Azure Data Lake Storage vs. Azure Event Hubs

Azure Data Lake storage is well suited for applications/use cases within organizations where capturing and storing large amounts of data in any format is required, primarily for storing and processing purposes. It's an easy and cost-effective cloud solution for your application data. The ability to integrate with other Azure Services like Azure Databricks and Azure Data Factory is superb.

Incentivized

Large IoT data ingestion which needs to be processed as batches or data which requires certain time to process in such scenario Azure Event Hubs is working very effective.

Incentivized

• Azure Data Lake Storage is extremely scalable. It allows us to scale up or down endlessly based on what we need including replication.
• In terms of security, Azure Data Lake Storage fits our requirements really well as we can monitor and encrypt seamlessly. We can also assign permissions through roles and grant network-level access.
• Due to the fact that it can scale, we are able to monitor the cost of storage and any given time and make financial decisions about our infrastructure based on how small or big we want to scale.

Incentivized

• message queuing
• data processing for notification.
• Handling large volumes of data from multiple sources.

Incentivized

• I'd like to see a better cross-platform native client. Azure Data Explorer is fine, but it's far from the "SSMS" kind of experience SQL Server users are used to.
• Listing a large number of file is somewhat problematic and slow. Using the native C# library, running directly on an Azure VM, it can take several hours to list just a couple million files.
• Switching from V1 to V2 requires the creation of a new Storage Account and that's pretty inconvenient.

Incentivized

• pricing should be less
• integration with the services should be enhanced.
• Deduplication functionality should be there in Azure Event Hubs

Incentivized

The Azure Data Lake solution is designed for organizations that want to take advantage of big data. It provides a data platform that can help developers, data scientists, and analysts store data of any size and format and perform all types of processing and analytics across multiple platforms and programming languages. It can work with your existing solutions, such as identity management and security solutions. It also integrates with other data warehouses and cloud environments. It can be useful for organizations that need the above softwares.

Incentivized

All platforms are good, costing wise it is effective, scalable is being managed by Azure Event Hubs only so only configuration is being required to do, also provides the encrypted, reliable and secure solution .

Incentivized

• The cost can be high for more advanced work. In some cases, for instance, time limits and lab runtimes may be too short if you are too slow to learn what is explained as you go along.
• promote flexible team communication. You can create different spaces for different teams, and share files and tasks.

Incentivized

• reducing the cost as you don't need to create a solution which is scalable
• increasing the productivity of the solution.
• customer satisfaction can be increased by integrating it as a solution.

Incentivized