Azure DataLake Storage Gen2 (ADLS2) Data Ingestion Tools

Data Ingestion Tools for Azure DataLake Storage Gen2 (ADLS2)

Question

ABC company has 1000s of IoT devices spread across the continent.

The company collects real-time data from these sources and stores it using Azure DataLake storage Gen2(ADLS2)

Which of the following tells about the tools used for ingesting this data to ADLS2?

Answers

Explanations

Click on the arrows to vote for the correct answer

A. B. C. D.

Correct Answers: A and B

The first point to keep in mind is that the data is real-time and is coming from 100s of devices.

So, it is a streaming data ingest solution we are looking for.

Azure Stream Analytics and Azure HDInsight Storm can ingest streaming data seamlessly and they integrate with ADLS2 easily.

So, this makes them the right choice.

Options A and B are correct: Both of them can ingest streaming data.

Option C is incorrect: Azure data factory cannot be used for streaming data.

Option D is incorrect: A and B are answers.

To know more about Streaming Data ingestion, please refer to the doc below:

The correct answer is option C, Azure Data Factory.

Azure Data Factory is a cloud-based data integration service that allows you to create, schedule, and manage data pipelines that ingest and transform data from various sources, including IoT devices, into ADLS2.

With Azure Data Factory, you can configure and monitor data pipelines that can scale to handle large amounts of data from different sources. It provides connectors to various data sources and allows you to create data transformation workflows using a visual interface or code.

Azure Stream Analytics and Azure HDInsight Storm are not the ideal tools for ingesting data into ADLS2. Azure Stream Analytics is used for real-time data stream processing, while Azure HDInsight Storm is a distributed stream processing framework used to process large volumes of data in real-time. Both tools are used for real-time data processing, but they are not designed for ingesting data into ADLS2.

Therefore, the correct option for the tools used for ingesting data into ADLS2 is Azure Data Factory.