A company ingests streaming data from IoT devices into Azure Event Hubs. The data must be processed in near real-time to detect anomalies and stored in Azure Data Lake Storage Gen2 for historical analysis. The solution must minimize latency and avoid duplicate processing. Which Azure service should be used for processing?
Trap 1: Azure Data Factory
Azure Data Factory is for batch orchestration, not real-time streaming.
Trap 2: Azure Databricks with Structured Streaming
Azure Databricks can process streams but has higher latency and complexity compared to Stream Analytics for this scenario.
Trap 3: Azure Functions with Event Hubs trigger
Azure Functions can process events but lacks built-in stream processing features like windowing and exactly-once.
- A
Azure Data Factory
Why wrong: Azure Data Factory is for batch orchestration, not real-time streaming.
- B
Azure Databricks with Structured Streaming
Why wrong: Azure Databricks can process streams but has higher latency and complexity compared to Stream Analytics for this scenario.
- C
Azure Functions with Event Hubs trigger
Why wrong: Azure Functions can process events but lacks built-in stream processing features like windowing and exactly-once.
- D
Azure Stream Analytics
Azure Stream Analytics provides low-latency stream processing with exactly-once semantics and integrates with Event Hubs and Data Lake Storage.