You are architecting a real-time anomaly detection system. Sensor data is ingested into an Azure Event Hub. Due to intermittent network issues between the IoT gateway and Azure, duplicate events are occasionally sent. You need downstream Stream Analytics to process each unique event exactly once within a sliding window. Which Event Hub property should you leverage?
Assigning a partition key ensures that events with the same key always land on the same partition, enabling stateful stream processing and deduplication.
Why this answer
Event Hubs supports publisher journaling and offset tracking, but for exact-once processing or deduplication, Stream Analytics utilizes the Event Hub Enqueued Time and Partition ID along with watermark definitions, or you can leverage Event Hubs partition keys to ensure identical events go to the same partition.