Courseiva

Databricks-DE-Pro

Study mode — explanations shown

1

Data Ingestion and Acquisition

medium

A data engineer is building a streaming ingestion pipeline from Apache Kafka to a Delta table. The pipeline must perform deduplication on a unique event_id field and handle late-arriving data. The engineer wants to use Structured Streaming with a watermark of 10 minutes. Which of the following approaches correctly implements deduplication and watermarking?

0 of 180 answered