DEA-C01 Data Ingestion and Transformation Practice Question

Correct answer & explanation

The stream does not have enough shards to handle the write throughput. Each Kinesis shard can ingest up to 1 MB/s or 1000 records per second (for up to 1 KB record size). With 2 shards, the total write capacity is 2 MB/s or 2000 records/s. However, the average record size is 50 KB, and the write rate is 1500 records/s. The throughput in MB/s is 1500 * 50 KB = 75 MB/s, which far exceeds the 2 MB/s total capacity. Therefore, the stream is under-provisioned, causing high write latency. Option A is incorrect because the region of the application does not directly cause high latency; cross-region latency might be a factor but not the most likely given the throughput metrics. Option B is incorrect because DynamoDB provisioned throughput is not relevant to Kinesis streams. Option C is incorrect because throttling due to a hot shard would occur if data is unevenly distributed, but the issue here is overall insufficient shard count given the high throughput demand.