A company uses Kinesis Data Streams to ingest clickstream data. They notice that the data processing latency increases as the number of shards grows. What is the most likely cause and solution?
Balancing shards and consumers ensures each shard is processed, reducing latency.
Why this answer
Option D is correct because when there are more shards than consumers, some shards are idle, leading to underutilization and increased latency. Option A is wrong because increasing shards would worsen the imbalance. Option B is wrong because enhanced fan-out is for multiple consumers, not single consumer.
Option C is wrong because increasing batch size might help throughput but not the fundamental shard-consumer mismatch.