How to Reduce Kinesis Firehose Delivery Latency for Small Records
A company uses Amazon Kinesis Data Firehose to ingest log data from web servers into Amazon S3. The data is in JSON format and each record is approximately 2 KB. The delivery stream is configured to buffer incoming records for 60 seconds or 5 MB, whichever comes first. The company notices that the data in S3 is delayed by up to 5 minutes during peak hours. Which action would most effectively reduce the delivery latency?
Quick Answer
The answer is to decrease the buffer interval to 15 seconds. This is the most effective action because Kinesis Data Firehose delivery latency is governed by two buffer triggers: a size threshold (5 MB) and an interval threshold (60 seconds). With small 2 KB records, the stream rarely hits the 5 MB size limit during peak hours, so delivery relies entirely on the 60-second interval, which can compound into the observed 5-minute delay due to queuing. On the AWS Certified Data Engineer Associate DEA-C01 exam, this scenario tests your understanding of how buffer hints directly control latency for small-record streams—a common trap is mistakenly increasing the buffer size or switching to a different service. The key insight is that for tiny records, the interval is the bottleneck, not the size. Memory tip: think "small records, shrink the clock"—when records are tiny, reduce the buffer interval to cut latency.
⚠ Common exam trap
Watch out — candidates often assume increasing buffer size or enabling compression will speed up delivery, but they fail to recognize that with small records, the buffer interval is the bottleneck, and only reducing that interval directly lowers latency.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Decrease the buffer interval to 15 seconds.
The observed delay of up to 5 minutes during peak hours indicates that the buffer size threshold (5 MB) is rarely reached because each record is only ~2 KB, so the delivery stream relies on the buffer interval (60 seconds) to trigger delivery. By decreasing the buffer interval to 15 seconds, Kinesis Data Firehose will push data to S3 more frequently, directly reducing the maximum latency from 60 seconds to 15 seconds per batch, which eliminates the compounding delays caused by queuing during high-throughput periods.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Increase the buffer size to 10 MB to allow more records per delivery.
Why it's wrong here
Larger buffer size increases latency as more data accumulates before delivery.
- ✓
Decrease the buffer interval to 15 seconds.
Why this is correct
Shorter buffer interval triggers more frequent deliveries, reducing latency.
- ✗
Enable compression (GZIP) on the delivery stream.
Why it's wrong here
Compression reduces file size but does not affect delivery frequency.
- ✗
Enable data transformation with AWS Lambda to convert JSON to Parquet.
Why it's wrong here
Transformation adds processing time, potentially increasing latency.
Quick reference
AWS S3 Storage Class Comparison
| Storage Class | Min Duration | Retrieval | Use Case |
|---|---|---|---|
| S3 Standard | None | Immediate | Frequently accessed data |
| S3 Standard-IA | 30 days | Immediate | Infrequent access, rapid retrieval |
| S3 One Zone-IA | 30 days | Immediate | Non-critical infrequent data |
| S3 Intelligent-Tiering | None | Immediate–hours | Unknown or changing access patterns |
| S3 Glacier Instant | 90 days | Milliseconds | Archive with instant retrieval |
| S3 Glacier Flexible | 90 days | Minutes–hours | Archive, flexible retrieval |
| S3 Glacier Deep Archive | 180 days | Hours | Long-term compliance archive |
Go deeper
Related to this question
About these practice questions
One of 1,711 original DEA-C01 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
2 more ways this is tested on DEA-C01
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A company uses Amazon Kinesis Data Firehose to deliver data to an Amazon S3 bucket. The data delivery is delayed by up to 5 minutes. The engineer wants to reduce the delay to under 1 minute. Which parameter should be adjusted?
easy- A.Enable error logging to CloudWatch.
- B.Increase the buffer size in Kinesis Data Firehose.
- C.Enable data compression.
- ✓ D.Decrease the buffer interval in Kinesis Data Firehose.
Why D: Decreasing the buffer interval reduces the time Kinesis Data Firehose waits before delivering a batch, thus lowering latency to under 1 minute. Option A is incorrect because error logging to CloudWatch does not affect delivery timing. Option B is incorrect because increasing the buffer size would actually increase the delay as Firehose waits for more data to accumulate. Option C is incorrect because enabling data compression reduces storage size but has no impact on delivery frequency.
Variation 2. A company is using Amazon Kinesis Data Firehose to deliver data to an Amazon S3 bucket. The data is delivered in 5-minute intervals. The company wants to reduce the delivery frequency to 1 minute to get data faster. Which parameter should be changed in the Firehose delivery stream configuration?
easy- ✓ A.Reduce the buffer interval from 300 seconds to 60 seconds.
- B.Increase the buffer size to trigger delivery sooner.
- C.Enable dynamic partitioning to deliver data more frequently.
- D.Enable compression to reduce data size and speed up delivery.
Why A: The buffer interval determines how often data is delivered to the destination. Changing it from 300 seconds to 60 seconds will deliver data every minute. Option B (buffer size) affects delivery based on data volume, not time. Option C (compression) does not affect frequency. Option D (partitioning) does not affect delivery frequency.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This DEA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the DEA-C01 exam.