DEA-C01 Data Ingestion and Transformation Practice Test 24 — 15 Questions

Question 1

A data engineer needs to ingest data from an Amazon RDS for PostgreSQL database into Amazon S3 on a daily basis. The data volume is approximately 500 GB per day. Which service is most appropriate for this task?

Accepted Answer

AWS Glue with a scheduled ETL job. Option B is correct because AWS Glue can run ETL jobs to extract data from RDS and write to S3. Option A is wrong because AWS DMS is for database migration and continuous replication, not for daily batch jobs. Option C is wrong because Amazon Athena is a query service, not for data transfer. Option D is wrong because Amazon EMR is for big data processing and is overkill for this simple task.

Answer

AWS Database Migration Service (DMS) with continuous replication

Answer

Amazon Athena with federated query to RDS

Answer

Amazon EMR with Spark job

Question 2

A company uses AWS Glue to transform data in Amazon S3. The transformation logic is complex and involves multiple steps. The data engineer wants to implement a workflow that handles dependencies and retries on failure. Which AWS service should be used to orchestrate the Glue jobs?

Accepted Answer

AWS Step Functions. Option A is correct because AWS Step Functions can orchestrate multiple Glue jobs with error handling and retries. Option B is wrong because Amazon MWAA (Airflow) can also orchestrate but is more complex. Option C is wrong because Amazon CloudWatch Events schedules jobs but does not handle dependencies. Option D is wrong because AWS Lambda is not designed for orchestration of long-running jobs.

Answer

AWS Lambda

Answer

Amazon Managed Workflows for Apache Airflow (MWAA)

Answer

Amazon CloudWatch Events

Question 3

A data engineer is building a streaming pipeline using Amazon Kinesis Data Streams and AWS Lambda. The Lambda function processes records and writes to Amazon DynamoDB. The engineer notices that the Lambda function is throttled during high traffic. Which action should the engineer take to reduce throttling?

Accepted Answer

Increase the number of shards in the Kinesis data stream. Option C is correct because increasing the number of shards increases the number of Lambda concurrent executions, reducing throttling. Option A is wrong because increasing Lambda timeout does not reduce throttling. Option B is wrong because disabling retries loses data. Option D is wrong because using SQS adds latency and complexity.

Answer

Increase the Lambda function timeout

Answer

Disable retries on the Lambda function

Answer

Use an Amazon SQS queue as an intermediate buffer

Question 4

A company needs to ingest data from multiple SaaS applications into Amazon S3. The data sources provide REST APIs. Which AWS service can be used to build a fully managed data ingestion pipeline without writing custom code?

Accepted Answer

Amazon AppFlow. Option D is correct because Amazon AppFlow is a fully managed service to transfer data from SaaS applications to AWS. Option A is wrong because AWS Lambda requires custom code. Option B is wrong because AWS Glue is for ETL, not for direct API integration. Option C is wrong because Amazon Kinesis is for streaming data.

Answer

Amazon Kinesis Data Streams

Answer

AWS Lambda with custom code

Answer

AWS Glue with Python shell

Question 5

A data engineer is designing a data lake on Amazon S3. The data ingestion pipeline must handle both batch and streaming data. The engineer wants to use a single service to ingest both types of data. Which service should the engineer choose?

Accepted Answer

Amazon Kinesis Data Firehose. Option A is correct because Amazon Kinesis Data Firehose can ingest streaming data and can also be used for batch delivery by putting records in batches. Option B is wrong because AWS Glue is batch-only. Option C is wrong because Amazon Athena queries data, not ingests. Option D is wrong because S3 Transfer Acceleration speeds up uploads but does not handle streaming.

Answer

Amazon Athena

Answer

S3 Transfer Acceleration

Answer

AWS Glue

Question 6

A company uses Amazon Kinesis Data Firehose to deliver data to Amazon S3. The data is transformed using an AWS Lambda function. Some records fail transformation and are lost because the Lambda function throws an exception. The data engineer needs to capture the failed records for analysis without affecting the pipeline. What should the engineer do?

Accepted Answer

Configure the Firehose delivery stream to send failed records to a backup S3 bucket. Option B is correct because configuring a backup S3 bucket for failed records captures them without stopping the pipeline. Option A is wrong because storing in DynamoDB adds complexity and is not a native Firehose feature. Option C is wrong because disabling transformation loses data quality. Option D is wrong because increasing buffer size does not capture failed records.

Answer

Increase the buffer size of the Firehose stream

Answer

Disable the Lambda transformation and process all records in batch later

Answer

Modify the Lambda function to write failed records to Amazon DynamoDB

Question 7

A data engineer is designing a data ingestion pipeline for streaming data from IoT devices. The devices send JSON messages every second. The engineer needs to ingest the data with low latency and store it in Amazon S3 in Parquet format. Which TWO services should the engineer use together?

Accepted Answer

Amazon Kinesis Data Streams. Options B and D are correct. Kinesis Data Streams provides low-latency ingestion, and Kinesis Data Firehose can convert data to Parquet and deliver to S3. Option A (Glue) is batch-oriented. Option C (Athena) is for querying. Option E (Lambda) can be used but is not required for the conversion; Firehose can do it natively.

Answer

AWS Lambda

Answer

Amazon Athena

Answer

AWS Glue

Question 8

A data engineer is building a pipeline to ingest data from an on-premises Oracle database into Amazon S3. The pipeline must capture change data (CDC) in near real-time and handle schema changes. Which TWO AWS services should the engineer use?

Accepted Answer

AWS Glue Schema Registry. Options A and D are correct. AWS DMS with CDC captures ongoing changes, and AWS Glue Schema Registry handles schema evolution. Option B (Kinesis) is not for database CDC. Option C (Snowball) is batch. Option E (AppFlow) is for SaaS, not on-prem databases.

Answer

AWS Snowball Edge

Answer

Amazon AppFlow

Answer

Amazon Kinesis Data Streams with Kinesis Agent

Question 9

A company uses Amazon Kinesis Data Firehose to deliver data to Amazon S3. The data engineer needs to transform the data before delivery. Which THREE options can be used to perform the transformation?

Accepted Answer

Amazon Kinesis Data Firehose data format conversion (e.g., JSON to Parquet). Options A, C, and D are correct. Lambda can transform records, Firehose can convert to Parquet/ORC, and Firehose can invoke Lambda for dynamic partitioning. Option B (Glue) is not integrated with Firehose directly. Option E (Athena) is for querying.

Answer

Amazon Athena queries

Answer

AWS Glue ETL job

Question 10

Refer to the exhibit. An IAM policy is attached to an AWS Glue ETL job. The job reads from the Kinesis stream 'input-stream' and writes to S3 bucket 'data-lake-bucket'. The job fails with an access denied error. Which missing permission is most likely the cause?

Accepted Answer

s3:ListBucket permission on the bucket. Option D is correct. The policy includes s3:PutObject but not s3:ListBucket, which is required for Glue to write to S3. Option A is wrong because the policy does not restrict to a prefix. Option B is wrong because kinesis:DescribeStream is not required for writing. Option C is wrong because the stream ARN is specific.

Answer

kinesis:PutRecord permission on a wildcard stream ARN

Answer

kinesis:DescribeStream permission

Answer

s3:PutObject permission on a specific prefix

Question 11

Refer to the exhibit. A data engineer is using a Kinesis Data Stream with one shard. The application writes 2000 records per second, each 1 KB. The put record calls are frequently throttled. What is the most likely cause?

Accepted Answer

The stream has only one shard, which limits writes to 1000 records per second. Option B is correct. A single shard supports 1000 records/sec write. The application exceeds this. Option A is wrong because retention does not affect throttling. Option C is wrong because encryption does not affect throttling. Option D is wrong because enhanced monitoring is not related.

Answer

The retention period of 24 hours is too short

Answer

The stream uses KMS encryption, causing additional latency

Answer

Enhanced monitoring is not enabled, causing performance issues

Question 12

Refer to the exhibit. An S3 event notification is configured to trigger an AWS Lambda function when objects are created in 'my-bucket'. The Lambda function processes the JSON file and writes results to Amazon DynamoDB. The function fails with a timeout error. Which action should the engineer take to resolve the issue?

Accepted Answer

Increase the Lambda function timeout. Option C is correct. If the function times out, increasing the timeout gives it more time to complete. Option A is wrong because the event is correct. Option B is wrong because the function can access DynamoDB with the right permissions. Option D is wrong because the event is from S3.

Answer

Modify the S3 event notification to use a different event type

Answer

Grant the Lambda function permission to access DynamoDB

Answer

Change the trigger to Amazon SQS instead of S3

Question 13

A data engineering team is ingesting streaming data from IoT devices using AWS IoT Core and needs to process the data in near real-time with minimal code. Which AWS service should they use to transform the data before storing it in Amazon S3?

Accepted Answer

Amazon Kinesis Data Analytics. Option B is correct because AWS IoT Core can route messages to Kinesis Data Analytics for SQL-based streaming transformations. Option A is wrong because Glue is for batch ETL, not real-time. Option C is wrong because Redshift is for warehousing. Option D is wrong because Athena is for ad-hoc querying, not streaming.

Answer

AWS Glue

Answer

Amazon Redshift

Answer

Amazon Athena

Question 14

A company uses Amazon S3 to store raw data and needs to transform it into Parquet format for analytics. The transformation job runs daily on a schedule. Which AWS service is BEST suited for this task?

Accepted Answer

AWS Glue. Option C is correct because AWS Glue is a serverless ETL service that can run scheduled jobs to convert data to Parquet. Option A is wrong because Lambda has a 15-minute timeout. Option B is wrong because EMR requires managing clusters. Option D is wrong because Redshift is a warehouse, not for file conversion.

Answer

Amazon Redshift

Answer

Amazon EMR

Answer

AWS Lambda

Question 15

A company is ingesting data from multiple on-premises databases into AWS using AWS Database Migration Service (DMS). The data must be continuously replicated with minimal downtime. However, the source databases do not support native CDC. What should the data engineer do to enable continuous replication?

Accepted Answer

Use AWS DMS with log-based CDC if the source databases support it; otherwise, use DMS with batch replication and schedule frequent refreshes.. Option A is correct because DMS can use the source engine's native CDC capabilities (e.g., Oracle GoldenGate, MySQL binlog) or log-based CDC if available. Option B is wrong because Glue is not for real-time CDC from databases. Option C is wrong because Kinesis is for streaming data, not for pulling from databases. Option D is wrong because Redshift is a target, not a replication tool.

Answer

Use Amazon Kinesis Data Streams with a custom producer to capture database changes.

Answer

Use Amazon Redshift Spectrum to directly query the on-premises databases.

Answer

Set up AWS Glue jobs to run every minute to extract and load the data.