DEA-C01 Data Ingestion and Transformation Practice Test 8 — 15 Questions

Question 1

A CloudFormation template defines an AWS Glue job. The job fails during execution with the error 'Unable to locate script: s3://scripts-bucket/etl-script.py'. The S3 bucket 'scripts-bucket' exists and the script file is present. What is the most likely cause?

Accepted Answer

The IAM role for the Glue job does not have s3:GetObject permission on the scripts bucket.. The Glue job's IAM role likely lacks s3:GetObject permission for the scripts bucket. Option A is correct. Option B is wrong because the bucket is in the same region. Option C is wrong because the script location is correct syntax. Option D is wrong because Glue supports Python 3.

Answer

The script location path is incorrect; it should include the bucket's region.

Answer

The Glue job requires Python version 2, but the script uses Python 3 syntax.

Answer

The S3 bucket is in a different AWS region than the Glue job.

Question 2

A company is ingesting streaming data from IoT devices into Amazon Kinesis Data Streams. The data must be transformed in real-time and then stored in Amazon S3. Which AWS service should be used to perform the transformation?

Accepted Answer

Amazon Kinesis Data Analytics. Option A is correct because Amazon Kinesis Data Analytics can process and transform streaming data in real-time using SQL or Apache Flink. Option B is wrong because AWS Glue is a batch ETL service, not real-time. Option C is wrong because Amazon EMR is for big data processing, not real-time streaming transformation. Option D is wrong because Amazon Athena is an interactive query service, not for real-time transformation.

Answer

AWS Glue

Answer

Amazon EMR

Answer

Amazon Athena

Question 3

A data engineering team needs to load data from an on-premises Oracle database to Amazon S3 daily. The data volume is about 50 GB per day, and the network bandwidth is 100 Mbps. The team wants to minimize operational overhead and use AWS managed services. Which solution should they choose?

Accepted Answer

Use AWS Database Migration Service (DMS) to migrate the data to S3.. Option C is correct because AWS Database Migration Service (DMS) can continuously replicate or schedule data migration from on-premises databases to S3 with minimal setup. Option A is wrong because AWS DataSync is for file transfers, not database tables. Option B is wrong because AWS Glue can connect to JDBC sources but requires more configuration for scheduled loads. Option D is wrong because Amazon Kinesis Firehose is for streaming data, not for batch database loads.

Answer

Use AWS DataSync to copy the database files directly to S3.

Answer

Use AWS Glue with a JDBC connection and schedule a crawler to load data into S3.

Answer

Use Amazon Kinesis Data Firehose to stream data from Oracle to S3.

Question 4

A company uses Amazon Kinesis Data Streams with a shard count of 10 to ingest clickstream data. The data is consumed by a Lambda function that transforms the records and writes to Amazon S3. Recently, the Lambda function started failing with 'ProvisionedThroughputExceededException' errors. The average record size is 5 KB, and the incoming data rate is 15 MB/s. What is the most likely cause and solution?

Accepted Answer

Increase the number of shards in the Kinesis data stream to 15.. Option B is correct because with 10 shards, the total write capacity is 10 MB/s (1 MB/s per shard). The incoming rate is 15 MB/s, exceeding capacity. Increasing shards to 15 would provide 15 MB/s write capacity. Option A is wrong because Lambda concurrency is not the issue; the error is about throughput exceeded. Option C is wrong because increasing Lambda memory does not affect Kinesis write limits. Option D is wrong because the error is on the producer side, not the consumer.

Answer

Decrease the batch size of the Lambda event source mapping.

Answer

Increase the Lambda function's memory allocation to 3008 MB.

Answer

Increase the Lambda function's reserved concurrency.

Question 5

A data engineer needs to ingest data from an external partner's FTP server to Amazon S3. The data arrives once daily as a CSV file. Which AWS service should be used for this ingestion?

Accepted Answer

AWS Transfer Family. Option A is correct because AWS Transfer Family supports SFTP and FTP-based transfers into S3. Option B is wrong because AWS DataSync is for transfers between storage systems, but it requires agent installation. Option C is wrong because Amazon AppFlow is for SaaS applications, not FTP. Option D is wrong because Amazon Kinesis Firehose is for streaming data.

Answer

AWS DataSync

Answer

Amazon Kinesis Data Firehose

Answer

Amazon AppFlow

Question 6

A company uses AWS Glue to transform data in S3. The transformation job reads Parquet files, filters rows, and writes to another S3 bucket. The job takes longer than expected. Which change would MOST likely reduce the job execution time?

Accepted Answer

Increase the number of DPUs allocated to the Glue job.. Option B is correct because AWS Glue jobs can benefit from increased DPU allocation for parallel processing. Option A is wrong because converting to CSV would increase size and likely slow processing. Option C is wrong because reducing the number of partitions reduces parallelism, increasing time. Option D is wrong because using a single file does not improve parallelism.

Answer

Use a single large file instead of multiple small files.

Answer

Reduce the number of partitions in the output data.

Answer

Convert the input files from Parquet to CSV format.

Question 7

A data pipeline uses Amazon Kinesis Data Firehose to deliver data to an S3 bucket. The delivery stream is configured with a buffer interval of 60 seconds and a buffer size of 5 MB. The data arrives at an average rate of 2 MB per second. What is the expected time interval between S3 writes?

Accepted Answer

Approximately 2.5 seconds. Option A is correct because with 2 MB/s, the buffer size of 5 MB will be reached in 2.5 seconds, but the buffer interval is 60 seconds. Firehose writes when either condition is met first. Since the buffer size is reached much earlier, writes will occur approximately every 2.5 seconds. Option B, C, D are incorrect because they are based on the interval or miscalculations.

Answer

Approximately 30 seconds

Answer

Approximately 60 seconds

Answer

Approximately 10 seconds

Question 8

A company wants to ingest real-time data from a social media API into Amazon S3 for analysis. The API provides data as JSON records. Which AWS service is best suited for this ingestion?

Accepted Answer

Amazon Kinesis Data Firehose. Option D is correct because Amazon Kinesis Data Firehose can capture and load streaming data into S3 with minimal latency. Option A is wrong because AWS Glue is ETL, not real-time ingestion. Option B is wrong because Amazon SQS is a message queue, not designed for direct S3 loading. Option C is wrong because Amazon DataZone is for data cataloging, not ingestion.

Answer

AWS Glue

Answer

Amazon Simple Queue Service (SQS)

Answer

Amazon DataZone

Question 9

A data engineer needs to transform JSON data into Parquet format using AWS Glue. The input data has nested fields. Which Glue feature should be used to flatten the nested structure?

Accepted Answer

Relationalize transform. Option B is correct because AWS Glue's 'Relationalize' transform flattens nested JSON into a relational format. Option A is wrong because 'FindMatches' is for deduplication. Option C is wrong because 'DropNullFields' removes null fields. Option D is wrong because 'Map' is for simple field mappings.

Answer

DropNullFields transform

Answer

FindMatches transform

Answer

Map transform

Question 10

A company uses Amazon Kinesis Data Streams with enhanced fan-out consumers. The stream has 5 shards. Each consumer reads from all shards. The total incoming data rate is 25 MB/s. What is the maximum read throughput per consumer if enhanced fan-out is enabled?

Accepted Answer

10 MB/s. Option A is correct because enhanced fan-out provides each consumer with dedicated 2 MB/s per shard read throughput. With 5 shards, each consumer can read up to 10 MB/s. Option B is wrong because that is the total write capacity. Option C is wrong because that is the read capacity without enhanced fan-out. Option D is wrong because that is the per-shard write capacity.

Answer

2 MB/s

Answer

1 MB/s

Answer

5 MB/s

Question 11

A company needs to ingest streaming data from thousands of IoT devices. The data must be processed in real-time and stored in Amazon S3. Which TWO services should be used together?

Accepted Answer

Amazon Kinesis Data Streams. Options A and C are correct. Kinesis Data Streams ingests streaming data, and Kinesis Data Firehose can deliver data from the stream to S3. Option B is wrong because SQS is a message queue, not for real-time processing. Option D is wrong because Glue is batch. Option E is wrong because Direct Connect doesn't apply.

Answer

AWS Glue

Answer

Amazon Simple Queue Service (SQS)

Answer

AWS Direct Connect

Question 12

A data engineer needs to transform data in Amazon S3 using AWS Glue. The job must handle schema evolution and partition pruning. Which THREE features should be used?

Accepted Answer

AWS Glue Data Catalog. Options A, B, and D are correct. Glue crawlers update the schema, partitions enable pruning, and the Data Catalog stores metadata. Option C is wrong because Bookmarks are for state tracking, not schema evolution. Option E is wrong because FindMatches is for deduplication.

Answer

AWS Glue job bookmarks

Answer

AWS Glue FindMatches transform

Question 13

Which TWO AWS services can be used to ingest data from an on-premise relational database into Amazon S3 on a one-time basis?

Accepted Answer

AWS Database Migration Service (DMS). Options A and C are correct. AWS DMS can perform one-time full load from databases to S3. AWS Glue can connect to JDBC sources and write to S3. Option B is wrong because Kinesis Data Streams is for streaming. Option D is wrong because SQS is a queue. Option E is wrong because Data Pipeline is a legacy service.

Answer

AWS Data Pipeline

Answer

Amazon Simple Queue Service (SQS)

Answer

Amazon Kinesis Data Streams

Question 14

A data engineer is ingesting streaming data from thousands of IoT devices into AWS. The data is JSON-formatted and must be stored in Amazon S3 for long-term analytics. Which service is most appropriate for real-time ingestion and routing to S3?

Accepted Answer

Amazon Kinesis Data Firehose. Amazon Kinesis Data Firehose is the easiest way to load streaming data into S3. Kinesis Data Streams requires custom consumers; AWS Glue is batch ETL; Amazon SQS is not designed for direct S3 delivery.

Answer

Amazon SQS

Answer

Amazon Kinesis Data Streams

Answer

AWS Glue

Question 15

A company runs a SQL Server transactional database on Amazon RDS. They need to capture change data (inserts, updates, deletes) in near real-time and replicate them to an Amazon S3 data lake. Which AWS service is most suitable?

Accepted Answer

AWS Database Migration Service (DMS) with change data capture. AWS DMS with CDC continuously captures changes from the source and writes to S3 in Parquet/JSON. Kinesis, Glue, and Redshift are not designed for CDC from RDS to S3 directly.

Answer

AWS Glue DataBrew

Answer

Amazon Kinesis Data Streams with Kinesis Client Library

Answer

Amazon Redshift Spectrum