Courseiva

DEA-C01 Data Ingestion and Transformation Practice Question

A data engineer is using AWS Glue Studio to build a visual ETL job that reads JSON files from Amazon S3, applies a mapping transform, and writes Parquet to another S3 location. The engineer notices that the job is writing many small files, which hurts downstream query performance. Which action should the engineer take to reduce the number of output files without changing the source data?

⚠ Common exam trap

The trap here is assuming that more compute resources will consolidate output, when adding workers usually increases the number of output files.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Use the repartition or coalesce transform before the S3 target to reduce the number of output partitions.

The number of files written by a Glue job corresponds to the number of partitions in the DataFrame at write time. Repartition or coalesce reduces that partition count, so the job writes fewer, larger files. This directly addresses the small-file issue without altering the source data or the output format.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • ✓

    Use the repartition or coalesce transform before the S3 target to reduce the number of output partitions.

    Why this is correct

    Repartition or coalesce changes the number of partitions in the DataFrame, which directly controls how many files are written. Coalesce is especially useful when reducing partitions without a full shuffle. Applying it before the target write consolidates output into fewer, larger files and improves downstream query performance.

  • ✗

    Increase the number of DPUs for the Glue job so more workers write files in parallel.

    Why it's wrong here

    Increasing DPUs adds more workers, which typically produces more output partitions and therefore more small files, not fewer. More parallelism helps throughput but does not consolidate the output, so it works against the goal of reducing file count in this scenario.

  • ✗

    Enable the Glue job bookmark so the job only processes new files on each run.

    Why it's wrong here

    Job bookmarks track which source data has already been processed to avoid reprocessing. They do not change how many files the job writes to the target location, so enabling bookmarks has no effect on the small-file problem described here.

  • ✗

    Change the output format from Parquet to CSV so the files are smaller and easier to manage.

    Why it's wrong here

    Switching to CSV does not reduce the number of files and actually makes each file less efficient for analytics because CSV is row-based and uncompressed by default. The small-file problem persists, and query performance typically gets worse rather than better.

Quick reference

AWS S3 Storage Class Comparison

Storage ClassMin DurationRetrievalUse Case
S3 StandardNoneImmediateFrequently accessed data
S3 Standard-IA30 daysImmediateInfrequent access, rapid retrieval
S3 One Zone-IA30 daysImmediateNon-critical infrequent data
S3 Intelligent-TieringNoneImmediate–hoursUnknown or changing access patterns
S3 Glacier Instant90 daysMillisecondsArchive with instant retrieval
S3 Glacier Flexible90 daysMinutes–hoursArchive, flexible retrieval
S3 Glacier Deep Archive180 daysHoursLong-term compliance archive

About these practice questions

One of 1,321 original DEA-C01 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

JA

Written and reviewed by Johnson Ajibi, MSc IT Security

Senior Network & Security Engineer · founder of Courseiva

Last reviewed September 2026 · checked against the official Amazon Web Services exam blueprint

This DEA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the DEA-C01 exam.