DEA-C01 Data Operations and Support Practice Question

Exhibit

2024-05-10T12:00:00Z ERROR 1234567890 Job failed: java.lang.OutOfMemoryError: Java heap space
2024-05-10T12:01:00Z INFO  1234567890 Job terminated with exit code 1

Refer to the exhibit. This log snippet is from a failed AWS Glue job. The job processes a large dataset in memory. What is the MOST likely cause of the OutOfMemoryError?

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

The Glue job is running with insufficient DPUs or worker type.

An OutOfMemoryError in AWS Glue typically occurs when the allocated DPUs or worker type are insufficient for the in-memory processing of a large dataset. Option B is incorrect because unsupported file formats cause parsing errors, not memory errors. Option C is incorrect because mismatched keys in a join cause data skew or incorrect results, but not directly an OutOfMemoryError. Option D is incorrect because too many partitions usually lead to small file overhead, not heap space exhaustion.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✓
The Glue job is running with insufficient DPUs or worker type.
Why this is correct
Insufficient resources cause out-of-memory.
✗
The input data is in an unsupported file format.
Why it's wrong here
Format does not cause heap space error directly.
✗
The job is attempting to join two tables with mismatched keys.
Why it's wrong here
This would cause data skew, but the error is heap space.
✗
The job has too many partitions.
Why it's wrong here
Too many partitions can cause overhead, but the error is heap space.

Go deeper

DEA-C01 Data Operations and Support Practice Question

Exhibit

Why each option matters

Option-by-option breakdown

Related to this question