DEA-C01 Data Operations and Support Practice Question

Exhibit

2024-01-15T10:30:00Z ERROR 123456789012 i-0abcd1234efgh5678 {"errorCode": "InvalidS3ObjectException", "errorMessage": "The specified S3 object is not a valid Parquet file."}

Refer to the exhibit. A data engineer sees this error in CloudWatch Logs from an AWS Glue ETL job. The job reads from an S3 location that contains both .parquet and .csv files. What is the most likely cause?

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

The job is reading a CSV file that was incorrectly placed in the directory with .parquet extension.

The error indicates that the job encountered an object that is not a valid Parquet file. Since the S3 location contains both .parquet and .csv files, the Glue job likely attempted to read a CSV file as if it were Parquet, causing the invalid Parquet error. Option C is correct because the CSV file was incorrectly placed in the directory with a .parquet extension (or the job's schema inference expects all files to be Parquet). Option A is incorrect because the error is about format, not a missing file. Option B is incorrect because the error is about the object's format, not a permissions issue. Option D is incorrect because insufficient memory would typically cause out-of-memory or capacity errors, not an invalid Parquet error.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✗
The S3 object was deleted during the job execution.
Why it's wrong here
Deletion would cause a different error.
✗
The IAM role does not have permission to read the S3 object.
Why it's wrong here
Permission errors would be AccessDenied.
✓
The job is reading a CSV file that was incorrectly placed in the directory with .parquet extension.
Why this is correct
The file might have .parquet extension but be CSV, or the job is reading all files regardless of extension.
✗
The Glue job does not have enough memory to parse the Parquet file.
Why it's wrong here
Memory issues cause different errors.

Quick reference

AWS S3 Storage Class Comparison

Storage Class	Min Duration	Retrieval	Use Case
S3 Standard	None	Immediate	Frequently accessed data
S3 Standard-IA	30 days	Immediate	Infrequent access, rapid retrieval
S3 One Zone-IA	30 days	Immediate	Non-critical infrequent data
S3 Intelligent-Tiering	None	Immediate–hours	Unknown or changing access patterns
S3 Glacier Instant	90 days	Milliseconds	Archive with instant retrieval
S3 Glacier Flexible	90 days	Minutes–hours	Archive, flexible retrieval
S3 Glacier Deep Archive	180 days	Hours	Long-term compliance archive

Go deeper

DEA-C01 Data Operations and Support Practice Question

Exhibit

Why each option matters

Option-by-option breakdown

AWS S3 Storage Class Comparison

Related to this question