easyMultiple ChoiceObjective-mapped
AIF-C01 Practice Question: A startup is building a code generation assistant…
A startup is building a code generation assistant using a large language model. They want to evaluate the quality of generated code compared to reference implementations. Which automated metric is MOST suitable for this task?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
BLEU
BLEU is commonly used for code generation evaluation, measuring n-gram overlap with reference code. ROUGE is for summarization, BERTScore for semantic similarity, and accuracy is for classification.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
BERTScore
Why it's wrong here
BERTScore measures semantic similarity, not lexical match important for code.
- ✓
BLEU
Why this is correct
BLEU measures n-gram precision and is widely used for code translation/generation tasks.
- ✗
ROUGE
Why it's wrong here
ROUGE is designed for summarization, not code.
- ✗
Accuracy
Why it's wrong here
Accuracy is for classification tasks, not generative output.
Go deeper
Related to this question
About these practice questions
This AIF-C01 question is part of Courseiva's 619-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AIF-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AIF-C01 exam.