Courseiva
mediumMultiple SelectObjective-mapped

AIF-C01 Practice Question: A developer is evaluating generative AI models…

A developer is evaluating generative AI models for a code generation task. Which THREE metrics are commonly used for automated evaluation of generated code? (Choose THREE.)

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

BERTScore

Common automated metrics for code generation include BLEU (n-gram overlap), ROUGE (recall-oriented), and BERTScore (contextual similarity). Perplexity is for language modeling, and human evaluation is not automated. Note: While ROUGE and BLEU originate from NLP, they are also used for code generation evaluation.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • BERTScore

    Why this is correct

    BERTScore uses embeddings to compute similarity and is applicable to code.

  • BLEU

    Why this is correct

    BLEU measures precision of n-grams and is used for code translation tasks.

  • ROUGE

    Why this is correct

    ROUGE measures recall of n-grams and is used for code summarization.

  • Human evaluation score

    Why it's wrong here

    Human evaluation is not an automated metric.

  • Perplexity

    Why it's wrong here

    Perplexity is a language model metric, not directly for evaluating generated code.

About these practice questions

Courseiva writes every AIF-C01 question from scratch — 619 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

JA

Written by Johnson Ajibi, MSc IT Security

Senior Network & Security Engineer · founder of Courseiva

This AIF-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AIF-C01 exam.