Quick Answer
The answer is BLEU and perplexity. BLEU, or Bilingual Evaluation Understudy, is the correct choice because it measures the n-gram overlap between generated text and a reference, making it ideal for assessing fluency and relevance in tasks like marketing content generation. Perplexity, on the other hand, evaluates how confidently a language model predicts a sample—lower perplexity indicates higher coherence and predictability in the generated text. On the AWS Certified AI Practitioner AIF-C01 exam, this question tests your understanding of evaluation metrics for foundation models on Amazon Bedrock, specifically distinguishing between reference-based metrics like BLEU and intrinsic model metrics like perplexity. A common trap is confusing BLEU with ROUGE, which is used for summarization, not general text quality. For a quick memory tip: think of BLEU as “Bilingual Lookalike Evaluation” for matching reference text, and perplexity as “Predictive Perplexity” where lower is better for confidence.
This AIF-C01 practice question tests your understanding of applications of foundation models. Compare every option against the stated constraints before choosing — the best answer satisfies all requirements, not just the most obvious one. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
A company is using Amazon Bedrock to generate marketing content. They want to evaluate the quality of the generated text. Which TWO metrics are most appropriate for evaluating text quality?
Precision
Why wrong: Precision is for classification.
Perplexity
Perplexity measures how well the model predicts the text.
Accuracy
Why wrong: Accuracy is for classification tasks, not text generation.
F1 score
Why wrong: F1 score is for classification.
BLEU (Bilingual Evaluation Understudy)
BLEU measures n-gram overlap with reference text.
Answer choices
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
Perplexity
Perplexity measures how well a language model predicts a sample, with lower values indicating higher confidence and coherence in generated text. BLEU evaluates the overlap between generated text and reference text, making it suitable for assessing fluency and relevance in content generation tasks like marketing copy.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
For each option: why learners choose it and why it is or isn't the right answer here.
Precision
Why it's wrong here
Precision is for classification.
Perplexity
Why this is correct
Perplexity measures how well the model predicts the text.
Related concept
Read the scenario before looking for a memorised answer.
Accuracy
Why it's wrong here
Accuracy is for classification tasks, not text generation.
F1 score
Why it's wrong here
F1 score is for classification.
BLEU (Bilingual Evaluation Understudy)
Why this is correct
BLEU measures n-gram overlap with reference text.
Related concept
Read the scenario before looking for a memorised answer.
Common exam traps
AWS often tests the distinction between classification metrics (precision, accuracy, F1) and generation evaluation metrics (perplexity, BLEU), leading candidates to mistakenly apply classification concepts to text quality assessment.
Detailed technical explanation
Perplexity is calculated as the exponentiated average negative log-likelihood of a sequence, reflecting the model's uncertainty; lower perplexity indicates better predictive performance. BLEU computes n-gram precision with a brevity penalty to penalize overly short outputs, and it is commonly used in machine translation and text generation tasks where reference texts are available. In marketing content generation, BLEU can compare generated copy against human-written examples, while perplexity helps gauge the model's internal confidence in its own output.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
A cloud solutions architect for a retail company is evaluating services for a new workload. The correct answer here reflects best practice for the specific scenario described — not a general cloud recommendation. Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option. Cloud exam questions reward reading the constraint carefully: the same technology can be right or wrong depending on the use case.
What to study next
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Applications of Foundation Models — study guide chapter
Learn the concepts, then practise the questions
Applications of Foundation Models practice questions
Targeted practice on this topic area only
All AIF-C01 questions
500 questions across all exam domains
AWS Certified AI Practitioner AIF-C01 study guide
Full concept coverage aligned to exam objectives
AIF-C01 practice test guide
How to use practice tests most effectively before exam day
Related practice questions
Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.
Practise AIF-C01 questions linked to Applications of Foundation Models.
Practise AIF-C01 questions linked to Fundamentals of AI and ML.
Practise AIF-C01 questions linked to Fundamentals of Generative AI.
Practise AIF-C01 questions linked to Guidelines for Responsible AI.
Practise AIF-C01 questions linked to Security, Compliance and Governance for AI Solutions.
Practise AIF-C01 questions linked to AIF-C01 fundamentals.
Practise AIF-C01 questions linked to AIF-C01 scenario.
Practise AIF-C01 questions linked to AIF-C01 troubleshooting.
Practice this exam
Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.
FAQ
Applications of Foundation Models — This question tests Applications of Foundation Models — Read the scenario before looking for a memorised answer..
The correct answer is: Perplexity — Perplexity measures how well a language model predicts a sample, with lower values indicating higher confidence and coherence in generated text. BLEU evaluates the overlap between generated text and reference text, making it suitable for assessing fluency and relevance in content generation tasks like marketing copy.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A company uses Amazon Bedrock to generate marketing copy. They want to measure the quality of generated text compared to reference text. Which metric is most appropriate?
mediumWhy B: BLEU (Bilingual Evaluation Understudy) is the most appropriate metric for evaluating the quality of generated text against reference text in tasks like machine translation and text generation. It measures n-gram precision between the generated and reference texts, making it ideal for assessing marketing copy generated by Amazon Bedrock.
Last reviewed: Jun 30, 2026
This AIF-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AIF-C01 exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.