CCAO-F Practice Test 11 — 15 Questions

Question 1

A team is building a pipeline where Claude must extract structured fields from invoices. They provide several examples of input and expected output in the prompt. The model performs well on formats similar to the examples but fails on a new invoice layout. Which adjustment best addresses this?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Diversify the few-shot examples to cover multiple invoice layouts and edge cases.. Few-shot prompting works by demonstrating the desired mapping between inputs and outputs. When all examples share a single format, the model learns that format rather than the underlying task. Diversifying examples across layouts and edge cases teaches the general extraction behavior, which improves performance on new invoice structures.

Answer

Lower the temperature to 0 and keep the examples unchanged.

Answer

Increase the number of examples to twenty, all using the same invoice layout.

Answer

Remove the examples and rely solely on a detailed instruction describing the fields.

Question 2

A developer is building a customer-facing assistant with the Claude Messages API and must implement multi-turn conversations that stay within context limits while remaining coherent. Which TWO practices are appropriate for managing the conversation history? (Choose two.)

Accepted Answer

Store durable facts and user preferences in a separate summary that is injected into the system prompt on each call.. Because the Messages API keeps no server-side session, the client owns conversation state and must resend it. The practical approaches are to manage the growing messages array by trimming or summarizing old turns, and to preserve durable facts in a compact summary injected through the system prompt. Neither raising max_tokens nor deleting assistant turns addresses the input-size limit, and the API does not remember prior turns on its own.

Answer

Rely on the API to remember previous turns server-side using a conversation identifier returned in each response.

Answer

Delete all prior assistant turns and keep only user messages to halve the token usage.

Answer

Increase max_tokens to the model's maximum on every request so no earlier turn is ever dropped.

Question 3

A developer is building a customer support assistant using Claude. The assistant must answer questions based on a knowledge base of product manuals. The developer wants to minimize hallucinations and ensure responses are grounded in the provided documents. Which TWO strategies should the developer implement? (Choose two.)

Accepted Answer

Include the relevant manual excerpts directly in the prompt within XML tags.. To minimize hallucinations and ground responses in provided documents, the developer should both supply the relevant excerpts in the prompt and instruct Claude to answer only from those excerpts. Including the text within XML tags focuses the model's attention, while the instruction to admit uncertainty prevents it from inventing answers. Together, these strategies create a constrained generation environment that prioritizes factual accuracy and source fidelity.

Answer

Use a chain-of-thought prompt asking Claude to reason step-by-step before answering.

Answer

Fine-tune Claude on the entire knowledge base to embed the information into the model weights.

Answer

Set the temperature parameter to a high value to encourage more creative responses.

Question 4

A developer is building an application that uses the Anthropic Messages API with Claude 3.5 Sonnet to generate structured JSON output for a data pipeline. They need to ensure the output is valid JSON and conforms to a specific schema. Which TWO strategies should they use to maximize reliability? (Choose two.)

Accepted Answer

Include a clear instruction in the system prompt that the response must be valid JSON matching the provided schema, and provide the schema in the prompt.. To maximize reliability for JSON output with Claude 3.5 Sonnet, combine explicit schema instructions in the system prompt with the prefill technique of starting the assistant response with an opening brace. These two strategies directly guide the model toward valid, schema-conformant JSON. Other parameters like temperature, max_tokens, and stop sequences do not enforce structure and may even harm output validity.

Answer

Set the temperature to 1.0 to encourage Claude to explore different JSON structures and pick the most valid one.

Answer

Increase the max_tokens to the maximum allowed so Claude has enough space to include all schema fields.

Answer

Use a stop sequence of '}' to ensure Claude stops immediately after closing the JSON object.

Question 5

A developer is optimizing a high-volume classification workload on the Claude Messages API. Every request shares a long, static set of instructions and few-shot examples, followed by a short variable user input. The developer wants to cut cost and latency without changing output quality. Which feature should the developer apply?

Accepted Answer

Enable prompt caching on the shared instruction and example prefix, placing the variable input after the cached portion.. When many requests share an identical leading block of tokens, prompt caching lets the API reuse the processed prefix. Cache reads cost less and reduce latency, and because the cached content is unchanged, output quality is preserved. The variable input must come after the cached prefix so the cacheable portion stays contiguous. Repositioning content, shrinking output limits, or swapping models does not achieve the same effect without side effects.

Answer

Move the static instructions into the system parameter and the few-shot examples into the final user turn.

Answer

Switch to a smaller model and remove the few-shot examples to compensate for the reduced capability.

Answer

Lower max_tokens to the smallest value that still fits a classification label.

Question 6

A developer is building a document summarization service that calls the Claude Messages API. The service must always respond in valid JSON containing exactly two fields: "summary" and "confidence". The developer wants to maximize the chance of receiving a valid JSON object without writing a custom parser. Which approach should the developer take?

Accepted Answer

Use the Messages API with a tool definition whose input_schema describes the two required fields, and require the tool to be called.. Tool use with a JSON Schema input_schema is the Messages API's structured-output mechanism. By declaring the two fields as required properties and forcing the tool call, the developer makes Claude return arguments that conform to the schema, eliminating custom parsing. Instruction-only approaches and temperature tuning reduce but do not remove the risk of malformed or extra output, so they are less reliable for a strict two-field contract.

Answer

Send the request with temperature set to 0 and count the number of braces in the response to validate the JSON.

Answer

Set the system prompt to instruct Claude to reply only with JSON, and include a single example of the desired JSON structure.

Answer

Append the word "JSON" to the end of the user message and set max_tokens to a value large enough for the expected output.

Question 7

A machine learning engineer is comparing Claude 3 Opus and Claude 3.5 Sonnet for a complex mathematical reasoning task. The task involves multi-step proofs and requires the highest possible accuracy. Cost is not a primary concern. Which statement accurately describes the trade-off between these models for this use case?

Accepted Answer

Claude 3 Opus is designed for the most complex reasoning tasks and generally offers higher accuracy than Claude 3.5 Sonnet on such tasks, though at higher cost and latency.. For a complex mathematical reasoning task where accuracy is paramount and cost is not a concern, Claude 3 Opus is the best choice. It is the most capable model in the Claude 3 family, designed for the most demanding reasoning tasks, and generally provides higher accuracy than Claude 3.5 Sonnet, albeit with higher cost and latency.

Answer

Claude 3.5 Sonnet is strictly more capable than Claude 3 Opus in all reasoning tasks.

Answer

Claude 3.5 Sonnet is always faster and more accurate than Claude 3 Opus, making it the best choice regardless of task complexity.

Answer

Both models have identical reasoning capabilities, so the choice should be based solely on cost.

Question 8

A product team is preparing to launch a Claude-powered assistant that gives users advice on personal finance topics such as budgeting and debt management. Before launch, the safety lead wants to reduce the risk of harmful financial guidance. Which TWO measures best align with responsible deployment practices for this scenario? (Choose two.)

Accepted Answer

Build an evaluation set of representative finance prompts, including edge cases, and review outputs before and after each model or prompt change.. Responsible deployment of a domain-specific assistant combines behavioral steering through system prompts with empirical measurement through evaluation sets. Directing Claude toward general education and professional referral reduces harm, while a curated finance evaluation suite lets the team detect regressions and validate that mitigations work. Disabling refusals, skipping testing, or maximizing randomness all increase risk rather than reduce it, so they are not appropriate choices.

Answer

Rely solely on Claude's built-in safety training and skip any application-level testing, since Anthropic has already addressed financial-advice risks.

Answer

Disable all refusal behavior so the assistant never declines a user request, ensuring a consistent and frictionless experience.

Answer

Increase the model's temperature setting to its maximum so responses are more creative and engaging for users.

Question 9

A developer wants Claude to always respond in a concise, bulleted format for a customer-facing chatbot. They want the behavior to apply across all user turns without repeating the instruction each time. Which approach is most appropriate?

Accepted Answer

Add the formatting instruction to the system prompt.. Persistent behavioral rules such as formatting and tone belong in the system prompt. It applies across every turn of the conversation, so Claude maintains the bulleted, concise style without the developer repeating instructions. Other approaches either affect randomness, are redundant, or lose influence over time.

Answer

Set the temperature to 0 so responses stay concise.

Answer

Append the formatting instruction to every user message automatically.

Answer

Include the instruction only in the first user message of the conversation.

Question 10

A developer needs Claude to always respond with a valid JSON object containing specific fields for a downstream parser. The team wants the strongest guarantee that the model's reply will conform to a defined structure. Which capability should the developer use?

Accepted Answer

Use the tool use feature with a defined input schema to force structured arguments.. Tool use with a JSON schema gives the strongest structural guarantee because the model emits arguments validated against the declared input schema. Prompt instructions and temperature settings influence behavior but cannot enforce format, and max_tokens only bounds length. When a downstream parser demands exact fields, schema-backed tool calls are the dependable choice.

Answer

Set temperature to 0 so the output becomes deterministic and therefore valid JSON.

Answer

Add the phrase 'respond only in JSON' to the system prompt and hope the model complies.

Answer

Increase max_tokens so the model has enough room to finish the JSON object.

Question 11

A support engineer is drafting an internal guide on using Claude for customer-facing replies. A colleague suggests that because Claude is generally helpful, it is fine to let it answer questions about competitors' products with confident comparisons. The engineer wants to set a policy that reflects responsible use. Which guidance is most appropriate?

Accepted Answer

Prohibit unverified competitor claims and require that any factual comparison be checked against approved internal sources before publishing.. The core risk is confident inaccuracy in customer-facing content, not the topic of competitors itself. A policy that requires verification against approved sources before publication creates a concrete check that catches hallucinations while still allowing accurate, well-grounded comparisons. Blanket bans are unnecessarily restrictive, and disclaimers do not prevent the dissemination of false statements to customers.

Answer

Allow confident competitor comparisons, since Claude's training data includes public information about many companies.

Answer

Prohibit any mention of competitors at all, even when the comparison is accurate and sourced from official documentation.

Answer

Permit competitor comparisons but add a disclaimer that the information may be inaccurate and should not be relied upon.

Question 12

A developer is sending a single request to the Anthropic Messages API with a system prompt and a user message. The application needs Claude to return a JSON object that strictly conforms to a predefined schema without any explanatory prose. Which request configuration should the developer use to maximize the likelihood of receiving only valid JSON?

Accepted Answer

Use the tool_choice parameter set to {"type": "tool", "name": "your_tool"} with an input_schema defining the desired JSON structure.. The Messages API provides a structural mechanism for schema-constrained output: defining a tool with an input_schema and forcing its use via tool_choice. This makes the model emit a tool_use block whose input matches the schema, yielding a clean JSON object without surrounding prose. Sampling parameters, prompt instructions, and stop sequences influence generation but do not enforce structure, so they cannot reliably satisfy the strict-JSON requirement.

Answer

Set the temperature parameter to 1.0 and rely on the model's natural tendency to produce structured output.

Answer

Add the instruction 'Return only JSON, nothing else' to the system prompt and set max_tokens to a small value.

Answer

Set the stop_sequences parameter to ['}'] so the response terminates immediately after the closing brace.

Question 13

A support team wants Claude to classify incoming tickets into exactly one of five categories and to always return the result as a JSON object with keys category and confidence. The developer has already written clear category definitions. Which additional step most directly improves the reliability of the JSON output?

Accepted Answer

Add a short example showing a sample ticket and the exact JSON object Claude should return.. Demonstrating the exact output shape with a concrete example is the most direct way to lock down structured output. Category definitions establish what to decide; the example establishes how to present the decision. Together they leave little room for the model to improvise key names, wrap the object in prose, or choose an unexpected value format.

Answer

Increase the maximum output tokens so the JSON object is never truncated.

Answer

Ask Claude to return the category and confidence as a plain sentence.

Answer

Instruct Claude to 'think step by step' before producing the JSON object.

Question 14

A developer wants Claude to answer questions strictly from a provided internal policy document and to refuse when the answer is not present. The team must ensure the model treats the document as authoritative reference material rather than as instructions to follow. Which approach best achieves this?

Accepted Answer

Include the document in a user message wrapped in clear delimiters and instruct the model to answer only from that content and refuse otherwise.. Grounding requires that reference content stay in the data channel and be explicitly framed as material to consult, not instructions to obey. Placing the document in a delimited user message with a refusal directive achieves both goals. Promoting the document to the system prompt grants it instruction authority, and output-length or temperature settings do not affect how content is interpreted.

Answer

Raise max_tokens so the model can read the entire document before answering.

Answer

Place the policy document inside the system prompt so it is treated as a higher-priority instruction.

Answer

Set temperature to a high value so the model explores the document more thoroughly before responding.

Question 15

A fintech developer builds an assistant that answers questions about account activity. The system prompt currently says: 'You are a helpful banking assistant. Use the provided account data to answer questions.' Testing shows Claude sometimes answers general banking questions from its own knowledge rather than from the supplied data, and occasionally states figures that are not in the data at all. Which revision to the system prompt best addresses both problems?

Accepted Answer

Add: 'Answer only from the account data in <data> tags. If the answer is not present, say you cannot find it in the provided data. Do not answer general banking questions.'. The effective revision names the permitted source, provides a fallback response when the data does not contain the answer, and constrains the assistant's scope. Source restriction stops substitution of outside knowledge, the fallback gives the model a safe alternative to guessing, and the scope limit removes the general-question path that produced unsupported figures.

Answer

Add: 'Always be accurate and never make up information.'

Answer

Move the account data into the system prompt instead of the user turn.

Answer

Add five examples of correct answers to common account questions.