CCAO-F Practice Test 2 — 25 Questions

Question 1

A legal team asks Claude to summarize contracts and cite the exact clause supporting each summary point. Claude produces accurate summaries but cites clauses that do not exist. The contracts are supplied inside <contract> tags in the same message. Which change most directly reduces the fabricated citations?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Instruct Claude to quote the exact sentence from the contract for each point and to say 'not found' when no sentence supports it.. Fabricated citations occur when a model is asked to attribute claims without being forced to ground them in source text. Requiring a verbatim quote for each point, plus an explicit 'not found' option when no sentence supports a claim, removes the incentive to invent plausible clauses. The other options either layer metadata over unverified citations, rely on examples alone, or enlarge input without changing the grounding requirement.

Answer

Increase the contract length limit so Claude has more space to search for the cited clauses.

Answer

Ask Claude to rank each citation by confidence so reviewers can skip the low-confidence ones.

Answer

Add a few-shot example showing a correct summary with a correct clause citation.

Question 2

A developer is integrating Claude 3.5 Sonnet into a medical imaging application. Which TWO capabilities of the Claude 3 family make it particularly suited for analyzing diagnostic reports alongside X-ray images?

Accepted Answer

Native Vision processing for images. The Claude 3 family introduced native multimodal capabilities, allowing the models to process both text and visual data in a single request. This is essential for medical applications where a report must be compared against an image. Additionally, the improved reasoning capabilities ensure that the model can draw logical connections between the visual evidence and the textual descriptions. (69 words)

Answer

Support for 1,000,000-token output

Answer

Ability to browse the live internet

Answer

Recursive self-improvement loops

Question 3

Refer to the exhibit. A developer receives this JSON response after submitting a prompt to the Claude API that included instructions to generate a bypass for a software licensing system. What does this error message indicate about the model's safety architecture?

Accepted Answer

An external safety layer identified the prompt as a violation of Anthropic's usage policies.. The exhibit demonstrates the active role of Anthropic's safety filters in intercepting requests that violate usage policies. In this case, requesting a software license bypass falls under prohibited activities related to illegal acts or computer misuse. The filter acts as a proactive guardrail to prevent the model from generating content that could facilitate harmful or illegal technical activities.

Answer

The API key has been revoked due to excessive safety violations by the developer.

Answer

The model's Constitutional AI training failed to identify the harmful intent during inference.

Answer

The model has encountered a technical timeout while processing a complex ethical dilemma.

Question 4

When fine-tuning a model for a specific industry, which TWO safety considerations are most important to maintain Claude's alignment?

Accepted Answer

Ensuring the fine-tuning dataset does not contain toxic or biased content.. Fine-tuning can inadvertently weaken a model's safety guardrails if not done carefully. It is crucial to ensure that the industry-specific data doesn't introduce new biases or teach the model to ignore its core safety principles. Maintaining alignment during fine-tuning requires balancing specialized knowledge with the original HHH safety framework.

Answer

Maximizing the model's ability to generate content as fast as possible.

Answer

Removing the Constitutional AI framework to allow for more flexibility.

Answer

Disabling all API-level filters to see the model's raw performance.

Question 5

You are building a chat application using Claude 3.5 Sonnet. You need to ensure the model maintains a consistent tone and follows specific formatting constraints across a long conversation. Which approach best optimizes API usage while maintaining context?

Accepted Answer

Maintain the conversation history in a list and include the full history in every request.. Passing the entire conversation history in every API call is the standard way to maintain context in stateless REST architectures. By managing the history array on the client side and sending the full thread, you ensure Claude has the necessary state to maintain tone. Token optimization is secondary to statefulness; you can prune older messages if the context window approaches limits, but full history is required for consistency.

Answer

Send only the last user message and the system prompt for every request.

Answer

Store the conversation history in the system prompt rather than the messages array.

Answer

Use the Claude session ID header to automatically track state on the server.

Question 6

Which of the following describes the correct behavior when using the 'stream' parameter in the Messages API?

Accepted Answer

The API returns content as it is generated in discrete events.. Setting 'stream' to true causes the API to return a series of Server-Sent Events (SSE) rather than a single JSON object. This is a critical pattern for interactive applications, as it provides an immediate perceived response time for the user. The client must be prepared to handle these discrete events, which include content chunks, metadata, and final completion signals.

Answer

The API sends the entire response at once, but with lower latency.

Answer

The API skips the 'messages' array and only accepts a single prompt string.

Answer

The 'stream' parameter is only available for the Claude 2 model series.

Question 7

An application uses Claude to summarize user-generated medical feedback. To comply with privacy requirements, you must ensure no Personally Identifiable Information (PII) is sent to the model. Which is the most appropriate workflow?

Accepted Answer

Processing the text through a dedicated PII anonymization layer before calling the API.. Data sanitization should occur prior to hitting the API. By using a PII-scrubbing service (like Presidio or a custom regex layer) before the payload reaches Anthropic, you enforce data residency and privacy controls at the edge. This approach is essential for responsible AI because it ensures PII never leaves your secure environment, preventing potential leaks and maintaining strict compliance with global privacy standards like GDPR or HIPAA.

Answer

Prompting the model to ignore and redact any PII found in the input.

Answer

Using a specific system prompt that warns the model to treat all input as private.

Answer

Requesting that users manually redact their own PII before submitting feedback.

Question 8

An analyst is using Claude 3.5 Sonnet to compare two 50-page contracts. They notice that Claude correctly identifies a discrepancy in a small footnote on page 74 of the combined input. This demonstrates which fundamental performance characteristic of Claude?

Accepted Answer

Strong long-context recall. The ability to retrieve specific information from a massive context window is known as 'recall' or 'Needle In A Haystack' performance. Claude models are specifically optimized to ensure that they don't just 'read' the whole document, but can actually find and use information regardless of its position in the input.

Answer

Zero-shot learning

Answer

Sentiment analysis

Answer

Iterative refinement

Question 9

Why should developers use the Anthropic Messages API instead of legacy Completions API?

Accepted Answer

It provides a superior structure for managing multi-turn conversations.. The Messages API is the current standard for interaction with Anthropic models. It natively supports structured conversation history, system-level prompts, and improved safety features, which are necessary for modern, production-grade applications. Transitioning to this API is essential for accessing the latest model features, receiving better support, and ensuring long-term compatibility with future model updates and enterprise deployment requirements, making it a critical choice for any professional AI project.

Answer

The Messages API is faster because it bypasses safety checks.

Answer

It allows developers to modify the model's internal weights.

Answer

It is the only API that supports streaming responses.

Question 10

A company is developing an application that generates long-form creative content. They notice that as the output length increases, the model's speed seems to fluctuate. Which technical factor most significantly impacts the latency of the 'Time to Last Token' (TTLT) in this scenario?

Accepted Answer

The total number of output tokens generated.. The Time to Last Token (TTLT) is primarily a function of the total number of tokens generated by the model. Each token is generated sequentially, meaning the model must perform a full inference pass for every single word or sub-word it produces. Therefore, longer outputs naturally take more time, as the total latency scales linearly with the generation length. (70 words)

Answer

The number of concurrent users in the API queue.

Answer

The use of a system prompt instead of a user prompt.

Answer

The presence of images in the input context.

Question 11

Which TWO of the following statements accurately describe the characteristics of the Claude 3.5 Sonnet model's context window and performance?

Accepted Answer

Claude 3.5 Sonnet offers a 200k token context window capacity.. Claude 3.5 Sonnet features a 200k token context window, which allows for the ingestion of large codebases or documents. Furthermore, the model is optimized for high throughput and low latency, making it ideal for tasks requiring rapid processing. Understanding these technical trade-offs is essential for architecting scalable applications that need to balance the need for deep contextual understanding with the speed requirements of real-time user interfaces.

Answer

Claude 3.5 Sonnet supports an infinite context window for streaming data.

Answer

The model's performance decreases linearly as the context window is filled.

Answer

Context window usage is irrelevant to API response latency.

Question 12

A developer wants to utilize 'Tool Use' (function calling) with Claude. Which TWO steps are necessary to properly define a tool in the API request?

Accepted Answer

Provide a 'description' field explaining what the tool does.. To use tools, developers must provide a 'tools' array in the request. Each tool needs a 'name', a 'description' (which helps Claude understand when to use it), and an 'input_schema'. The 'input_schema' must be a valid JSON Schema object, defining the parameters the tool expects. This structured approach allows Claude to generate valid arguments that the developer's code can then execute.

Answer

Include the tool's source code in the 'implementation' field.

Answer

Set the 'role' of the message to 'function'.

Answer

Upload a CSV file containing example tool outputs.

Question 13

An enterprise is scaling their Claude integration and needs to manage their rate limits effectively. Which TWO strategies are recommended by Anthropic to handle rate limiting gracefully?

Accepted Answer

Implement exponential backoff for retries. Rate limits are a reality of high-scale API usage. To handle them, developers should implement exponential backoff, which increases the wait time between retries after each failure. Additionally, they should monitor the rate limit headers in the API response to adjust their request frequency dynamically. These practices prevent the application from being blocked and ensure smoother overall performance.

Answer

Request a limit increase immediately upon the first 429 error

Answer

Use multiple API keys to multiply the available rate limits

Answer

Switch to a smaller model only when a rate limit is hit

Question 14

Refer to the exhibit. This request uses a technique to force Claude to output valid JSON. What is the technical name for this technique, and what is its primary benefit?

Accepted Answer

Response Prefilling; it eliminates conversational filler and ensures correct formatting.. The technique shown is 'prefilling the assistant response.' By starting the assistant's turn with the beginning of a JSON object, the developer forces Claude to continue the pattern. This is the most reliable way to ensure the output starts exactly with the required characters for programmatic parsing, bypassing any conversational preamble.

Answer

Few-shotting; it provides a single example of the JSON format to follow.

Answer

System Role Prompting; it defines the model's persona as a JSON generator.

Answer

XML Delimitation; it uses the curly braces as tags to separate the data.

Question 15

Refer to the exhibit. The developer notices the model often hallucinates data not present in the <data> tags. Which adjustment is most likely to mitigate this behavior?

Accepted Answer

Add an explicit instruction in the system prompt to only use information contained within the tags.. Adding a strong negative constraint to the system prompt, such as 'If the information is not present in the provided , state that you do not have sufficient information,' directly addresses hallucination. This forces the model to prioritize factual grounding over generative completion. In production systems, explicit constraints about the source material are essential for maintaining the integrity of data processing workflows and preventing the propagation of false information.

Answer

Reduce the temperature to 0.0 to make the model's output more deterministic.

Answer

Increase the max_tokens to ensure the model has enough room to explain its reasoning.

Answer

Change the model to an older version that is less prone to creative generation.

Question 16

Refer to the exhibit. An engineer wants to use Prompt Caching to optimize this request. What is the correct way to modify the request body to enable this?

Accepted Answer

Nest a 'cache_control' object within the content block of the message.. Prompt caching requires the inclusion of a 'cache_control' block within the message content. This tells the API to store the processed state of that specific chunk. This is critical for high-latency or high-cost prompts because it allows for faster processing of subsequent requests that share the same cached prefix, significantly reducing latency and cost for repetitive tasks like data analysis.

Answer

Add a 'cache_control' field to the root level of the JSON body.

Answer

Rename the 'system' field to 'system_cached'.

Answer

Enable 'caching=true' in the request headers.

Question 17

An HR department is using Claude to screen resumes for a high-volume engineering role. They are concerned that the model might inadvertently favor candidates from certain universities over others, reflecting historical biases in the training data. Which concept in AI safety does this concern directly address?

Accepted Answer

Algorithmic Bias and Fairness.. Algorithmic bias and fairness are critical components of responsible AI use. In hiring, bias can manifest as a preference for certain demographics or backgrounds that were overrepresented in the training data. Addressing this involves careful testing, monitoring, and potentially using debiasing techniques to ensure the model makes equitable decisions based on merit rather than historical prejudice.

Answer

Model Hallucination.

Answer

Prompt Injection.

Answer

Data Sovereignty.

Question 18

Refer to the exhibit. What is the specific effect of the 'tool_choice' parameter as configured in this request?

Accepted Answer

It forces Claude to use the 'get_weather' tool specifically.. The 'tool_choice' parameter allows developers to control Claude's tool-calling behavior. By setting it to type 'tool' and specifying a 'name', the developer is forcing Claude to use that specific tool, even if it thinks it could answer without it. This is useful for specialized workflows where a specific function must always be executed as the next step in the application logic.

Answer

It allows Claude to choose between using the tool or answering normally.

Answer

It prevents Claude from using any tools during this request.

Answer

It enables Claude to use multiple tools in a single response.

Question 19

A developer is optimizing a customer support bot that uses a 50,000-token knowledge base in every request. They want to implement Prompt Caching to reduce costs and latency. Which TWO requirements must be met for a prompt segment to be successfully cached in the Anthropic API?

Accepted Answer

The segment intended for caching must contain at least 1024 tokens.. Prompt caching is a powerful feature for large contexts, but it requires specific implementation details. The segment to be cached must be at least 1024 tokens and must be explicitly marked with the cache_control metadata. Understanding these technical thresholds is vital for developers looking to scale high-token applications while maintaining cost-efficiency and low latency.

Answer

The cached content must be placed at the very end of the user message.

Answer

The system prompt must be empty when using cached blocks in the user message.

Answer

The temperature setting must be set to 0.0 for the cache to remain valid.

Question 20

Which term describes the fundamental unit of text that Claude processes, which can be a single character, a part of a word, or a whole word?

Accepted Answer

Token. Understanding tokens is essential for grasping how LLMs like Claude process information and how costs are calculated. Tokens are the 'atomic' units of the model's vocabulary, and the efficiency of the tokenizer directly impacts the model's context window usage and pricing.

Answer

Bit

Answer

Sentence

Answer

Prompt