CCAO-F Practice Test 2 — 30 Questions

Question 1

Which of the following describes the correct behavior when using the 'stream' parameter in the Messages API?

Accepted Answer

The API returns content as it is generated in discrete events.. Setting 'stream' to true causes the API to return a series of Server-Sent Events (SSE) rather than a single JSON object. This is a critical pattern for interactive applications, as it provides an immediate perceived response time for the user. The client must be prepared to handle these discrete events, which include content chunks, metadata, and final completion signals.

Answer

The API sends the entire response at once, but with lower latency.

Answer

The API skips the 'messages' array and only accepts a single prompt string.

Answer

The 'stream' parameter is only available for the Claude 2 model series.

Question 2

An application uses Claude to summarize user-generated medical feedback. To comply with privacy requirements, you must ensure no Personally Identifiable Information (PII) is sent to the model. Which is the most appropriate workflow?

Accepted Answer

Processing the text through a dedicated PII anonymization layer before calling the API.. Data sanitization should occur prior to hitting the API. By using a PII-scrubbing service (like Presidio or a custom regex layer) before the payload reaches Anthropic, you enforce data residency and privacy controls at the edge. This approach is essential for responsible AI because it ensures PII never leaves your secure environment, preventing potential leaks and maintaining strict compliance with global privacy standards like GDPR or HIPAA.

Answer

Prompting the model to ignore and redact any PII found in the input.

Answer

Using a specific system prompt that warns the model to treat all input as private.

Answer

Requesting that users manually redact their own PII before submitting feedback.

Question 3

An analyst is using Claude 3.5 Sonnet to compare two 50-page contracts. They notice that Claude correctly identifies a discrepancy in a small footnote on page 74 of the combined input. This demonstrates which fundamental performance characteristic of Claude?

Accepted Answer

Strong long-context recall. The ability to retrieve specific information from a massive context window is known as 'recall' or 'Needle In A Haystack' performance. Claude models are specifically optimized to ensure that they don't just 'read' the whole document, but can actually find and use information regardless of its position in the input.

Answer

Zero-shot learning

Answer

Sentiment analysis

Answer

Iterative refinement

Question 4

Why should developers use the Anthropic Messages API instead of legacy Completions API?

Accepted Answer

It provides a superior structure for managing multi-turn conversations.. The Messages API is the current standard for interaction with Anthropic models. It natively supports structured conversation history, system-level prompts, and improved safety features, which are necessary for modern, production-grade applications. Transitioning to this API is essential for accessing the latest model features, receiving better support, and ensuring long-term compatibility with future model updates and enterprise deployment requirements, making it a critical choice for any professional AI project.

Answer

The Messages API is faster because it bypasses safety checks.

Answer

It allows developers to modify the model's internal weights.

Answer

It is the only API that supports streaming responses.

Question 5

A company is developing an application that generates long-form creative content. They notice that as the output length increases, the model's speed seems to fluctuate. Which technical factor most significantly impacts the latency of the 'Time to Last Token' (TTLT) in this scenario?

Accepted Answer

The total number of output tokens generated.. The Time to Last Token (TTLT) is primarily a function of the total number of tokens generated by the model. Each token is generated sequentially, meaning the model must perform a full inference pass for every single word or sub-word it produces. Therefore, longer outputs naturally take more time, as the total latency scales linearly with the generation length. (70 words)

Answer

The number of concurrent users in the API queue.

Answer

The use of a system prompt instead of a user prompt.

Answer

The presence of images in the input context.

Question 6

Which TWO of the following statements accurately describe the characteristics of the Claude 3.5 Sonnet model's context window and performance?

Accepted Answer

Claude 3.5 Sonnet offers a 200k token context window capacity.. Claude 3.5 Sonnet features a 200k token context window, which allows for the ingestion of large codebases or documents. Furthermore, the model is optimized for high throughput and low latency, making it ideal for tasks requiring rapid processing. Understanding these technical trade-offs is essential for architecting scalable applications that need to balance the need for deep contextual understanding with the speed requirements of real-time user interfaces.

Answer

Claude 3.5 Sonnet supports an infinite context window for streaming data.

Answer

The model's performance decreases linearly as the context window is filled.

Answer

Context window usage is irrelevant to API response latency.

Question 7

A developer wants to utilize 'Tool Use' (function calling) with Claude. Which TWO steps are necessary to properly define a tool in the API request?

Accepted Answer

Provide a 'description' field explaining what the tool does.. To use tools, developers must provide a 'tools' array in the request. Each tool needs a 'name', a 'description' (which helps Claude understand when to use it), and an 'input_schema'. The 'input_schema' must be a valid JSON Schema object, defining the parameters the tool expects. This structured approach allows Claude to generate valid arguments that the developer's code can then execute.

Answer

Include the tool's source code in the 'implementation' field.

Answer

Set the 'role' of the message to 'function'.

Answer

Upload a CSV file containing example tool outputs.

Question 8

An enterprise is scaling their Claude integration and needs to manage their rate limits effectively. Which TWO strategies are recommended by Anthropic to handle rate limiting gracefully?

Accepted Answer

Implement exponential backoff for retries. Rate limits are a reality of high-scale API usage. To handle them, developers should implement exponential backoff, which increases the wait time between retries after each failure. Additionally, they should monitor the rate limit headers in the API response to adjust their request frequency dynamically. These practices prevent the application from being blocked and ensure smoother overall performance.

Answer

Request a limit increase immediately upon the first 429 error

Answer

Use multiple API keys to multiply the available rate limits

Answer

Switch to a smaller model only when a rate limit is hit

Question 9

Refer to the exhibit. This request uses a technique to force Claude to output valid JSON. What is the technical name for this technique, and what is its primary benefit?

Accepted Answer

Response Prefilling; it eliminates conversational filler and ensures correct formatting.. The technique shown is 'prefilling the assistant response.' By starting the assistant's turn with the beginning of a JSON object, the developer forces Claude to continue the pattern. This is the most reliable way to ensure the output starts exactly with the required characters for programmatic parsing, bypassing any conversational preamble.

Answer

Few-shotting; it provides a single example of the JSON format to follow.

Answer

System Role Prompting; it defines the model's persona as a JSON generator.

Answer

XML Delimitation; it uses the curly braces as tags to separate the data.

Question 10

Refer to the exhibit. The developer notices the model often hallucinates data not present in the <data> tags. Which adjustment is most likely to mitigate this behavior?

Accepted Answer

Add an explicit instruction in the system prompt to only use information contained within the tags.. Adding a strong negative constraint to the system prompt, such as 'If the information is not present in the provided , state that you do not have sufficient information,' directly addresses hallucination. This forces the model to prioritize factual grounding over generative completion. In production systems, explicit constraints about the source material are essential for maintaining the integrity of data processing workflows and preventing the propagation of false information.

Answer

Reduce the temperature to 0.0 to make the model's output more deterministic.

Answer

Increase the max_tokens to ensure the model has enough room to explain its reasoning.

Answer

Change the model to an older version that is less prone to creative generation.

Question 11

Refer to the exhibit. An engineer wants to use Prompt Caching to optimize this request. What is the correct way to modify the request body to enable this?

Accepted Answer

Nest a 'cache_control' object within the content block of the message.. Prompt caching requires the inclusion of a 'cache_control' block within the message content. This tells the API to store the processed state of that specific chunk. This is critical for high-latency or high-cost prompts because it allows for faster processing of subsequent requests that share the same cached prefix, significantly reducing latency and cost for repetitive tasks like data analysis.

Answer

Add a 'cache_control' field to the root level of the JSON body.

Answer

Rename the 'system' field to 'system_cached'.

Answer

Enable 'caching=true' in the request headers.

Question 12

An HR department is using Claude to screen resumes for a high-volume engineering role. They are concerned that the model might inadvertently favor candidates from certain universities over others, reflecting historical biases in the training data. Which concept in AI safety does this concern directly address?

Accepted Answer

Algorithmic Bias and Fairness.. Algorithmic bias and fairness are critical components of responsible AI use. In hiring, bias can manifest as a preference for certain demographics or backgrounds that were overrepresented in the training data. Addressing this involves careful testing, monitoring, and potentially using debiasing techniques to ensure the model makes equitable decisions based on merit rather than historical prejudice.

Answer

Model Hallucination.

Answer

Prompt Injection.

Answer

Data Sovereignty.

Question 13

Refer to the exhibit. What is the specific effect of the 'tool_choice' parameter as configured in this request?

Accepted Answer

It forces Claude to use the 'get_weather' tool specifically.. The 'tool_choice' parameter allows developers to control Claude's tool-calling behavior. By setting it to type 'tool' and specifying a 'name', the developer is forcing Claude to use that specific tool, even if it thinks it could answer without it. This is useful for specialized workflows where a specific function must always be executed as the next step in the application logic.

Answer

It allows Claude to choose between using the tool or answering normally.

Answer

It prevents Claude from using any tools during this request.

Answer

It enables Claude to use multiple tools in a single response.

Question 14

A developer is optimizing a customer support bot that uses a 50,000-token knowledge base in every request. They want to implement Prompt Caching to reduce costs and latency. Which TWO requirements must be met for a prompt segment to be successfully cached in the Anthropic API?

Accepted Answer

The segment intended for caching must contain at least 1024 tokens.. Prompt caching is a powerful feature for large contexts, but it requires specific implementation details. The segment to be cached must be at least 1024 tokens and must be explicitly marked with the cache_control metadata. Understanding these technical thresholds is vital for developers looking to scale high-token applications while maintaining cost-efficiency and low latency.

Answer

The cached content must be placed at the very end of the user message.

Answer

The system prompt must be empty when using cached blocks in the user message.

Answer

The temperature setting must be set to 0.0 for the cache to remain valid.

Question 15

Which term describes the fundamental unit of text that Claude processes, which can be a single character, a part of a word, or a whole word?

Accepted Answer

Token. Understanding tokens is essential for grasping how LLMs like Claude process information and how costs are calculated. Tokens are the 'atomic' units of the model's vocabulary, and the efficiency of the tokenizer directly impacts the model's context window usage and pricing.

Answer

Bit

Answer

Sentence

Answer

Prompt

Question 16

A legal firm is using Claude to summarize multi-hundred page litigation documents. The model occasionally ignores specific clauses or mixes up dates between different case files provided in the same prompt. Which context engineering technique would most effectively improve the model's extraction accuracy and structural understanding of these inputs?

Accepted Answer

Wrapping separate documents and instructions within distinct XML tags like and .. Claude performs significantly better when instructions are clearly separated from data using XML tags. This technique helps the model parse complex inputs without confusing the task description with the content being processed. In professional context engineering, structured prompts reduce ambiguity and improve reliability, especially when handling long-form text or multi-step reasoning tasks that require high precision.

Answer

Applying Chain-of-Thought reasoning by asking the model to think step-by-step before summarizing.

Answer

Increasing the frequency of few-shot examples to demonstrate the desired summary format repeatedly.

Answer

Moving the most important instructions to the very beginning of the prompt to ensure maximum attention.

Question 17

You have a system prompt that encourages a 'concise and professional' tone. However, Claude is occasionally being overly verbose when users ask simple questions. Which modification is most effective?

Accepted Answer

Add 'Do not use more than two sentences' to the system prompt.. Constraints are most effective when they are specific and provide actionable boundaries. Instead of relying on qualitative adjectives like 'professional', defining a clear length constraint or a style template forces the model to adhere to a measurable standard. This reduces ambiguity and ensures the model consistently provides the level of brevity required for your specific business application, preventing the tendency for verbose or flowery conversational outputs.

Answer

Instruct the model to act as a 'strict editor' to improve tone.

Answer

Increase the frequency of the 'professional' instruction in the prompt.

Answer

Reduce the system prompt length to force the model to be brief.

Question 18

A developer is building an application that needs to maintain a specific tone and set of behavioral constraints across multiple turns of a conversation. Where should these instructions be placed in the Messages API call to ensure the most consistent adherence by the model?

Accepted Answer

As a standalone 'system' parameter at the top level of the request body.. In the Messages API, the system parameter is specifically designed for high-level instructions, personas, and behavioral constraints. Placing these instructions in the system prompt rather than the first user message helps Claude distinguish between the developer's rules and the user's input, leading to better instruction following and reduced likelihood of the model ignoring constraints during long interactions.

Answer

Inside the first object of the messages array with the role set to 'user'.

Answer

Inside every assistant message to remind the model of its persona.

Answer

In a metadata field within the request body to be parsed by the API.

Question 19

A developer needs to configure a Claude 3 model to generate a wide variety of creative and unpredictable marketing slogans for a new product line. Which TWO parameter adjustments would best support this goal?

Accepted Answer

Set temperature to 1.0. To increase creativity and variety in model outputs, developers must adjust the sampling parameters. Increasing temperature makes the probability distribution of the next token flatter, allowing for less likely choices. Similarly, a high top_p value ensures a larger pool of potential tokens is considered. These settings are ideal for creative tasks where consistency and predictability are less important than novelty.

Answer

Set temperature to 0.0

Answer

Set top_p to 0.1

Answer

Set max_tokens to a very low value

Question 20

When using the Claude API, which parameter should be adjusted if you want to influence the model's creativity and randomness?

Accepted Answer

temperature. The 'temperature' parameter is the primary lever for controlling the stochastic nature of the model's output. By adjusting this value, you directly influence the probability distribution of the next token selection. A lower temperature makes the model more deterministic and focused, whereas a higher temperature introduces more variation, which is essential for creative writing or brainstorming tasks in AI applications.

Answer

max_tokens

Answer

top_p

Answer

system