CCAO-F Practice Test 16 — 15 Questions

Question 1

When designing a prompt to handle sensitive user data, which THREE of the following practices should be prioritized for security and compliance?

Accepted Answer

Anonymize all PII (Personally Identifiable Information) before sending it to the API.. Security in LLM applications relies on the principle of least privilege and data minimization. You should never pass PII or sensitive data into the prompt if it is not absolutely necessary. Sanitizing inputs and using system prompts to enforce strict data handling policies ensures that the model acts as a safe intermediary, protecting user privacy and adhering to compliance requirements like GDPR or SOC2.

Answer

Include the user's password in the prompt to verify their identity before responding.

Answer

Use as many few-shot examples as possible to ensure the model behaves consistently.

Question 2

You are prompting Claude to adopt a specific tone. Which technique is most likely to ensure consistency across a variety of user queries?

Accepted Answer

Provide multiple examples (few-shot) of the desired tone in the prompt.. Few-shot prompting provides concrete examples of the desired tone in action, which is far more reliable than qualitative descriptions. By showing the model exactly how to handle different scenarios, you provide a behavioral template that the model can generalize. This approach removes the guesswork and ensures that the tone remains consistent regardless of the specific topic or nature of the user's inquiry.

Answer

Explain the tone in exhaustive detail in the system prompt.

Answer

Use a system prompt that specifies a list of forbidden words.

Answer

Set the temperature to a high value to increase variety in the tone.

Question 3

You are building a customer support bot using Claude. Users frequently provide long, rambling narratives that dilute the core request. Which prompting strategy best ensures the model stays focused on the actionable request?

Accepted Answer

Wrap the user input in XML tags and instruct the model to analyze the content within those tags for actionable steps.. Using a XML tag wrapper like <user_input> for the narrative helps Claude delineate between structural instructions and variable content. By framing the prompt to instruct Claude to first summarize the narrative and then extract the specific support request, you minimize task drift. This technique is critical because it forces the model to process information sequentially, reducing the cognitive load and preventing the model from becoming distracted by irrelevant conversational noise.

Answer

Add a System Prompt instruction to ignore all text longer than 200 words.

Answer

Provide several few-shot examples where the model outputs 'I cannot understand' for long inputs.

Answer

Increase the temperature to 1.0 to encourage the model to be more creative in identifying requests.

Question 4

You are processing large documents with Claude. If the document exceeds the context window, which strategy is most effective for maintaining quality results?

Accepted Answer

Use a RAG approach to retrieve and send only relevant chunks to the model.. When dealing with documents exceeding the context window, a RAG (Retrieval-Augmented Generation) approach is the standard solution. By segmenting the document into chunks and retrieving only the most relevant sections for a specific query, you ensure the model focuses on pertinent information. This avoids truncation issues while keeping the input within the model's limits, thereby maintaining the quality and relevance of the generated responses.

Answer

Increase the max_tokens to accommodate the entire document.

Answer

Split the document into chunks and send them in parallel as separate API calls.

Answer

Request the model to summarize the document in sections using a loop.

Question 5

An enterprise developer is building a customer support bot using Claude. During testing, the model refuses to answer a query about a competitor's product, stating it cannot discuss other brands. This behavior is considered an over-refusal. Which pillar of the 'Helpful, Honest, Harmless' (HHH) framework is primarily being misapplied in this instance?

Accepted Answer

Helpfulness. The HHH framework requires a delicate balance between being useful to the user and avoiding harm. In this scenario, the model is prioritizing a perceived safety boundary over its core duty to be helpful. Over-refusals occur when the model interprets safety guidelines too broadly, resulting in a failure to provide legitimate information that does not actually violate any safety policies.

Answer

Harmlessness

Answer

Honesty

Answer

Confidentiality

Question 6

When designing a prompt for Claude to perform complex reasoning, why is it beneficial to include 'think step-by-step' in the instructions?

Accepted Answer

It allows the model to break down complex problems into manageable sub-tasks.. The 'think step-by-step' technique leverages the model's ability to perform chain-of-thought reasoning. By forcing the model to articulate its intermediate logic before arriving at a final answer, the model is less likely to jump to premature conclusions. This is particularly important for logic, math, or coding tasks where the final output depends on the accuracy of sequential steps rather than direct pattern completion.

Answer

It forces the model to use more memory, which increases its internal intelligence.

Answer

It automatically converts the output format into a bulleted list.

Answer

It minimizes the token cost by reducing the number of words in the final output.

Question 7

Refer to the exhibit. When this request is sent to Claude, the model responds: 'I cannot fulfill this request. I am programmed to be a helpful and harmless AI assistant, and I cannot assist with requests related to cyberattacks or illegal activities.' Which safety mechanism is primarily responsible for this specific refusal?

Accepted Answer

Internal safety guardrails and alignment training.. Claude's refusal is a result of safety training and alignment, specifically designed to prevent the model from assisting in illegal or harmful activities like cyberattacks. The model identifies the harmful intent in the user's prompt and, based on its internal safety guardrails and Constitutional AI training, generates a refusal message instead of the requested harmful content.

Answer

The system prompt provided in the exhibit.

Answer

A regex-based keyword filter at the API level.

Answer

The user's lack of administrative privileges in the API console.

Question 8

Which of the following best describes the 'Shared Responsibility Model' for safety when using Anthropic's API?

Accepted Answer

Anthropic secures the model and base safety, while the customer secures their application and use case.. The Shared Responsibility Model clarifies that both Anthropic and the customer have roles in ensuring safety. Anthropic provides a secure and aligned model, while the customer is responsible for how they implement and use that model in their specific application. This partnership is essential for the safe and ethical deployment of AI across different industries.

Answer

Anthropic is 100% responsible for any output the model generates in any context.

Answer

The user is 100% responsible for all model behavior, and Anthropic provides no safety features.

Answer

Both parties are responsible for sharing the financial costs of any legal disputes.

Question 9

What is the primary benefit of using pre-filling in a Claude API request?

Accepted Answer

It helps steer the model's response by setting a specific starting sequence for the assistant's output.. Pre-filling leverages the assistant's tendency to continue a sequence, effectively steering the model toward a specific starting format or tone. By providing the initial content of the assistant's response, you can force the model to adopt a desired structure immediately. This is essential for guiding complex interactions or forcing specific output formats, such as starting a JSON object with a specific curly brace or key.

Answer

It significantly reduces the total number of input tokens consumed by the prompt.

Answer

It forces the model to complete the user's unfinished sentence.

Answer

It allows the model to access real-time external data without function calling.

Question 10

Refer to the exhibit. A developer receives this JSON response while trying to generate a response from Claude. What does this error message signify regarding Anthropic's safety systems?

Accepted Answer

The model's generated output violated a safety threshold and was suppressed.. This error indicates that the model's output was blocked by an automated safety filter. Anthropic uses various layers of safety, including the model's internal refusal logic and external filters that scan for specific types of harmful content. This ensures that even if a model were to generate a harmful response, it is caught before being returned.

Answer

The user's API key has been permanently banned for a policy violation.

Answer

The request was blocked because the prompt was too long for the model.

Answer

The developer forgot to include the mandatory 'safety_check' parameter.

Question 11

You are building an application using Claude to extract structured data from messy user emails. The model occasionally ignores your schema constraints when the input text is ambiguous. Which strategy most effectively ensures strict adherence to the requested format?

Accepted Answer

Enclose the user input in <user_input> tags and include a few-shot example of the expected JSON structure within the system prompt.. Using XML tags to delineate user input from instructions, coupled with a few-shot example of the desired JSON output, significantly improves schema adherence. This technique leverages Claude’s architectural strength in processing structured markup, reducing the likelihood of the model conflating input data with system instructions. Consistent formatting is vital in production pipelines where downstream systems expect rigid data schemas, as failure to comply can cause parsing errors and data loss.

Answer

Increase the temperature parameter to 1.0 to allow the model more creative flexibility in formatting.

Answer

Add a preamble asking the model to act as a helpful assistant that tries its best to output JSON.

Answer

Ask the model to output the result in a markdown code block without providing a schema definition.

Question 12

Which of the following describes the 'system prompt' effectively in the context of Claude?

Accepted Answer

The primary mechanism for defining the model's persona, operational rules, and behavioral constraints.. The system prompt acts as the foundational 'constitution' for the interaction, defining the agent's persona, constraints, and operational goals. Unlike user messages, the system prompt is prioritized by the model and sets the boundaries for the entire session. Proper configuration here is critical because it dictates how the model interprets incoming user requests and handles edge cases, ensuring consistent and safe behavior across various application use cases.

Answer

A list of history messages that the model uses to understand previous context.

Answer

A temporary cache used to store user input tokens to improve response speed.

Answer

An optional field that is only used when the model is in training mode.

Question 13

Refer to the exhibit. An organization implements this JSON-based policy in their middleware before sending data to the Claude API. Which safety and privacy goal does this configuration primarily support?

Accepted Answer

Minimizing the exposure of Personally Identifiable Information (PII) to the AI model.. This configuration is a classic example of a PII (Personally Identifiable Information) protection layer. By redacting, blocking, or masking sensitive fields like emails and Social Security numbers before they reach the AI, the organization minimizes the risk of data leakage and ensures compliance with privacy regulations like GDPR or HIPAA, supporting the responsible use of AI.

Answer

Enhancing the model's ability to perform complex mathematical calculations.

Answer

Reducing the latency of API responses by minimizing the payload size.

Answer

Preventing the model from learning from sensitive user data during training.

Question 14

Refer to the exhibit. A company is building a translation service for live subtitles where latency must be under 200ms per segment. Which Claude 3 model family member is the only viable candidate based on the provided performance and cost data?

Accepted Answer

Claude 3 Haiku. In real-time applications like live subtitling, latency is the primary constraint. Even if a model is more intelligent, if it cannot meet the timing requirements, it is unusable. Claude 3 Haiku's ultra-low latency makes it the only choice for near-instantaneous feedback loops required for live media.

Answer

Claude 3 Opus

Answer

Claude 3 Sonnet

Answer

All Claude 3 models are equally viable.

Question 15

You are building a customer support bot using Claude 3.5 Sonnet. You notice the model sometimes hallucinates policy details when the user asks a question not covered in your provided documentation. How should you structure your prompt to minimize this?

Accepted Answer

Add a constraint to the system prompt: 'If the answer is not found in the provided context, state that you do not know and do not attempt to guess.'. Anchoring the model with strict constraints is the most effective way to reduce hallucinations. By explicitly instructing the model to state 'I don't know' rather than guessing, you force a boundary between known context and external knowledge. This approach is essential for enterprise applications where accuracy and safety are paramount, ensuring that the model remains within the provided knowledge base and does not invent plausible-sounding but incorrect information.

Answer

Increase the temperature setting to 1.0 to ensure the model explores all possible answers before responding.

Answer

Embed all company policy documents into a single massive system prompt to ensure total coverage.

Answer

Use few-shot prompting to include examples of the model generating creative solutions to unknown problems.