CCAO-F Practice Test 18 — 15 Questions

Question 1

A developer notices that Claude consistently provides more detailed career advice to male-sounding personas than to female-sounding personas in a simulation. This is an example of which safety concern?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Algorithmic Bias. Algorithmic bias occurs when a model reflects or amplifies societal prejudices found in its training data. Even with safety alignment, models can exhibit subtle biases in how they treat different demographic groups. Identifying and mitigating these biases is a key part of Anthropic's commitment to responsible and equitable AI development.

Answer

Data Hallucination

Answer

Over-refusal

Answer

Prompt Injection

Question 2

Claude refuses to write a fictional story about a bank robbery for a novelist, claiming it cannot assist with illegal acts. The novelist intends for the story to be part of a crime thriller. This is best described as:

Accepted Answer

An over-refusal due to conservative safety alignment.. This is a classic case of over-refusal, where the model's safety training is applied too broadly. While bank robbery is illegal, writing a fictional story about one is a standard creative task. Over-refusals occur when the model fails to distinguish between 'assisting in a crime' and 'writing about a crime' in a creative context.

Answer

A successful application of the Harmlessness principle.

Answer

A jailbreak attempt by the novelist.

Answer

A violation of the Anthropic Usage Policy by the user.

Question 3

When Claude is asked to generate instructions for a dangerous and illegal activity, such as manufacturing a prohibited substance, it provides a refusal. This refusal is a direct result of which Anthropic design choice?

Accepted Answer

The 'harmlessness' training within the Constitutional AI framework.. Anthropic's commitment to safety is baked into the model's architecture through Constitutional AI. The refusal to assist with illegal or dangerous activities is a deliberate design choice to ensure that the model cannot be used to cause physical harm. This is a core part of the 'harmlessness' principle that guides all Anthropic model development.

Answer

The model's inability to understand complex chemical formulas.

Answer

A manual review of the prompt by an Anthropic safety officer.

Answer

A request from the user's internet service provider to block the content.

Question 4

You are building a high-throughput application. Which TWO of the following strategies are best for optimizing your API costs and efficiency?

Accepted Answer

Cache frequently used static system prompts or common context.. Optimizing API usage involves balancing model choice with intelligent prompt management. Choosing the right model for the task (Sonnet vs. Haiku) and ensuring input tokens are minimized through efficient prompting are the most effective ways to reduce operational overhead. These practices are fundamental to scaling Claude-based applications while maintaining a sustainable cost structure and ensuring that the API responds with low latency to handle high-volume user traffic.

Answer

Use the largest available model for all tasks to ensure accuracy.

Answer

Set the temperature to 0 for all production API calls.

Answer

Increase the 'max_tokens' to the maximum allowed for every request.

Question 5

You are debugging a prompt where Claude frequently fails to follow a complex, multi-part rule set. What is the most effective way to troubleshoot this?

Accepted Answer

Ask the model to create a checklist of the rules and confirm it has addressed each one before outputting the final response.. When a model struggles with complex rules, it is often because the rules are presented in a way that doesn't allow for clear logical checking. By breaking down the rules into a simple checklist and forcing the model to verify its output against the checklist before finalizing the answer, you create a self-correcting loop that significantly improves adherence to complex requirements in high-stakes environments.

Answer

Increase the number of system prompts to repeat the instructions multiple times.

Answer

Change the model to a smaller, faster model to reduce latency.

Answer

Add a few-shot example that uses completely different logic to distract the model from the current failing rules.

Question 6

Anthropic's approach to safety involves 'Red Teaming.' Which TWO of the following best describe the purpose and process of Red Teaming in the context of Claude?

Accepted Answer

Simulating adversarial attacks to identify potential safety failures in the model.. Red Teaming is a rigorous testing process where internal or external experts deliberately try to find vulnerabilities in the model. This includes attempting to bypass safety filters, trigger biased responses, or elicit harmful information. The goal is to identify and fix these weaknesses before the model is released to the general public.

Answer

Automating the generation of marketing copy to increase model adoption.

Answer

Manually verifying that every single model output is 100% factually correct.

Answer

Ensuring the model's hardware is protected against physical theft in the data center.

Question 7

Which of the following describes the correct behavior of the Anthropic API regarding the 'system' prompt?

Accepted Answer

It provides foundational behavioral instructions to the model.. The system prompt is designed to set the behavior, persona, and constraints of the model before it processes user-provided inputs. It is treated with higher priority than the user message, making it the ideal place for defining core safety guidelines or operational instructions. Correct utilization of the system field is a fundamental security practice, as it helps enforce behavioral boundaries consistently throughout the conversation, regardless of user attempts to influence the model.

Answer

It is ignored if a user message is also provided.

Answer

It can be dynamically changed during a single request.

Answer

It is automatically appended to the end of the user message.

Question 8

Refer to the exhibit. You are receiving this error in your Python integration. What is the likely cause of this issue?

Accepted Answer

You are passing a list of strings to the system parameter instead of a single concatenated string.. Anthropic's API expects the system prompt to be a single string. If a developer accidentally passes a list, dictionary, or another object type into the system field, the API will reject the request. This is a common integration error that highlights the importance of data type validation before passing parameters to the API client, ensuring all fields meet the expected schema requirements.

Answer

Your prompt contains invalid characters that the JSON parser cannot read.

Answer

You are using an outdated version of the Anthropic SDK that no longer supports system prompts.

Answer

Your system prompt exceeds the maximum token length limit for the model.

Question 9

Refer to the exhibit. A developer is testing this API request to optimize their analysis tool. Why will this specific request fail to provide the intended performance benefits of prompt caching?

Accepted Answer

The content marked for caching is significantly below the 1024-token minimum requirement.. This question highlights the token threshold requirement for prompt caching. In the exhibit, the total token count of the CSV data and instructions is far below the 1024-token minimum required by Anthropic's caching mechanism. Understanding these limits prevents developers from misconfiguring their applications or expecting cost savings on prompts that do not meet the technical criteria.

Answer

The cache_control block is placed inside the user role instead of the system role.

Answer

The XML tags used in the text content are not valid standard HTML syntax.

Answer

The messages array contains two separate text objects within a single user role.

Question 10

Refer to the exhibit. A developer is testing the vision capabilities of Claude 3.5 Sonnet. Based on the provided JSON request, which statement accurately describes how the model will process this input?

Accepted Answer

The model will analyze the image and text together to provide the receipt total.. The Claude API supports multimodal inputs by allowing a mix of text and image content blocks within the messages array. In this specific configuration, the model receives both a base64-encoded image and a text query, enabling it to apply its vision capabilities to answer a specific question about the visual data.

Answer

The model will fail because images must be sent in a separate system prompt.

Answer

The request will error because Claude 3.5 Sonnet does not support base64 images.

Answer

The model will ignore the text and only provide a description of the image.

Question 11

An AI researcher is concerned about 'hallucinations' when Claude summarizes internal technical specifications. Which approach leverages Claude's fundamental design to minimize the risk of the model inventing non-existent features?

Accepted Answer

Providing the documents in the context and requesting citations. Hallucinations occur when a model generates plausible but incorrect information. To mitigate this, grounding the model in the provided context is the most effective strategy. By explicitly instructing Claude to use only the provided text and to cite its sources, the model's reasoning is constrained to the verified data, significantly improving the factual accuracy of the summary. (69 words)

Answer

Increasing the temperature to 1.0

Answer

Using Claude 3 Haiku for higher precision

Answer

Setting 'max_tokens' to a very low value

Question 12

A healthcare organization is using Claude to summarize patient notes. To ensure the responsible use of the AI and protect patient privacy, which action should the organization take before sending data to the Claude API?

Accepted Answer

De-identify or redact all PII/PHI from the notes locally.. Protecting Personally Identifiable Information (PII) and Protected Health Information (PHI) is a critical component of responsible AI use. Organizations must ensure that sensitive data is handled according to legal standards like HIPAA. De-identifying or anonymizing data before it reaches the AI provider is a primary security measure to prevent accidental exposure.

Answer

Enable the 'Public Data Sharing' option in the Anthropic console.

Answer

Instruct the model via the system prompt to ignore all names.

Answer

Use the 'Honest' parameter in the API request body.

Question 13

Which action constitutes a violation of Anthropic’s Acceptable Use Policy regarding the generation of deceptive content?

Accepted Answer

Creating content that impersonates a real public figure to spread false information.. Anthropic strictly prohibits the use of its models to generate deceptive content, including political misinformation or impersonation. This policy is fundamental to responsible use, as the widespread dissemination of fabricated content undermines public trust and creates real-world harm. Developers are responsible for ensuring their applications do not facilitate the creation or distribution of fraudulent or misleading information targeting individuals or groups.

Answer

Generating a fictional story about a hypothetical political scenario.

Answer

Using the model to write an email template for customer support employees.

Answer

Building a tool that helps students brainstorm ideas for a history essay.

Question 14

A user asks Claude to help them write a convincing phishing email to steal credentials from their coworkers. Claude refuses. How does this refusal benefit the 'Safety and Responsible Use' ecosystem?

Accepted Answer

It prevents the model from being used to facilitate cyberattacks and social engineering.. By refusing to generate phishing content, Claude prevents its technology from being used as a tool for cybercrime. This aligns with Anthropic's goal of ensuring AI is a force for good. Such refusals protect potential victims, reduce the burden on cybersecurity teams, and maintain the model's reputation as a safe and helpful assistant for legitimate tasks.

Answer

It ensures the model remains competitive with other AI providers who also refuse.

Answer

It helps the user learn how to write better phishing emails on their own.

Answer

It allows the model to save its processing power for more complex coding tasks.

Question 15

Which THREE of the following are core components of Anthropic's 'Constitutional AI' approach to model safety?

Accepted Answer

A set of written principles (the 'Constitution') used to guide model behavior.. Constitutional AI is a unique method developed by Anthropic to train models to be helpful, honest, and harmless. It involves a supervised learning phase where the model learns from a 'constitution' of principles, followed by a reinforcement learning phase where the model critiques its own responses based on those principles, reducing the need for human labeling.

Answer

Complete reliance on human moderators to review every API call in real-time.

Answer

Hard-coding specific keywords that trigger an automatic shutdown of the model.