CCAO-F Safety and Responsible Use Practice Test 3 — 15 Questions

Question 1

A company wants to use Claude to automate the first pass of its content moderation for a social media platform. What is a key safety recommendation for this specific use case?

Accepted Answer

The company should use a 'Human-in-the-loop' system to review AI decisions.. Using AI for moderation is a powerful application, but it requires human oversight to be responsible. AI can make mistakes, show bias, or fail to understand cultural nuances. A 'Human-in-the-loop' approach ensures that the AI's decisions are audited and that difficult or borderline cases are handled by people with the appropriate context.

Answer

The AI should have final authority to ban users without human review.

Answer

The AI should be instructed to ignore the context of the posts to save time.

Answer

The company should only use the oldest, least capable version of Claude for safety.

Question 2

Refer to the exhibit. When Claude receives this request, it is likely to refuse. According to Anthropic's core safety principles, why is this refusal necessary for 'Responsible Use'?

Accepted Answer

To prevent the model from facilitating illegal acts and causing real-world harm.. Responsible use of AI involves preventing the model from facilitating criminal or harmful activities. Providing instructions on how to commit a crime like car theft is a direct violation of the harmlessness principle. By refusing such requests, Anthropic ensures that its technology is not used to cause real-world damage or undermine public safety.

Answer

Because car theft is a topic that requires a paid subscription to access.

Answer

Because the model does not have access to real-time GPS data for cars.

Answer

Because the 'max_tokens' value is too low to explain the process properly.

Question 3

A developer is building a sensitive financial advice application using Claude. To ensure compliance with safety standards and prevent the model from providing harmful advice, which architectural approach provides the most robust defense?

Accepted Answer

Integrating a secondary validation layer that inspects model output for prohibited content.. Effective AI safety in financial contexts requires a multi-layered approach. While system prompts set boundaries, they are vulnerable to jailbreaks. Implementing external guardrails, such as PII filtering and semantic checks, ensures that model outputs are validated against regulatory requirements before reaching the user. This strategy is critical because it decouples model generation from output validation, creating a verifiable safety perimeter that remains intact even if the model's internal heuristics are bypassed or manipulated.

Answer

Relying exclusively on a robust system prompt to define all financial boundaries.

Answer

Using few-shot prompting to demonstrate correct financial advice patterns to Claude.

Answer

Setting the temperature parameter to zero to ensure deterministic, safe outputs.

Question 4

An application uses Claude to summarize user-generated medical feedback. To comply with privacy requirements, you must ensure no Personally Identifiable Information (PII) is sent to the model. Which is the most appropriate workflow?

Accepted Answer

Processing the text through a dedicated PII anonymization layer before calling the API.. Data sanitization should occur prior to hitting the API. By using a PII-scrubbing service (like Presidio or a custom regex layer) before the payload reaches Anthropic, you enforce data residency and privacy controls at the edge. This approach is essential for responsible AI because it ensures PII never leaves your secure environment, preventing potential leaks and maintaining strict compliance with global privacy standards like GDPR or HIPAA.

Answer

Prompting the model to ignore and redact any PII found in the input.

Answer

Using a specific system prompt that warns the model to treat all input as private.

Answer

Requesting that users manually redact their own PII before submitting feedback.

Question 5

Which action constitutes a violation of Anthropic’s Acceptable Use Policy regarding the generation of deceptive content?

Accepted Answer

Creating content that impersonates a real public figure to spread false information.. Anthropic strictly prohibits the use of its models to generate deceptive content, including political misinformation or impersonation. This policy is fundamental to responsible use, as the widespread dissemination of fabricated content undermines public trust and creates real-world harm. Developers are responsible for ensuring their applications do not facilitate the creation or distribution of fraudulent or misleading information targeting individuals or groups.

Answer

Generating a fictional story about a hypothetical political scenario.

Answer

Using the model to write an email template for customer support employees.

Answer

Building a tool that helps students brainstorm ideas for a history essay.

Question 6

A junior developer at a marketing agency uses the Claude API to draft promotional blog posts. For one client, they paste in a confidential product roadmap the client shared under NDA and ask Claude to generate teaser posts. The developer's manager later asks whether this use complied with Anthropic's policies. Which statement best describes the compliance situation?

Accepted Answer

This likely violates the client's confidentiality agreement, so the developer should have obtained explicit client consent or used non-confidential material instead.. Sending NDA-protected client material to a third-party AI service is a disclosure that requires the client's consent or a contractual framework permitting it. The agency, as the Anthropic customer, is accountable for what it submits, and neither client authorship nor later deletion neutralizes the confidentiality breach. The safe approach is explicit authorization, an appropriate data agreement, or substituting non-confidential content.

Answer

This is compliant as long as the developer deletes the conversation afterward and does not enable any training-data sharing setting.

Answer

This is compliant because Anthropic's Acceptable Use Policy only restricts illegal content and does not address confidential business information.

Answer

This is compliant because the roadmap was provided by the client, who owns the content and implicitly authorized its use.

Question 7

A product team is preparing to launch a Claude-powered assistant that gives users advice on personal finance topics such as budgeting and debt management. Before launch, the safety lead wants to reduce the risk of harmful financial guidance. Which TWO measures best align with responsible deployment practices for this scenario? (Choose two.)

Accepted Answer

Build an evaluation set of representative finance prompts, including edge cases, and review outputs before and after each model or prompt change.. Responsible deployment of a domain-specific assistant combines behavioral steering through system prompts with empirical measurement through evaluation sets. Directing Claude toward general education and professional referral reduces harm, while a curated finance evaluation suite lets the team detect regressions and validate that mitigations work. Disabling refusals, skipping testing, or maximizing randomness all increase risk rather than reduce it, so they are not appropriate choices.

Answer

Rely solely on Claude's built-in safety training and skip any application-level testing, since Anthropic has already addressed financial-advice risks.

Answer

Disable all refusal behavior so the assistant never declines a user request, ensuring a consistent and frictionless experience.

Answer

Increase the model's temperature setting to its maximum so responses are more creative and engaging for users.

Question 8

A startup is building a Claude-powered assistant for a children's tutoring app. During red-team testing, a prompt is found that makes Claude role-play as a character who encourages a minor to keep a harmful secret from parents. The startup wants to prevent this without blocking legitimate tutoring conversations. Which approach best aligns with Anthropic's safety guidance for handling such edge cases?

Accepted Answer

Implement input and output classifiers that detect and block prompts or responses involving harmful secrets with minors, and regularly red-team the system to find new bypasses.. The correct approach combines input/output classifiers with continuous red-teaming, as recommended by Anthropic for high-risk applications involving minors. Classifiers act as a safety net even if the model fails to refuse, and red-teaming uncovers new attack patterns. This layered defense protects users while preserving legitimate tutoring functionality, aligning with Anthropic's principle of balancing safety and helpfulness.

Answer

Set a low temperature and a max token limit to reduce the chance of creative harmful outputs, and monitor logs for any violations.

Answer

Add a system prompt instructing Claude to never discuss secrets and rely on the model's built-in safety training to refuse any related requests.

Answer

Fine-tune Claude on a dataset of safe tutoring conversations so it learns to avoid harmful secrets, then deploy without additional filters.

Question 9

A support engineer is drafting an internal guide on using Claude for customer-facing replies. A colleague suggests that because Claude is generally helpful, it is fine to let it answer questions about competitors' products with confident comparisons. The engineer wants to set a policy that reflects responsible use. Which guidance is most appropriate?

Accepted Answer

Prohibit unverified competitor claims and require that any factual comparison be checked against approved internal sources before publishing.. The core risk is confident inaccuracy in customer-facing content, not the topic of competitors itself. A policy that requires verification against approved sources before publication creates a concrete check that catches hallucinations while still allowing accurate, well-grounded comparisons. Blanket bans are unnecessarily restrictive, and disclaimers do not prevent the dissemination of false statements to customers.

Answer

Allow confident competitor comparisons, since Claude's training data includes public information about many companies.

Answer

Prohibit any mention of competitors at all, even when the comparison is accurate and sourced from official documentation.

Answer

Permit competitor comparisons but add a disclaimer that the information may be inaccurate and should not be relied upon.

Question 10

A legal tech company uses Claude to summarize case files. A developer notices that when summarizing a case involving a defendant with a non-English-sounding name, Claude sometimes adds speculative language about the defendant's credibility that is not present in the source. The developer wants to mitigate this bias without reducing summarization quality. Which action is most appropriate according to responsible AI practices?

Accepted Answer

Add a prompt instruction to summarize only facts from the source and avoid speculation, and evaluate outputs for bias across diverse names.. The most appropriate action is to refine the prompt to emphasize factual summarization and to systematically evaluate outputs for bias across diverse names. This directly addresses the speculative language while maintaining quality. It also aligns with responsible AI principles of testing for fairness and iterating on prompts, rather than relying on parameter changes or dataset removal that could degrade performance.

Answer

Fine-tune Claude on a dataset of legal summaries that are known to be unbiased, then deploy without further evaluation.

Answer

Remove all names from case files before summarization to eliminate the possibility of name-based bias.

Answer

Increase the model's temperature to encourage more creative summaries that might avoid biased patterns.

Question 11

A red team is probing a Claude-powered tutoring application that helps high-school students with chemistry homework. During testing, a user submits a prompt asking Claude to role-play as a teacher who will provide step-by-step instructions for synthesizing a hazardous compound at home. The application currently passes raw user input directly to the model. Which response best reflects responsible handling of this scenario?

Accepted Answer

The team should add application-level controls such as input screening for hazardous-intent patterns, system-prompt scope limits for the tutoring context, and logging so that attempts are visible and reviewable.. A tutoring application serving minors needs defense in depth rather than a single reliance on model behavior. Application-level input screening, scoped system prompts, and privacy-preserving logging create detection and accountability around hazardous-intent attempts. Removing logging sacrifices visibility, and increasing creative latitude would weaken rather than strengthen the safety posture of the deployment.

Answer

The application should rely on Claude's built-in safety behavior to refuse, and the team should not add any additional controls since that would duplicate the model's protection.

Answer

The team should disable logging entirely to protect student privacy, and rely on periodic manual spot checks of random sessions instead.

Answer

The team should raise the model's temperature and encourage more creative role-play responses so students remain engaged with the tutoring experience.

Question 12

A developer is using the Claude API to build a content moderation tool. They want to ensure that Claude's responses comply with Anthropic's usage policies. Which of the following is a required step when using the API for moderation?

Accepted Answer

Ensure that the tool does not generate or promote harmful content, and adhere to Anthropic's Acceptable Use Policy.. The key requirement when using the Claude API for moderation is to comply with Anthropic's Acceptable Use Policy, which prohibits generating or promoting harmful content. This ensures the tool itself does not become a source of harm. Other practices like rate limiting or logging are beneficial but not mandated by the policy. Adherence to the AUP is essential for all applications.

Answer

Log all API requests and responses for auditing purposes.

Answer

Implement rate limiting to prevent excessive API calls.

Answer

Use a specific model version that is optimized for moderation tasks.

Question 13

An analyst is using Claude to summarize user feedback for a product team. While reviewing outputs, the analyst notices that Claude sometimes invents specific statistics, such as '78% of users reported difficulty with onboarding,' that do not appear anywhere in the source feedback. The analyst wants to reduce this behavior in the workflow. Which approach is most appropriate?

Accepted Answer

Instruct Claude to summarize using only the provided feedback text, to avoid introducing statistics not present in the source, and to flag when it cannot support a claim.. Fabricated statistics appear when the model fills gaps beyond the supplied source material. Instructing Claude to summarize only from the provided feedback and to flag unsupported claims constrains generation to what the input can support. Confidence scores, disclaimers, and higher temperature do not prevent the fabrication and may obscure it, so source-constrained prompting is the appropriate remedy for this workflow.

Answer

Instruct Claude to include confidence scores next to every statistic it generates, so readers can judge reliability.

Answer

Increase the model's temperature so it produces more varied summaries and is less likely to repeat the same invented figures.

Answer

Ask Claude to append a disclaimer that some figures may be illustrative and should be verified before use.

Question 14

A developer is building a Claude-powered chatbot for a mental health support app. During testing, a user prompt expresses suicidal ideation. The developer wants to ensure the chatbot responds safely and appropriately. Which of the following is the best course of action according to Anthropic's safety guidelines?

Accepted Answer

Have the chatbot express empathy, encourage the user to seek professional help, and provide crisis resources without attempting to diagnose or treat.. The best action is for the chatbot to express empathy, encourage professional help, and provide crisis resources without diagnosing or treating. This aligns with Anthropic's guidelines for handling sensitive mental health topics, ensuring the user feels heard while directing them to appropriate care. It balances safety with helpfulness and avoids overstepping the chatbot's role.

Answer

Program the chatbot to offer a diagnosis of depression and suggest coping strategies.

Answer

Configure the chatbot to immediately provide a list of emergency hotlines and end the conversation.

Answer

Instruct the chatbot to change the subject to a positive topic to de-escalate the situation.

Question 15

A small startup is drafting its public-facing AI usage policy and wants to align with Anthropic's guidance on transparency. The team plans to embed Claude in a chatbot that recommends legal documents to users. Which practice best reflects responsible disclosure to end users in this scenario?

Accepted Answer

Add a visible notice that the recommendations are generated by an AI system and may require verification by a qualified professional.. Responsible use of Claude in a user-facing product centers on giving people clear, timely notice that they are interacting with an AI system and that outputs may be imperfect. A visible notice paired with a recommendation to verify with a qualified professional satisfies transparency and mitigates overreliance, particularly in a legal context where errors carry real consequences.

Answer

Store a disclosure statement in the application's terms of service and reference it only when a user files a complaint.

Answer

Have the chatbot claim to be a licensed attorney so users trust the document recommendations more readily.

Answer

Configure the chatbot to deny being an AI whenever a user asks directly, to keep the conversation natural.