CCAR-P Practice Test 3 — 10 Questions

Question 1

A company is integrating Claude into a high-stakes automated decision-making system. Which TWO practices should be implemented to align with Anthropic’s Responsible AI principles?

Accepted Answer

Implement human-in-the-loop oversight for model outputs.. Integrating LLMs into high-stakes environments requires a focus on human-in-the-loop (HITL) oversight and continuous monitoring. These practices help manage hallucinations and maintain accountability. Without these safeguards, automated systems can produce biased or incorrect outcomes without human correction. Implementing these protocols ensures that AI governance remains aligned with human values and organizational safety goals, reducing the risk of unintended consequences in critical decision-making processes.

Answer

Allow the model to finalize decisions without human review.

Answer

Only use the most advanced model available for all tasks.

Answer

Disable all system logs to preserve user privacy.

Question 2

Your team is deploying an application that uses PII in prompts. A stakeholder asks how you are mitigating the risk of data leakage. How do you respond?

Accepted Answer

Explain the use of PII masking and data sanitization pipelines.. The correct response involves explaining a combination of data sanitization, prompt masking, and secure infrastructure design. This is critical because PII handling is a high-liability area. By detailing a defense-in-depth strategy, the architect provides the necessary assurance that privacy is treated with the highest priority, which is vital for maintaining organizational compliance and preventing severe legal or reputational damage during the application's lifecycle.

Answer

Assure them that the model is smart enough to handle PII.

Answer

Tell them the model does not store any data anyway.

Answer

Suggest moving the project to an on-premise LLM to ensure security.

Question 3

Refer to the exhibit. The user is attempting to trick the model into revealing sensitive information by claiming a high-clearance role. This is an example of which security threat, and how does the 'system' prompt help mitigate it?

Accepted Answer

Prompt injection (jailbreaking); the system prompt establishes a higher-priority context.. Social engineering and role-playing are common techniques used in prompt injection attacks to bypass security constraints. The system prompt is a powerful governance tool because it sets the foundational rules and persona for the model, which are prioritized by Claude's reasoning engine over conflicting instructions found in the user messages.

Answer

Man-in-the-middle attack; the system prompt encrypts the secret code name.

Answer

Denial of Service (DoS); the system prompt limits the tokens used to hide the secret.

Answer

Data poisoning; the system prompt cleans the training data in real-time.

Question 4

An agentic system is struggling with 'context fragmentation' over long-running sessions. What is the most effective architectural solution?

Accepted Answer

Implement a hierarchical memory system with summarization.. Context fragmentation happens when the history becomes too large or disorganized. A 'summarization agent' or a 'memory manager' that periodically compresses the conversation history into a concise summary is the standard solution. This preserves core context while discarding transient details, ensuring the main agent remains focused on the long-term goal rather than getting lost in thousands of lines of previous chat history.

Answer

Increase the context window size of the model indefinitely.

Answer

Force the user to clear their history periodically.

Answer

Only use the most recent 10 messages of the history.

Question 5

Refer to the exhibit. An agentic workflow encounters an error immediately after this message is generated by Claude. No further messages are sent to the API. What is the most likely cause of the failure in the orchestration logic?

Accepted Answer

The orchestrator failed to send a tool_result message. The Anthropic Messages API requires a specific sequence for tool use. After the assistant generates a 'tool_use' block, the orchestration layer must execute the tool and return a 'tool_result' message to the model before the assistant can continue its turn. Failing to provide this required response breaks the synchronous nature of the tool-calling conversation flow.

Answer

The input parameters do not match the JSON schema

Answer

The tool_use ID is missing the required prefix

Answer

The assistant content block lacks a stop_reason

Question 6

Which THREE factors should be prioritized when selecting an Anthropic model for a production-grade application?

Accepted Answer

Latency requirements of the specific user task.. Balancing performance, latency, and cost is fundamental to operational enablement. A professional architect must consider the specific requirements of the task—whether high-level reasoning or rapid response—to ensure that the chosen model delivers value efficiently. These factors dictate the system's scalability and overall budget, making them the primary drivers for architectural decisions when building and maintaining reliable AI-powered solutions in a corporate environment.

Answer

The total number of parameters in the model.

Answer

Whether the model is open-source or proprietary.

Question 7

A development team wants to optimize the latency of their prompt engineering workflow using Claude. They currently run evaluations sequentially. Which approach best improves iteration speed?

Accepted Answer

Implement a distributed asynchronous evaluation framework for concurrent prompt execution.. Parallelizing evaluation pipelines allows developers to test multiple prompt variations concurrently, significantly reducing feedback loops. In the context of LLM development, bottlenecking often occurs during the testing phase where prompt sensitivity to small changes requires broad regression coverage. By integrating asynchronous evaluation frameworks into CI/CD, teams can validate changes rapidly without manual overhead, ensuring that prompt performance remains consistent across diverse input datasets.

Answer

Switch to a smaller model version for all initial prompt testing.

Answer

Reduce the number of test cases to ensure the evaluation suite completes quickly.

Answer

Cache all user prompts to avoid re-sending identical requests to the API.

Question 8

Which TWO practices best improve the maintainability of large-scale prompt libraries? (Choose TWO)

Accepted Answer

Store prompts in external configuration files or a dedicated prompt management system.. Managing large prompt libraries requires modularity and version control to ensure consistency. By treating prompts as code and decoupling them from application logic, teams can implement standardized testing and deployment workflows. This separation allows developers to iterate on prompt performance independently of the software release cycle, reducing the risk of regressions and enabling rapid experimentation within established operational guardrails.

Answer

Hardcode all prompt versions directly into the application source code.

Answer

Combine prompts and business logic into monolithic classes for better encapsulation.

Answer

Avoid using variables in prompts to ensure absolute predictability.

Question 9

A developer needs to log all prompt-response pairs for compliance. What is the most reliable way to implement this without impacting application performance?

Accepted Answer

Use an asynchronous message queue to offload log processing.. Asynchronous logging is the key to maintaining application performance while ensuring full auditability. By offloading the logging process to a background task, the main request thread is not blocked, ensuring that users experience minimal latency. This pattern is crucial for compliance-heavy environments where audit trails are non-negotiable but system performance must remain highly responsive to meet end-user demands.

Answer

Write logs to a local file system before sending the response to the user.

Answer

Request the user to manually send a copy of the interaction for audit.

Answer

Only log errors instead of every prompt-response pair.

Question 10

You are building a customer-support agent with Claude that must call a lookup_order tool, then a refund_order tool that depends on the order's status. During testing, the agent sometimes calls refund_order before the lookup_order result returns. Which change to your orchestration loop best enforces the required ordering?

Accepted Answer

Expose only lookup_order until its result is returned, then add refund_order to the tools array for the subsequent request.. Deterministic ordering is achieved by controlling what the model can do at each step, not by prompting harder. Withholding the dependent tool until the prerequisite result is in the conversation removes the failure mode entirely, because the model cannot select a tool absent from the current tools array. This makes the dependency a property of the orchestration state machine rather than of model compliance.

Answer

Increase the max_tokens value so the model has more room to reason about the correct order before calling tools.

Answer

Include both tools in the same request's tools array and let the model choose the call order.

Answer

Set tool_choice to force a tool call on every turn so the agent never stalls between lookup and refund.