CCAR-P Practice Test 2 — 25 Questions

Question 1

Which THREE factors should be prioritized when selecting an Anthropic model for a production-grade application?

Accepted Answer

Latency requirements of the specific user task.. Balancing performance, latency, and cost is fundamental to operational enablement. A professional architect must consider the specific requirements of the task—whether high-level reasoning or rapid response—to ensure that the chosen model delivers value efficiently. These factors dictate the system's scalability and overall budget, making them the primary drivers for architectural decisions when building and maintaining reliable AI-powered solutions in a corporate environment.

Answer

The total number of parameters in the model.

Answer

Whether the model is open-source or proprietary.

Question 2

A development team wants to optimize the latency of their prompt engineering workflow using Claude. They currently run evaluations sequentially. Which approach best improves iteration speed?

Accepted Answer

Implement a distributed asynchronous evaluation framework for concurrent prompt execution.. Parallelizing evaluation pipelines allows developers to test multiple prompt variations concurrently, significantly reducing feedback loops. In the context of LLM development, bottlenecking often occurs during the testing phase where prompt sensitivity to small changes requires broad regression coverage. By integrating asynchronous evaluation frameworks into CI/CD, teams can validate changes rapidly without manual overhead, ensuring that prompt performance remains consistent across diverse input datasets.

Answer

Switch to a smaller model version for all initial prompt testing.

Answer

Reduce the number of test cases to ensure the evaluation suite completes quickly.

Answer

Cache all user prompts to avoid re-sending identical requests to the API.

Question 3

Which TWO practices best improve the maintainability of large-scale prompt libraries? (Choose TWO)

Accepted Answer

Store prompts in external configuration files or a dedicated prompt management system.. Managing large prompt libraries requires modularity and version control to ensure consistency. By treating prompts as code and decoupling them from application logic, teams can implement standardized testing and deployment workflows. This separation allows developers to iterate on prompt performance independently of the software release cycle, reducing the risk of regressions and enabling rapid experimentation within established operational guardrails.

Answer

Hardcode all prompt versions directly into the application source code.

Answer

Combine prompts and business logic into monolithic classes for better encapsulation.

Answer

Avoid using variables in prompts to ensure absolute predictability.

Question 4

A developer needs to log all prompt-response pairs for compliance. What is the most reliable way to implement this without impacting application performance?

Accepted Answer

Use an asynchronous message queue to offload log processing.. Asynchronous logging is the key to maintaining application performance while ensuring full auditability. By offloading the logging process to a background task, the main request thread is not blocked, ensuring that users experience minimal latency. This pattern is crucial for compliance-heavy environments where audit trails are non-negotiable but system performance must remain highly responsive to meet end-user demands.

Answer

Write logs to a local file system before sending the response to the user.

Answer

Request the user to manually send a copy of the interaction for audit.

Answer

Only log errors instead of every prompt-response pair.

Question 5

You are building a customer-support agent with Claude that must call a lookup_order tool, then a refund_order tool that depends on the order's status. During testing, the agent sometimes calls refund_order before the lookup_order result returns. Which change to your orchestration loop best enforces the required ordering?

Accepted Answer

Expose only lookup_order until its result is returned, then add refund_order to the tools array for the subsequent request.. Deterministic ordering is achieved by controlling what the model can do at each step, not by prompting harder. Withholding the dependent tool until the prerequisite result is in the conversation removes the failure mode entirely, because the model cannot select a tool absent from the current tools array. This makes the dependency a property of the orchestration state machine rather than of model compliance.

Answer

Increase the max_tokens value so the model has more room to reason about the correct order before calling tools.

Answer

Include both tools in the same request's tools array and let the model choose the call order.

Answer

Set tool_choice to force a tool call on every turn so the agent never stalls between lookup and refund.

Question 6

A support agent built on Claude must decide whether a customer request is a billing issue, a technical issue, or a general inquiry before routing it. The categories are fixed and mutually exclusive, and the routing decision must be fast and cheap. Which approach is most appropriate?

Accepted Answer

Use a single Claude call with a constrained output format such as a tool definition or structured JSON that returns exactly one category label.. Fixed, mutually exclusive categories with strict latency and cost goals are best handled by a single Claude call that constrains output to one of the allowed labels. Using a tool definition or JSON schema with an enum removes ambiguity and avoids the overhead of multi-agent orchestration or a separate fine-tuned model.

Answer

Fine-tune a separate model on historical tickets and deploy it alongside the Claude agent for classification.

Answer

Give the agent access to all internal tools and let it infer the category from whichever tool it chooses to call.

Answer

Build a multi-agent pipeline where a classifier agent debates a router agent until they agree on a category.

Question 7

An agent uses a retrieval tool that returns the top 20 chunks for any query. In production, the agent frequently cites irrelevant chunks and sometimes misses the correct answer even when it is present in the corpus. The corpus contains documents with overlapping terminology. Which architectural change most improves answer grounding without increasing the number of retrieved chunks?

Accepted Answer

Add a re-ranking stage that scores the retrieved chunks against the query and passes only the highest-scoring subset to the model.. The retrieval step is high-recall but low-precision, which is why irrelevant chunks are cited and correct ones are missed amid overlapping terminology. Adding a re-ranking stage that scores candidates against the query and passes only the top subset improves precision without retrieving more chunks, directly improving grounding and citation quality.

Answer

Embed the entire corpus into the system prompt so the model always has full context available.

Answer

Increase the retrieval count to 50 so the correct chunk is more likely to be included somewhere in the context.

Answer

Lower the model's temperature to zero so it sticks more closely to the retrieved text.

Question 8

An orchestration agent runs a nightly workflow that fans out to 12 subagents, each calling a partner REST API. Partner calls intermittently return HTTP 429 with a Retry-After header. The orchestrator currently retries immediately in a tight loop, causing cascading 429s and duplicate side effects on the partner systems. Which architectural change best addresses both the throttling and the duplicate side effects?

Accepted Answer

Introduce a shared token-bucket rate limiter in front of the partner calls plus idempotency keys on every mutating request, with subagents respecting Retry-After.. Bursty fan-out against a rate-limited partner needs two coordinated controls: a shared limiter so the aggregate request rate stays under the partner's ceiling, and idempotency keys so a retried mutating call cannot create a second side effect. Honoring Retry-After aligns retry timing with the partner's guidance. Token or context changes operate on model text, not on outbound traffic, and serializing the workload removes parallelism without addressing throttling or duplication.

Answer

Reduce the fan-out to a single subagent that processes all 12 partners sequentially with no retry logic at all.

Answer

Switch every subagent to a larger context window so each can hold the full history of prior 429 responses and learn to avoid them.

Answer

Increase the orchestrator's max_tokens so the model can reason longer about each 429 before deciding to retry.

Question 9

You are architecting a Claude-based agent for a regulated financial client that performs long-running portfolio rebalancing workflows. A compliance requirement mandates that no single trade instruction may be executed unless it is cryptographically traceable to the exact model-generated intent that produced it. The agent uses the Messages API with tool use, and several downstream services consume tool calls asynchronously. Which architectural mechanism best satisfies this requirement while preserving agent autonomy?

Accepted Answer

Persist every assistant turn containing a tool_use block, its tool_use id, and the matching tool_result, forming an immutable audit chain keyed by the tool_use id.. Binding each tool call to the platform-generated tool_use id and persisting the surrounding assistant turn creates a deterministic chain from model intent to executed instruction. Because the id appears in both the tool_use block and the tool_result, downstream services and auditors can reconcile them without trusting model-authored text. Caching, summaries, or self-hashes do not establish that binding.

Answer

Require the model to emit a SHA-256 hash of its own reasoning text inside the tool input, and verify that hash in the downstream trade service before execution.

Answer

Route all trades through a single orchestrator agent that logs a natural-language summary of each decision to an append-only ledger after the trade is confirmed.

Answer

Enable prompt caching on the system prompt so that every trade instruction inherits a stable cache key that can be presented to auditors as proof of origin.

Question 10

Your team operates a Claude agent that triages inbound customer support tickets. After several weeks in production, the agent begins approving refunds above the policy ceiling and citing outdated policy text. Investigation shows the system prompt embeds a policy document that was updated three weeks ago, but the deployed prompt was never regenerated. Which architectural practice most directly prevents this class of failure?

Accepted Answer

Move policy content out of the system prompt and retrieve the current policy at runtime via a versioned tool or retrieval step, recording the version used in each decision.. Stale behavior traced to a frozen prompt is best solved by externalizing the mutable knowledge and fetching it at decision time from a versioned source. That way policy updates propagate immediately, and logging the retrieved version makes each action auditable. Compression, randomness, or peer review all leave the embedded copy as the de facto source of truth.

Answer

Add a second Claude agent that reviews the first agent's refund decisions and overrides any that appear inconsistent with its own recollection of company policy.

Answer

Increase the model's temperature slightly so the agent explores alternative interpretations of the policy text it has memorized.

Answer

Shorten the system prompt by summarizing the policy into a compact bullet list, which reduces the chance that outdated sections remain embedded.

Question 11

A retail company is building a governance program for a customer-facing Claude agent that can issue refunds and update order records. The risk committee wants controls that limit the blast radius of a compromised or misbehaving agent. (Choose two.)

Accepted Answer

Require human approval for refunds above a defined monetary threshold before the action is executed.. Blast-radius reduction requires preventive controls that bound what the agent can execute. Least-privilege tool scopes with per-action authorization shrink the callable action set, and threshold-based human approval stops high-value refunds before they happen. Logging, policy publication, and periodic transcript review are detective or administrative measures that document or discourage misuse but do not constrain the agent's real-time capabilities, so they fail the risk committee's objective.

Answer

Enable verbose debug logging of every prompt and response for later forensic review.

Answer

Schedule quarterly reviews of the agent's conversation transcripts to identify emerging misuse patterns.

Answer

Publish an acceptable use policy that prohibits employees from manipulating the agent.

Question 12

A fintech company's risk committee is operationalizing a governance program for Claude-powered customer support agents. They must demonstrate to regulators that model behavior changes are tracked, attributable, and reversible. Which TWO practices best satisfy this requirement? (Choose two.)

Accepted Answer

Run a fixed regression suite against each candidate model version and archive the scored results before promoting it.. Attributable, reversible model change management requires two things working together: a frozen, dated artifact in production and comparable evidence captured before promotion. Pinning to dated model identifiers supplies the frozen artifact and the rollback target, while a fixed regression suite run against each candidate supplies the before-and-after evidence. Together they let the risk committee answer what changed, who approved it, and how to undo it.

Answer

Route every request through a gateway that logs the full request and response payloads with the model identifier attached.

Answer

Enable prompt caching on all production requests so that previously validated prompts are reused verbatim.

Answer

Store the system prompt in a version-controlled repository and require pull-request review before it is merged.

Question 13

A multinational bank deploys Claude to draft internal policy summaries for staff in the EU and Singapore. Legal requires that personal data embedded in employee questions never leave its region of origin, but the bank wants a single application codebase. Which architecture most directly enforces the residency requirement?

Accepted Answer

Configure regional API endpoints so that EU traffic is served within the EU and Singapore traffic within its region, sharing only stateless application code.. Data residency is a geographic constraint on where processing happens, so the control must shape the request path rather than the contract or the retention window. Routing each jurisdiction to an in-region API endpoint keeps personal data inside its required boundary while a shared, stateless codebase avoids duplicated engineering effort. Redaction and retention settings reduce risk but do not guarantee the data never leaves the region.

Answer

Enable zero data retention on the account so that no request or response content is stored by the provider.

Answer

Deploy the application in one region and rely on the model provider's contractual data processing addendum to cover cross-border transfer.

Answer

Apply client-side redaction of names and identifiers before the request is sent, then send all traffic to a single global endpoint.

Question 14

A hospital network is drafting its AI risk register for a Claude-based discharge-summary assistant. The governance lead wants entries that describe residual risk after existing controls are applied, and that can be assigned an owner and a review cadence. Which TWO characteristics must each risk register entry have to meet this standard? (Choose two.)

Accepted Answer

A residual risk rating that reflects the effect of the controls already in place.. An operational risk register entry must state the exposure that remains after controls and must have someone accountable for watching it on a schedule. Residual rating captures what is actually at stake post-mitigation, while owner and review interval ensure the entry is revisited and acted upon as the assistant and its clinical context change.

Answer

A verbatim copy of the vendor's model card and system prompt.

Answer

A list of every employee who has ever accessed the assistant.

Answer

A projected cost saving attributed to deploying the assistant.

Question 15

A stakeholder asks for a change in the model's tone to be 'more professional' for customer support. How should you translate this request into technical requirements?

Accepted Answer

Create a clear system prompt with guidelines for tone, style, and vocabulary.. Translating subjective feedback like 'professional tone' into concrete system instructions is a core task for an architect. By creating a specific system prompt and testing it against a set of representative inputs, you define what 'professional' means for the system. This provides a clear, verifiable standard that ensures consistent communication across all customer support interactions, improving both the quality of service and the reliability of the AI implementation.

Answer

Tell the stakeholder that tone is subjective and suggest we keep the default setting.

Answer

Change the model version to one that is specifically advertised as 'professional'.

Answer

Ask the stakeholder to rewrite the model's responses themselves to ensure it is correct.

Question 16

A regional sales director wants the Claude assistant to answer questions about competitor pricing using 'whatever is on the internet.' You know the assistant currently uses only approved internal documents. How should you frame the trade-off for the steering committee?

Accepted Answer

Present a comparison of retrieval sources covering accuracy, freshness, legal exposure, and cost, and recommend a scoped pilot with an approved external source.. When a stakeholder asks to broaden a data source, the architect's value is in structuring the trade-off rather than issuing a verdict. A source comparison across accuracy, freshness, legal exposure, and cost gives the steering committee the information to decide, and a scoped pilot with an approved external source limits risk while testing the premise. Blanket rejection, instant approval, and deflection all skip the analysis that makes the decision defensible.

Answer

Reject the request because unapproved internet content can never be used in a Claude-based system.

Answer

Approve it immediately and connect the assistant to a general web search tool without further analysis.

Answer

Tell the director that competitor pricing is out of scope and should be handled by a separate team.

Question 17

A retail client's marketing director tells you the Claude-based product description generator is 'too slow' and wants it fixed by the end of the week. Before committing engineering effort, what should you do first?

Accepted Answer

Ask the director to define the target latency, the workflow step where it feels slow, and how many descriptions are generated per session, then measure current performance against that definition.. A vague performance complaint must be converted into measurable criteria before any engineering commitment. Asking for the target latency, the specific workflow step, and the typical session volume establishes both a baseline and an agreed success threshold. That measurement reveals whether the bottleneck is model generation, prompt size, batching, network overhead, or the surrounding application, so effort goes to the real constraint rather than a guess.

Answer

Escalate to the account executive to reset expectations, explaining that large language model latency is inherent and cannot be improved.

Answer

Agree to the deadline and immediately begin optimizing prompt length and switching to a smaller model to reduce latency.

Answer

Convert the pipeline to streaming responses so text begins appearing in the UI sooner, which will resolve the perceived slowness.

Question 18

A business unit wants to reuse your Claude-based document summarization service for a new internal use case. They ask what they must provide before you can onboard them. Which response best reflects a sustainable internal platform operating model?

Accepted Answer

They must complete a standard intake form covering use case, data classification, expected volume, latency needs, and success metrics.. A sustainable internal platform model requires a consistent intake path so demand can be assessed, prioritized, and configured safely. A standard intake form captures use case, data classification, volume, latency, and success metrics, giving the platform team the information to evaluate fit and risk. This creates comparability across business units and prevents ad hoc onboarding that leads to rework, inconsistent safeguards, and unclear ownership of outcomes.

Answer

They only need to send sample documents, and your team will infer the rest of the requirements.

Answer

They must fund a dedicated instance of the service with its own separate codebase and deployment pipeline.

Answer

They should open a support ticket whenever they are ready and the platform team will schedule a kickoff call.

Question 19

You are preparing a go-live readiness review for a Claude-powered advisory assistant used by field staff. The steering committee wants assurance that operational ownership is clear before launch. Which two artifacts are most essential to demonstrate that the lifecycle handover from project to operations is complete? (Choose two.)

Accepted Answer

A documented service ownership agreement naming the accountable team, support hours, and service level objectives.. A complete handover requires both a named owner and the operational procedures that owner will follow. The service ownership agreement establishes accountability, support hours, and service level objectives, while the signed runbook documents incident response, escalation, and maintenance. Together they give the steering committee confidence that the assistant will be sustained after the project team transitions away, rather than drifting without ownership or support coverage.

Answer

A list of all stakeholders who attended the project kickoff meeting.

Answer

A complete archive of every prompt version ever tested during development.

Answer

A slide deck summarizing the assistant's key features for the marketing team.

Question 20

Why is it recommended to use structured output (like JSON) when building LLM-based applications?

Accepted Answer

It ensures the model response is easily consumable by downstream code.. Structured output ensures that the model's response is easily parsable by downstream systems, eliminating the need for complex, error-prone regex or natural language parsing. This enables seamless integration between AI components and existing backend services, which is vital for building reliable, production-grade software. It directly improves developer productivity by reducing the amount of 'glue code' needed to handle unpredictable text formats, leading to more stable and maintainable application architectures.

Answer

It makes the model run faster than returning unstructured text.

Answer

It allows the model to compress the output into fewer tokens.

Answer

It prevents the model from generating hallucinations.