CCAR-P Practice Test 8 — 10 Questions

Question 1

You are the lead architect on a Claude-powered claims triage system that has been in production for six months. A newly appointed VP of Operations asks for a quarterly review of the system's lifecycle status. Which deliverable best satisfies this request while maintaining stakeholder alignment?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

A lifecycle status report covering adoption metrics, cost trends, incident history, model version currency, and the next-quarter roadmap.. The VP requested a lifecycle status review, which is a governance activity, not a technical artifact or a contracting action. Consolidating adoption, cost, incidents, version currency, and the roadmap into a single report gives the stakeholder the decision-ready picture they need and establishes a repeatable review cadence. Pointing to a model card, raw logs, or a statement of work extension each answers a different question than the one asked.

Answer

A raw export of the last 90 days of API request logs for the VP's team to analyze.

Answer

A revised statement of work that extends the engagement by another two quarters.

Answer

A model card update listing the current Claude model version and its evaluation benchmarks.

Question 2

A developer enablement team is building an internal prompt playground so engineers can iterate on Claude prompts without writing API code. They want the playground to reflect production behavior and avoid surprising cost overruns. (Choose two.)

Accepted Answer

Pin the playground to the same model version and system prompt that production uses, so experiments reflect real behavior.. A playground is only useful if its results predict production, so the model version and system prompt must match what ships. Cost safety comes from automated controls: per-user quotas and usage dashboards. Together these give engineers fast, trustworthy iteration without exposing the organization to unbounded spend. Unlimited keys, disabled streaming, and ticket-gated testing each fail either the parity goal or the velocity goal.

Answer

Disable streaming in the playground to reduce token consumption.

Answer

Require engineers to file a ticket for every prompt test so usage is reviewed before execution.

Answer

Give every engineer an unlimited personal API key so experimentation is never blocked.

Question 3

A developer enablement group is standing up a shared Claude integration library that dozens of internal teams will consume. They want to reduce duplicated work and prevent each team from re-implementing fragile request handling. Which TWO practices best improve developer productivity across those consuming teams? (Choose two.)

Accepted Answer

Publish a typed client library that encapsulates authentication, retries, and error normalization behind a small, stable interface.. A typed client library with a small stable interface centralizes fragile request handling so teams do not each reinvent retries and error normalization. Runnable examples and integration tests lower the cost of adoption and document the recommended patterns. Together these reduce duplicated work and support questions, which is exactly what a developer enablement group is trying to achieve.

Answer

Give every team direct access to the raw HTTP layer and encourage them to call the API without the shared library.

Answer

Keep the client API undocumented so teams are forced to read the source code and understand every internal detail.

Answer

Require every consuming team to write its own request wrapper so each can tune retries to its own latency profile.

Question 4

A developer is building a tool that lets engineers query an internal knowledge base through Claude. During testing, Claude sometimes invents plausible but nonexistent document titles when the retrieved context is thin. The team wants a systematic way to detect and reduce these hallucinations before the tool reaches general availability. Which approach is most appropriate?

Accepted Answer

Build an evaluation set of questions with known ground-truth answers, score responses for faithfulness to the retrieved context, and iterate on retrieval and prompting until scores meet a defined threshold.. Hallucinated titles are a grounding failure, so the fix is to measure faithfulness against retrieved context and improve retrieval and prompting where scores fall short. A labeled evaluation set with ground-truth answers makes the problem quantifiable, and a release threshold converts that measurement into a defensible go or no-go decision.

Answer

Add an instruction telling the model to be accurate and never hallucinate, then rely on that instruction in production.

Answer

Raise the temperature setting so responses become more varied and the model is less likely to repeat a fabricated title.

Answer

Switch the knowledge base queries to return a fixed number of documents regardless of relevance, so the model always has something to cite.

Question 5

A fintech company wants to use Claude to generate personalized financial advice for retail customers. The compliance team mandates that all AI-generated advice must be traceable to a specific model version and configuration for audit purposes. Which governance control best satisfies this requirement?

Accepted Answer

Enable logging of all API requests and responses with model version and configuration metadata.. The correct control is logging API requests and responses with model version and configuration metadata. This creates a detailed audit trail that links each output to the exact model version and settings used, enabling full traceability. Other options improve security or oversight but fail to provide the required technical record for auditing AI-generated financial advice.

Answer

Implement a human review step where a compliance officer approves each piece of advice before it is sent.

Answer

Restrict API access to a whitelist of IP addresses and require multi-factor authentication.

Answer

Use a single, static prompt template that never changes and is stored in version control.

Question 6

A developer support team receives repeated reports that Claude responses in an internal tool are truncated mid-sentence. Logs show the stop_reason value is max_tokens on most affected calls. Which change most directly resolves the truncation while preserving response quality?

Accepted Answer

Increase the max_tokens parameter on the affected requests and verify the model's context window can accommodate input plus output.. The stop_reason value is the authoritative signal: max_tokens means the output ceiling, not the model, ended the response. Raising max_tokens lets the model finish, and checking that input plus output fit the context window prevents a new failure mode. Sampling settings, prompt wording, and streaming do not change how many tokens the model may emit, so they cannot resolve this truncation.

Answer

Set temperature to zero so the model produces shorter, more deterministic completions.

Answer

Enable streaming so partial responses are delivered before the token limit is reached.

Answer

Add a system prompt instruction telling the model to always finish its sentences.

Question 7

A team is building an agent that must call a payment provider's API. The API requires an idempotency key on every charge request, and the agent may retry a charge if a network error occurs mid-call. Which design correctly preserves financial correctness when retries happen?

Accepted Answer

Derive the idempotency key deterministically from the logical charge (for example, a hash of order ID and amount) and reuse that same key across all retries of that charge.. The idempotency key is the provider's contract for recognizing repeated attempts as one logical charge. Deriving it deterministically from stable charge attributes means every retry, even after a process restart or agent replan, presents the same key, so the provider returns the original outcome instead of charging again. This preserves correctness under at-least-once retry semantics without sacrificing resilience.

Answer

Generate a fresh idempotency key for each retry attempt so the provider can distinguish a retry from a genuinely new charge.

Answer

Disable automatic retries for charge calls and surface every network error to a human operator for manual reconciliation.

Answer

Omit the idempotency key and instead check the account balance before each retry to see whether the charge already landed.

Question 8

A platform team is standardizing how internal teams integrate Claude. Leadership wants faster onboarding, fewer production incidents, and clear accountability for cost. Which TWO practices best support these goals? (Choose two.)

Accepted Answer

Publish a golden-path reference implementation with sample prompts, error handling, and a checklist for going to production.. A golden-path reference implementation accelerates onboarding and reduces incidents by giving teams proven patterns, while per-service tagging with a shared usage dashboard makes cost attributable and accountable. Freezing model versions, allowing full tooling autonomy, and centralizing one shared key each work against at least one of the stated goals, so they are not the right practices here.

Answer

Route all Claude traffic through a single shared API key managed by the platform team to simplify billing.

Answer

Let each team choose its own SDK, logging format, and retry strategy to maximize autonomy.

Answer

Mandate that all teams use the same model version and freeze upgrades for a year to reduce variability.

Question 9

A software company's internal AI review board is defining escalation criteria for its Claude-powered support assistant. The board wants a rule that reliably routes the highest-consequence cases to human specialists rather than relying on the model's own confidence statements. Which escalation design best achieves this?

Accepted Answer

Route cases to specialists based on objective risk signals such as account tier, regulatory keywords, and prior complaint history.. Reliable escalation must be driven by signals that exist independently of the model's self-assessment. Objective criteria such as account tier, regulatory keywords, and complaint history correlate directly with consequence and can be evaluated deterministically, guaranteeing that the cases the board cares most about reach a specialist before a reply is finalized.

Answer

Ask the assistant to flag any conversation it finds ambiguous and forward those to specialists for a second opinion.

Answer

Instruct the assistant to state a confidence percentage with each answer and escalate whenever it reports below ninety percent.

Answer

Sample five percent of all conversations at random for specialist review after the assistant has already replied.

Question 10

You are the lead architect on a Claude-powered claims triage system that has been in production for six months. A newly appointed VP of Operations asks for a quarterly review of the system's lifecycle status. Which deliverable best satisfies this request while maintaining stakeholder alignment?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

A data-flow and retention attestation that maps contract text through the Claude API, documents Anthropic's zero-data-retention configuration, and confirms the EU-only processing region.. The stakeholder needs verifiable evidence about two distinct properties: retention behaviour and processing location. Only a data-flow and retention attestation both traces the path of contract text through the Claude API and records the concrete configuration choices, such as zero-data-retention and EU-region processing, that make the assurance true. Schedule changes, redaction habits, and risk logs are adjacent activities that do not answer the question.

Answer

A prompt-engineering guideline telling analysts to strip client names from contract text before submitting it.

Answer

An updated project charter that adds a legal-review milestone to the schedule before the go-live date.

Answer

A risk-register entry logging 'data residency uncertainty' with a medium severity rating and an owner.