CCAR-P Practice Test 5 — 10 Questions

Question 1

A regional sales director wants the Claude assistant to answer questions about competitor pricing using 'whatever is on the internet.' You know the assistant currently uses only approved internal documents. How should you frame the trade-off for the steering committee?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Present a comparison of retrieval sources covering accuracy, freshness, legal exposure, and cost, and recommend a scoped pilot with an approved external source.. When a stakeholder asks to broaden a data source, the architect's value is in structuring the trade-off rather than issuing a verdict. A source comparison across accuracy, freshness, legal exposure, and cost gives the steering committee the information to decide, and a scoped pilot with an approved external source limits risk while testing the premise. Blanket rejection, instant approval, and deflection all skip the analysis that makes the decision defensible.

Answer

Reject the request because unapproved internet content can never be used in a Claude-based system.

Answer

Approve it immediately and connect the assistant to a general web search tool without further analysis.

Answer

Tell the director that competitor pricing is out of scope and should be handled by a separate team.

Question 2

A retail client's marketing director tells you the Claude-based product description generator is 'too slow' and wants it fixed by the end of the week. Before committing engineering effort, what should you do first?

Accepted Answer

Ask the director to define the target latency, the workflow step where it feels slow, and how many descriptions are generated per session, then measure current performance against that definition.. A vague performance complaint must be converted into measurable criteria before any engineering commitment. Asking for the target latency, the specific workflow step, and the typical session volume establishes both a baseline and an agreed success threshold. That measurement reveals whether the bottleneck is model generation, prompt size, batching, network overhead, or the surrounding application, so effort goes to the real constraint rather than a guess.

Answer

Escalate to the account executive to reset expectations, explaining that large language model latency is inherent and cannot be improved.

Answer

Agree to the deadline and immediately begin optimizing prompt length and switching to a smaller model to reduce latency.

Answer

Convert the pipeline to streaming responses so text begins appearing in the UI sooner, which will resolve the perceived slowness.

Question 3

A business unit wants to reuse your Claude-based document summarization service for a new internal use case. They ask what they must provide before you can onboard them. Which response best reflects a sustainable internal platform operating model?

Accepted Answer

They must complete a standard intake form covering use case, data classification, expected volume, latency needs, and success metrics.. A sustainable internal platform model requires a consistent intake path so demand can be assessed, prioritized, and configured safely. A standard intake form captures use case, data classification, volume, latency, and success metrics, giving the platform team the information to evaluate fit and risk. This creates comparability across business units and prevents ad hoc onboarding that leads to rework, inconsistent safeguards, and unclear ownership of outcomes.

Answer

They only need to send sample documents, and your team will infer the rest of the requirements.

Answer

They must fund a dedicated instance of the service with its own separate codebase and deployment pipeline.

Answer

They should open a support ticket whenever they are ready and the platform team will schedule a kickoff call.

Question 4

You are preparing a go-live readiness review for a Claude-powered advisory assistant used by field staff. The steering committee wants assurance that operational ownership is clear before launch. Which two artifacts are most essential to demonstrate that the lifecycle handover from project to operations is complete? (Choose two.)

Accepted Answer

A documented service ownership agreement naming the accountable team, support hours, and service level objectives.. A complete handover requires both a named owner and the operational procedures that owner will follow. The service ownership agreement establishes accountability, support hours, and service level objectives, while the signed runbook documents incident response, escalation, and maintenance. Together they give the steering committee confidence that the assistant will be sustained after the project team transitions away, rather than drifting without ownership or support coverage.

Answer

A list of all stakeholders who attended the project kickoff meeting.

Answer

A complete archive of every prompt version ever tested during development.

Answer

A slide deck summarizing the assistant's key features for the marketing team.

Question 5

Why is it recommended to use structured output (like JSON) when building LLM-based applications?

Accepted Answer

It ensures the model response is easily consumable by downstream code.. Structured output ensures that the model's response is easily parsable by downstream systems, eliminating the need for complex, error-prone regex or natural language parsing. This enables seamless integration between AI components and existing backend services, which is vital for building reliable, production-grade software. It directly improves developer productivity by reducing the amount of 'glue code' needed to handle unpredictable text formats, leading to more stable and maintainable application architectures.

Answer

It makes the model run faster than returning unstructured text.

Answer

It allows the model to compress the output into fewer tokens.

Answer

It prevents the model from generating hallucinations.

Question 6

An architect wants to improve the coherence of an agent that frequently makes 'leaps of logic' or misses obvious errors in its tool outputs. Which TWO techniques directly address this behavior?

Accepted Answer

Chain-of-Thought (CoT) in the assistant turns. Coherence in agents is improved by forcing the model to externalize its reasoning and critique its own work. Chain-of-thought encourages the model to plan before acting, while self-reflection allows it to catch and correct its own mistakes in a subsequent turn, leading to much more reliable agentic behavior.

Answer

Increasing the frequency of tool calls

Answer

Reducing the temperature to exactly 0.0

Answer

Using the 'tool_choice' parameter to force tool use

Question 7

When planning for the long-term support of an Anthropic API deployment, what is the most important stakeholder alignment activity?

Accepted Answer

Establish a roadmap for periodic model updates and performance validation.. Regular alignment on the evolving capabilities of the model and the corresponding updates to the application is critical. LLM technology evolves rapidly, and maintaining an alignment between new capabilities and the business roadmap ensures that the organization extracts maximum value over time. This keeps stakeholders engaged and ensures that the system doesn't become stagnant, providing a path for continuous improvement and innovation throughout the lifecycle of the AI integration.

Answer

Ensure that the IT budget is fixed for the next five years to prevent cost fluctuations.

Answer

Sign a lifetime contract with the current development team to avoid knowledge loss.

Answer

Focus on manual documentation of every prompt to keep the system unchanged forever.

Question 8

Your team wants to adopt a 'Configuration-as-Code' approach for LLM prompts. Which tool is most suited for managing this?

Accepted Answer

A Git-based repository integrated with a CI/CD pipeline.. Version control systems (like Git) combined with modern CI/CD pipelines are the best tools for Configuration-as-Code. By treating prompts as code, teams gain the benefits of peer reviews, version history, and automated testing, which are essential for LLM operational enablement. This approach ensures that changes to model behavior are transparent, reproducible, and easily reversible, significantly reducing the risk of production incidents and improving team collaboration on prompt engineering tasks.

Answer

A shared Excel spreadsheet on a local company server.

Answer

Directly updating the prompts in the model provider's web console.

Answer

Hardcoding the prompts in a static configuration file inside the app binary.

Question 9

What is the primary role of a 'Model Card' in the context of enterprise AI governance?

Accepted Answer

A comprehensive summary of the model's performance, limitations, and intended usage.. Model Cards are essential documentation that provides transparency into a model's intended use, limitations, performance benchmarks, and known biases. For an enterprise architect, they serve as the technical source of truth for assessing whether a model is fit for a specific business use case. This documentation is critical for risk management, ensuring that deployments are grounded in a clear understanding of the model's capabilities and boundaries.

Answer

A list of all API keys associated with the model for billing purposes.

Answer

A tool for automatically deploying the model to production environments.

Answer

A physical card used for multi-factor authentication to access the API.

Question 10

When implementing AI safety policies, which THREE components should be included to ensure effective operationalization?

Accepted Answer

Clearly defined prohibited use cases.. Operationalizing safety policy requires a combination of clear guidelines, technical enforcement, and feedback mechanisms. Without all three, policies remain abstract documents that are difficult to follow. Effective governance requires that these policies are baked into the CI/CD pipeline, audited regularly, and enforced by technical tools like guardrails, ensuring that the organization can maintain a consistent safety posture across all AI applications and development teams.

Answer

The ability to ignore rules during testing.

Answer

Complete removal of human oversight.