CCAR-P Stakeholder Communication and Lifecycle Management Practice Test 3 — 15 Questions

Question 1

Your team is deploying an application that uses PII in prompts. A stakeholder asks how you are mitigating the risk of data leakage. How do you respond?

Accepted Answer

Explain the use of PII masking and data sanitization pipelines.. The correct response involves explaining a combination of data sanitization, prompt masking, and secure infrastructure design. This is critical because PII handling is a high-liability area. By detailing a defense-in-depth strategy, the architect provides the necessary assurance that privacy is treated with the highest priority, which is vital for maintaining organizational compliance and preventing severe legal or reputational damage during the application's lifecycle.

Answer

Assure them that the model is smart enough to handle PII.

Answer

Tell them the model does not store any data anyway.

Answer

Suggest moving the project to an on-premise LLM to ensure security.

Question 2

Refer to the exhibit. Your application is hitting rate limits. A stakeholder is concerned about the user impact. What is your communication strategy?

Accepted Answer

Explain the rate limit, the automatic retry mechanism, and the scaling plan.. When hit by technical constraints, the architect must communicate the limitation, the current mitigation (retry logic), and the plan for long-term scaling. This is vital because stakeholders need to know that the system is self-healing, but also that you are actively working on increasing capacity. Clear communication prevents panic and demonstrates that the system was designed with resilience in mind, maintaining stakeholder trust during temporary service interruptions.

Answer

Tell them the service is unusable and wait for Anthropic to fix it.

Answer

Ignore the issue until the stakeholder asks about it again.

Answer

Blame the engineering team for poor code quality.

Question 3

How should an architect manage the expectations of a stakeholder who expects 100% accuracy from an AI model?

Accepted Answer

Explain the probabilistic nature and implement human-in-the-loop reviews.. Managing expectations regarding accuracy is a critical communication challenge. By explaining that LLMs are probabilistic, not deterministic, the architect aligns the stakeholder with the reality of the technology. This is vital to prevent the stakeholder from viewing non-perfect results as system failure, and instead encouraging them to design feedback loops or human-in-the-loop validation that can mitigate the inherent risks of generative AI.

Answer

Promise that future model versions will be 100% accurate.

Answer

Focus on the speed of the model to distract from accuracy issues.

Answer

Tell them to lower their standards for the project.

Question 4

Which THREE components are essential for a robust 'Stakeholder Communication Plan' during an LLM project rollout?

Accepted Answer

Defined channels for feedback and incident reporting.. A communication plan must be systematic, addressing reporting, escalation, and change management. By establishing clear channels for feedback, regular status updates, and defined procedures for handling model deviations, the architect ensures alignment. This is critical because LLM projects involve high ambiguity, and a well-structured plan prevents the team from feeling isolated or lost as the model behaves in unexpected ways during the production rollout phase.

Answer

A static, one-time document updated only at project end.

Answer

Strict secrecy policies to prevent stakeholders from knowing details.

Question 5

A stakeholder wants to change the project scope halfway through. How do you evaluate the impact?

Accepted Answer

Perform a formal impact analysis and present the trade-offs.. Managing scope creep involves a structured impact analysis, covering cost, timeline, and technical feasibility. The architect must ensure that the stakeholder understands the trade-offs of their request. This is vital for maintaining project alignment and ensuring that the team is not overloaded with un-resourced tasks that will derail the core objectives and negatively impact the quality of the final deliverable.

Answer

Accept the change immediately to keep the stakeholder happy.

Answer

Deny the request without explanation to prevent scope creep.

Answer

Work on the request secretly and surprise them later.

Question 6

A project stakeholder expresses concern that an Anthropic-powered content moderation system is generating unexpected output bias. As the lead architect, how should you communicate the resolution strategy while managing expectations?

Accepted Answer

Outline a documented evaluation process using a golden dataset to measure bias before and after applying specific safety guardrails.. Effective architect communication requires transitioning from abstract concern to empirical validation. By proposing a phased audit approach, you demonstrate technical rigor and transparency. This builds trust by confirming the issue is being treated as a high-priority architectural defect rather than a minor configuration tweak. Maintaining a clear line of communication regarding the evaluation methodology helps stakeholders understand the inherent limitations of LLMs while ensuring the mitigation path is grounded in verifiable data.

Answer

Immediately disable all moderation features until a full audit is completed.

Answer

Inform the stakeholder that LLM behavior is non-deterministic and inherent to the model.

Answer

Task the engineering team to manually review every output until the stakeholder is satisfied.

Question 7

You are leading a project involving Claude integration. Which TWO of the following steps are essential for successful stakeholder expectation management during the model evaluation phase?

Accepted Answer

Define specific, measurable KPIs related to task completion time and accuracy rates.. Managing expectations requires balancing technical transparency with business clarity. By defining clear success metrics and documenting the limitations of LLMs, you prevent misalignment between the technical performance and business outcomes. These actions ensure that stakeholders are aware of both the potential and the constraints of the system, fostering a collaborative environment where iterations can occur based on real data rather than misguided assumptions about artificial intelligence capabilities.

Answer

Promise 100% accuracy for all complex logic tasks to secure stakeholder buy-in.

Answer

Exclude non-technical stakeholders from the evaluation process to maintain focus.

Answer

Automate all stakeholder status reports to avoid any human interaction.

Question 8

A project sponsor asks for a timeline estimation for a project utilizing Claude for sentiment analysis. What is the most appropriate architectural response?

Accepted Answer

Give a broad range with a disclaimer that accuracy tuning will dictate the final go-live date.. Providing a timeline for AI projects requires acknowledging the iterative nature of model performance and data integration. By focusing on milestones rather than rigid delivery dates, you maintain flexibility while providing transparency. This approach protects the project team from unreasonable pressure and allows for the necessary R&D time required to refine prompts and safety guardrails, ultimately leading to a more successful and sustainable outcome for the stakeholders.

Answer

Provide a fixed date based on a standard waterfall project model.

Answer

State that the timeline is impossible to predict and refuse to provide any estimates.

Answer

Ask the sponsor to define the date they want and agree to it immediately.

Question 9

Your organization is transitioning from a legacy rule-based system to a Claude-based solution. A key stakeholder is worried about 'loss of control'. How do you address this during a steering committee meeting?

Accepted Answer

Propose an evaluation framework that includes both automated guardrails and a human-in-the-loop review process.. Address the fear of 'loss of control' by highlighting the architectural layers of governance available in modern AI. By explaining concepts like system prompts, output schemas, and automated evaluation frameworks, you demonstrate that control is not lost but rather evolved from static rules to dynamic, verifiable constraints. This helps stakeholders understand that modern AI architectures offer robust mechanisms for oversight, maintaining alignment with corporate compliance and quality standards.

Answer

Tell them that the model is smarter than the rules and they should trust it.

Answer

Suggest keeping the legacy system running in parallel indefinitely to avoid the issue.

Answer

Ignore the concern as it is purely emotional and not based on technical facts.

Question 10

A stakeholder wants to incorporate 'real-time' news data into your Claude-based assistant. What is the most important architectural communication point to convey?

Accepted Answer

Explain that real-time data requires an external search index and retrieval system, increasing system complexity.. Communicating the limitations of LLM knowledge cut-offs and the complexities of real-time data integration is essential for project success. By framing this as a RAG-based architectural requirement, you manage expectations regarding latency, data accuracy, and the cost of building an up-to-date retrieval pipeline. This helps the stakeholder understand that 'real-time' is not a native model feature but a complex system design requirement that warrants specific investment and architectural rigor.

Answer

Confirm that Claude has access to the internet and can browse live sites directly.

Answer

Recommend the stakeholder use a different LLM that is always up to date.

Answer

Tell the stakeholder it will take two days to implement for all news sources.

Question 11

During a project, a stakeholder requests a feature that violates your established safety guidelines. What is the most professional way to handle this?

Accepted Answer

Explain the safety implications and facilitate a session to brainstorm alternative, compliant ways to meet the underlying business need.. Handling requests that violate safety guidelines requires firm adherence to architectural principles, coupled with a collaborative approach to finding alternatives. By explaining the rationale behind the safety rules and then engaging in a discovery process for acceptable use cases, you maintain the integrity of your security posture while still helping the stakeholder achieve their underlying business objective. This demonstrates leadership and alignment with corporate compliance while avoiding unnecessary conflict.

Answer

Refuse the request immediately and do not discuss it further.

Answer

Implement the feature but add a disclaimer to the output.

Answer

Ask the stakeholder to sign a waiver accepting responsibility for the potential safety issues.

Question 12

A stakeholder asks why the AI system occasionally provides different answers to the same question. How do you explain this?

Accepted Answer

Explain that the model uses a 'temperature' parameter to balance variety and predictability, which is key to its generative nature.. Explaining the concept of model temperature and non-determinism is crucial for managing expectations about AI behavior. By framing it as a balance between creativity and consistency, you help stakeholders understand that this variability is a fundamental aspect of generative AI. This allows them to make informed decisions about whether to adjust parameters for their specific use case, ensuring they have the right tool for the job while maintaining realistic expectations about performance.

Answer

Tell them it is a bug and that the team is working on a fix for consistency.

Answer

Blame the training data for being inconsistent and poorly structured.

Answer

State that the system is broken and should be shut down until it is perfect.

Question 13

Which THREE factors should you communicate to stakeholders when planning a production rollout of a Claude-based chatbot?

Accepted Answer

The expected latency ranges for user queries and the impact on the user experience.. Successful production rollout requires managing the intersection of technical performance, cost, and user expectation. By clearly outlining latency, token costs, and the ongoing need for monitoring, you ensure stakeholders are prepared for the operational realities of the system. This transparency prevents post-launch surprises and creates a foundation for iterative improvement, where both technical and business teams work together to refine the deployment over time, leading to higher long-term success rates.

Answer

A fixed-cost budget that will never change regardless of usage.

Answer

The guarantee that the AI will never make an error or hallucinate.

Question 14

A stakeholder expresses concern about data privacy regarding the inputs sent to Claude. What is the most appropriate way to address this?

Accepted Answer

Provide documentation regarding data handling, encryption, and the Anthropic data processing agreement.. Addressing data privacy requires a formal, evidence-based approach that references established security frameworks and contractual terms. By explaining the data processing agreement and the security controls in place—such as encryption and data retention policies—you provide the stakeholder with the necessary assurance to move forward. This professional response treats privacy as a standard architectural requirement rather than an afterthought, reinforcing trust in the system's design and organizational compliance.

Answer

Tell them privacy is not an issue because all data is automatically deleted.

Answer

Suggest they talk to the legal department and wait for a response.

Answer

Ask them to sign a waiver stating they are responsible for any data leaks.

Question 15

You are managing a long-term AI project. How should you handle stakeholder communication when the underlying model architecture changes (e.g., release of a new model generation)?

Accepted Answer

Create a transition plan with a phased testing period using a sandbox environment.. Communicating major model changes requires a proactive, structured approach that highlights both benefits and potential disruptions. By framing the upgrade as a planned lifecycle event, you can manage the transition by defining testing phases, regression benchmarks, and a rollback strategy. This demonstrates professional control, reassuring stakeholders that the change is an intentional improvement rather than an unpredictable disruption to their business operations.

Answer

Update the model automatically without telling stakeholders to avoid confusion.

Answer

Recommend staying on the old model forever to avoid any potential issues.

Answer

Ask the stakeholders to choose the new model for you.