Testing Validation And Troubleshooting

A developer is using Amazon Bedrock Guardrails to filter out hate speech and violence in a chatbot application. During testing, the developer notices that some prompts containing subtle hate speech are not being blocked. The developer wants to improve the detection rate without increasing false positives on benign content. Which action should the developer take?

Which THREE of the following are valid components of an Amazon Bedrock Agent test plan?

A developer is troubleshooting a generative AI application that calls Amazon Bedrock. Intermittently, invocations fail with a ThrottlingException. CloudWatch metrics show that the account's on-demand quota for the model is being exceeded during peak hours. The developer wants to reduce throttling without changing the model or application logic. Which solution is most appropriate?

A developer is troubleshooting an Amazon Bedrock Agent that fails to complete a multi-step task. CloudWatch Logs show that the agent successfully invokes the action group's Lambda function, but the agent then replies to the user that it cannot proceed. The Lambda function returns a JSON object with a top-level key "result" instead of the key the agent expects. Which change will most likely resolve the issue?

A generative AI application deployed on AWS Lambda invokes an Amazon Bedrock model and occasionally receives a ThrottlingException with the message 'Too many requests'. The developer has already confirmed that the Lambda function's reserved concurrency is well below the account limit. The application must remain reliable without over-provisioning. Which action should the developer take to handle these throttling errors most effectively?

A developer is using Amazon Bedrock to build a customer support chatbot. The model is hallucinating frequently when retrieving internal company knowledge. Which evaluation methodology should the developer implement to quantify the ground truth accuracy of the RAG pipeline?

A developer is troubleshooting an Amazon Bedrock Agent that is frequently hitting errors. Which TWO of the following steps should be taken to isolate the issue?

A developer is creating a test suite for an LLM application. Which THREE of the following metrics are commonly used to evaluate RAG system performance?

A developer is testing a retrieval-augmented generation (RAG) application built on Amazon Bedrock Knowledge Bases. For a specific question, the model returns a confident but incorrect answer, and the retrieved chunks shown in the test console are only loosely related to the question. The developer wants to diagnose whether the retrieval step or the generation step is at fault. Which approach is most effective?

An application deployed on AWS Lambda is receiving 429 Too Many Requests errors when calling Amazon Bedrock. The developer has verified that account-level quotas have not been reached. What is the most likely cause?

A developer is validating a generative AI application that uses Amazon Bedrock. The application must produce deterministic, repeatable outputs for regression testing. Which TWO configuration changes should the developer make to achieve this? (Choose two.)

A developer is testing an Amazon Bedrock application and wants to verify that the model's responses do not contain personally identifiable information (PII) before the application displays them to users. The developer needs a managed way to detect and block PII in both prompts and responses. Which AWS feature should be used?