Courseiva

CCNA Troubleshooting Questions

9 questions · Troubleshooting topic · All types, answers revealed

1
Multi-Selecteasy

Which THREE of the following are valid components of an Amazon Bedrock Agent test plan?

Select 3 answers
A.Validating the reasoning path of the agent.
B.Verifying the S3 bucket encryption.
C.Testing the accuracy of tool invocations (Action Groups).
D.Measuring model training time.
E.Ensuring Guardrails are applied to both input and output.
AnswersA, C, E

The agent must be tested for its ability to follow instructions logically.

Why this answer

Testing reasoning, tool invocation accuracy, and safety constraints are critical components of an agent test plan.

2
Multi-Selectmedium

A developer is testing an application and finds that the model output is too verbose. Which TWO of the following parameters or techniques can help control the response length?

Select 2 answers
A.Reduce the 'max_tokens' parameter.
B.Increase the temperature.
C.Enable Guardrails to truncate output.
D.Use a different model family.
E.Update the system prompt to include 'be concise'.
AnswersA, E

This sets a hard limit on the number of generated tokens.

Why this answer

Max tokens and system instructions are the primary ways to limit verbosity.

3
MCQmedium

A developer is using Amazon Bedrock to build a customer support chatbot. The model is hallucinating frequently when retrieving internal company knowledge. Which evaluation methodology should the developer implement to quantify the ground truth accuracy of the RAG pipeline?

A.Implement a RAGAS-based evaluation pipeline to measure faithfulness and answer relevance.
B.Increase the temperature setting to 1.0 to encourage more creative responses.
C.Use Amazon CloudWatch logs to calculate the latency of every inference call.
D.Run a standard BLEU score evaluation against the model's training data.
AnswerA

RAGAS metrics are industry standard for measuring the effectiveness of the retrieval and generation components.

Why this answer

Retrieval-Augmented Generation (RAG) evaluation requires metrics like RAGAS or TruLens to measure faithfulness, answer relevance, and context precision against a golden dataset.

4
Multi-Selectmedium

A company is setting up a governance framework for AI development. Which TWO of the following tools should they use to enforce safety and compliance in Amazon Bedrock?

Select 2 answers
A.AWS Config.
B.Amazon Bedrock Model Evaluation jobs.
C.Amazon Inspector.
D.AWS Systems Manager.
E.Amazon Bedrock Guardrails.
AnswersB, E

Allows for standardized safety and compliance benchmarking.

Why this answer

Guardrails and Model Evaluation jobs are the primary tools for enforcing safety and assessing compliance.

5
Multi-Selecthard

A developer is troubleshooting an Amazon Bedrock Agent that is frequently hitting errors. Which TWO of the following steps should be taken to isolate the issue?

Select 2 answers
A.Restart the Bedrock service.
B.Increase the model's temperature to 1.0.
C.Check CloudWatch Logs for the associated Action Group Lambda functions.
D.Review the Agent's 'Trace' output to identify the failure point.
E.Re-train the underlying base model.
AnswersC, D

If the agent is failing during tool execution, the error is likely in the Lambda function code.

Why this answer

Examining the trace and checking the Lambda function logs are the standard diagnostic paths for Agent failures.

6
Multi-Selectmedium

A developer is creating a test suite for an LLM application. Which THREE of the following metrics are commonly used to evaluate RAG system performance?

Select 3 answers
A.Answer Relevance
B.Context Precision
C.Model Training Loss
D.Faithfulness
E.Inference Latency
AnswersA, B, D

Measures how relevant the answer is to the original query.

Why this answer

Faithfulness, answer relevance, and context precision are the key components of RAGAS evaluation.

7
MCQhard

An application deployed on AWS Lambda is receiving 429 Too Many Requests errors when calling Amazon Bedrock. The developer has verified that account-level quotas have not been reached. What is the most likely cause?

A.The VPC endpoint policy is blocking traffic to the Bedrock runtime service.
B.The application is exceeding the tokens-per-minute (TPM) limit for the specific model in that AWS Region.
C.The Lambda function timeout is set too low for the model response time.
D.The IAM role is missing the bedrock:InvokeModelWithResponseStream permission.
AnswerB

Each model has specific throughput limits that, when exceeded, trigger 429 errors.

Why this answer

Model-specific throughput limits or Provisioned Throughput quotas are distinct from account-level service quotas.

8
Multi-Selecthard

You are auditing an AI application for security risks. Which THREE of the following are potential threats that should be tested against the model?

Select 3 answers
A.Toxic or biased output generation.
B.Insecure API endpoint access.
C.Excessive API latency.
D.Prompt injection attacks.
E.PII data leakage in the response.
AnswersA, D, E

Ensuring the model adheres to safety policies regarding tone and content.

Why this answer

Prompt injection, PII leakage, and model output toxicity are key security concerns for LLM applications.

9
Multi-Selecteasy

Which THREE of the following are valid ways to monitor Amazon Bedrock model usage?

Select 3 answers
A.AWS CloudTrail logs.
B.Amazon CloudWatch metrics.
C.AWS X-Ray service map.
D.AWS Billing and Cost Management reports.
E.Amazon S3 bucket logging.
AnswersA, B, D

Tracks API calls and administrative actions.

Why this answer

CloudWatch metrics, AWS CloudTrail logs, and Usage billing reports are the primary ways to monitor usage.

Ready to test yourself?

Try a timed practice session using only Troubleshooting questions.