1Z0-1127 Using OCI Generative AI Service Practice Test 2 — 15 Questions

Question 1

A developer is using OCI Generative AI Service to generate product descriptions. The outputs are often too generic and lack brand-specific tone. The developer has a small set of 20 high-quality example descriptions. What is the most efficient approach to improve output quality?

Accepted Answer

Use few-shot prompting by including the 20 examples in the prompt.. Option B is correct because few-shot prompting is the most efficient approach when you have a small set of high-quality examples (20 in this case). It allows the model to infer the desired tone and style directly from the provided examples without requiring any training or fine-tuning, which would be inefficient and potentially ineffective with such a small dataset. In OCI Generative AI Service, few-shot prompting leverages the model's in-context learning capability to adapt its output to the brand-specific tone.

Answer

Fine-tune a base model on the 20 examples.

Answer

Use a more detailed system prompt describing the brand tone.

Answer

Use chain-of-thought prompting to guide the model step by step.

Question 2

A team is using OCI Generative AI Agents to build a customer support bot. The bot sometimes generates answers that contradict the knowledge base. What is the most likely cause?

Accepted Answer

The chunking strategy for the knowledge base does not capture enough context overlap.. Option A is correct because when the chunking strategy lacks sufficient context overlap, the retrieved chunks may omit critical surrounding information, causing the generative AI model to infer missing details incorrectly and produce answers that contradict the knowledge base. In OCI Generative AI Agents, the chunking strategy determines how documents are split into smaller pieces for retrieval; without adequate overlap, the model loses the semantic continuity needed to stay faithful to the source material.

Answer

The max tokens value is too low, truncating the response.

Answer

The temperature parameter is set too high, causing the model to hallucinate.

Answer

The model's repetition penalty is too high.

Question 3

A company is deploying a multi-language chatbot using OCI Generative AI Service. The chatbot must support English, Spanish, and French. The team finds that responses in Spanish are less accurate than in English. They have a small bilingual dataset. What is the best approach?

Accepted Answer

Use a multilingual base model (e.g., mT5) and fine-tune on the bilingual dataset (English and Spanish) using cross-lingual transfer learning.. Option A is correct because fine-tuning a multilingual base model like mT5 on a small bilingual dataset leverages cross-lingual transfer learning, where knowledge from high-resource languages (English) improves performance on low-resource languages (Spanish). This approach is specifically designed for scenarios with limited data and directly addresses the accuracy gap without requiring separate models or translation pipelines.

Answer

Use prompt engineering with language-specific instructions in the system prompt.

Answer

Translate all user queries to English, process them, then translate responses back.

Answer

Train separate fine-tuned models for each language.

Question 4

Which TWO measures can help reduce the risk of generating toxic or unsafe content when using OCI Generative AI Service?

Accepted Answer

Use few-shot prompting with examples that demonstrate safe and appropriate responses.. Few-shot prompting provides the model with explicit examples of safe, appropriate responses, which helps steer the model's behavior toward desired outputs and reduces the likelihood of generating toxic or unsafe content. This technique leverages in-context learning to align the model's responses with the provided examples, making it a practical measure for content safety.

Answer

Disable model monitoring and logging to reduce overhead.

Answer

Increase the temperature parameter to make output more deterministic.

Answer

Fine-tune the model on a large dataset without any safety filtering.

Question 5

Which THREE factors are important when designing a multi-turn conversational agent using OCI Generative AI Agents?

Accepted Answer

Manage the context window size to avoid truncating important earlier messages.. Managing the context window size is critical because OCI Generative AI Agents have a fixed token limit for the conversation history. If the context window is exceeded, the agent truncates the oldest messages, which can remove essential context from earlier turns, leading to incoherent or incorrect responses. Proper management ensures that the most relevant history is retained without exceeding the model's maximum input length.

Answer

Always generate the longest possible response to be thorough.

Answer

Disable logging to reduce latency and cost.

Question 6

A financial services company deployed a fine-tuned model using OCI Generative AI Service to generate investment advice based on quarterly reports. The model was trained on 10,000 labeled examples and achieved high accuracy in testing. However, after three months in production, the model's outputs have become inconsistent and sometimes recommend investments based on outdated market conditions. The team has received multiple complaints from users about inaccurate advice. The model is deployed on a dedicated AI cluster with auto-scaling disabled. The OCI audit logs show no configuration changes. The team suspects data drift and wants to mitigate it without incurring high costs. They have a pipeline that can collect new labeled data monthly, but it takes two weeks to process. What should the team do?

Accepted Answer

Set up a monthly retraining schedule using the new labeled data as soon as it is available, and use a champion/challenger deployment to validate the new model before full rollout.. Option A is correct because it directly addresses data drift by establishing a regular retraining cycle with the new labeled data, which is the standard mitigation strategy for model degradation over time. The champion/challenger deployment pattern allows the team to validate the updated model's performance against the current production model before full rollout, ensuring no regression in accuracy. This approach balances cost efficiency (monthly retraining) with the operational constraint of a two-week data processing pipeline.

Answer

Decrease the temperature parameter to 0.1 to make outputs more deterministic.

Answer

Revert to the base model (Cohere Command) and use few-shot prompting with recent reports.

Answer

Enable auto-scaling on the dedicated AI cluster to handle increased load.

Question 7

A retail company uses OCI Generative AI Agents to power a product recommendation chatbot on their e-commerce website. The chatbot is integrated with a knowledge base containing product descriptions, customer reviews, and inventory data. Recently, the chatbot has started recommending out-of-stock products frequently, leading to customer frustration. The development team verified that the knowledge base is updated in real-time with inventory data. The chatbot's configuration uses a chunking strategy with a chunk size of 500 tokens and an overlap of 50 tokens. The team suspects the issue is related to how the agent retrieves information. They have access to OCI Logging and Monitoring. Which course of action should the team take first?

Accepted Answer

Increase the chunk overlap from 50 to 150 tokens to ensure inventory status is captured in multiple chunks.. The core issue is that the chatbot retrieves chunks that contain product descriptions but may miss the inventory status because the chunking strategy does not reliably include both pieces of information together. Increasing the chunk overlap from 50 to 150 tokens ensures that inventory data, which may be at the boundary of a chunk, is captured in multiple overlapping chunks, thereby increasing the likelihood that the retrieval step returns a chunk containing both the product and its current stock level. This directly addresses the retrieval gap without altering model behavior or infrastructure.

Answer

Decrease the chunk size to 250 tokens to make chunks more specific.

Answer

Reduce the temperature parameter of the model to 0.2 to reduce hallucinations.

Answer

Enable auto-scaling on the AI cluster to improve response speed.

Question 8

You are a cloud architect at a healthcare company that uses OCI Generative AI Service to analyze patient records and generate clinical summaries. The service is deployed in the Frankfurt region with a dedicated AI cluster. Recently, the compliance team flagged that some generated summaries contain hallucinated diagnoses not present in the source records. They demand immediate mitigation. The current setup uses the default model (cohere.command-r-08-2024) with temperature=0.7, top_p=0.9, and max_tokens=2048. The application sends the entire patient record as a single prompt. You have access to OCI Logging, monitoring metrics (latency, request count, token count, safety filter rejections), and the AI service's model fine-tuning capability. You must reduce hallucinations while minimizing latency increase. What is the most effective course of action?

Accepted Answer

Reduce temperature to 0.2, top_p to 0.5, and fine-tune the model on a curated dataset of 5,000 clinical summaries with a learning rate of 0.00005 and batch size of 8.. Option D is correct because reducing temperature and top_p makes the model more deterministic, reducing randomness and thus hallucinations. Fine-tuning on curated clinical data with a lower learning rate and smaller batch size aligns the model to the domain without excessive training. Option A might reduce hallucinations but increases latency and token cost. Option B only adds a safety filter, which does not address factual accuracy. Option C may change style but not reduce hallucinations.

Answer

Switch to cohere.command-light model for faster inference and add a post-processing step using a BERT-based NER model to validate entities.

Answer

Increase max_tokens to 4096 and use chunked processing with overlapping context windows to provide more context.

Answer

Enable the safety filter with strict content moderation and set up OCI Logging to audit all generations.

Question 9

A developer wants to use the OCI Generative AI service to generate text using a Cohere model. Which SDK class should be used for inference calls?

Accepted Answer

GenerativeAiInferenceClient. Option B is correct because the GenerativeAiInferenceClient is the dedicated client for inference operations in the OCI Python SDK. Option A is incorrect because GenerativeAiClient is for managing models and endpoints, not inference. Option C is incorrect because it's a generic term. Option D is incorrect because it's for managing custom models.

Answer

CustomModelClient

Answer

AiInferenceClient

Answer

GenerativeAiClient

Question 10

A user has attached an IAM policy granting access to the generative-ai-family resource type, but API calls to the Generative AI service return a 403 Forbidden error. What is the most likely cause?

Accepted Answer

The policy does not specify the correct compartment or resource.. Option C is correct because OCI Generative AI resources are compartment-scoped, and if the policy does not specify the correct compartment, access is denied. Option A is incorrect because the policy allows the resource type. Option B is incorrect because Dedicated AI Cluster is not a prerequisite for managed inference. Option D is incorrect because the policy already includes the service.

Answer

The service is not enabled in the tenancy.

Answer

The policy does not include the 'use' verb for the resource type.

Answer

The user has not created a Dedicated AI Cluster.

Question 11

A company is building a customer support chatbot that uses Retrieval-Augmented Generation (RAG) with OCI Generative AI. They need low-latency responses and the ability to update the knowledge base daily. Which architecture best meets these requirements?

Accepted Answer

Use OCI Search with OpenSearch for the vector database, OCI Generative AI for inference, and Oracle Database for metadata.. Option A is correct because it integrates OCI Search with OpenSearch for low-latency vector search and updates, OCI Generative AI for inference, and Oracle Database for metadata. Option B is incorrect because Functions without a database may not scale well for indexing. Option C is incorrect because using object storage directly for retrieval would be slow. Option D is incorrect because Data Science notebooks are not suitable for production inference.

Answer

Store embeddings in OCI Object Storage and use OCI Functions to perform similarity search.

Answer

Use OCI Data Science Notebook Sessions to run the RAG pipeline with a managed Cohere model.

Answer

Use OCI Streaming to ingest documents and OCI Data Flow to update a knowledge base in OCI Object Storage.

Question 12

Which model family is NOT currently available in OCI Generative AI service?

Accepted Answer

OpenAI GPT-4. OpenAI GPT-4 is not available in OCI Generative AI service because OCI's native generative AI offerings are built on open-source and partner models like Meta Llama, Anthropic Claude, and Cohere, but not on OpenAI's proprietary models. OCI Generative AI service provides access to models hosted on OCI, and OpenAI GPT-4 is only accessible via Azure OpenAI Service or direct OpenAI API, not through OCI's managed service.

Answer

Meta Llama

Answer

Anthropic Claude

Answer

Cohere

Question 13

After fine-tuning a Cohere Command model on a dataset of customer emails, the model performs well on validation data but poorly on new, unseen emails. Which action is most likely to improve generalization?

Accepted Answer

Expand the training dataset with more diverse examples.. Option B is correct because using a diverse and representative dataset helps the model generalize to unseen examples. Option A is incorrect because increasing epochs risks overfitting. Option C is incorrect because a smaller model may have lower capacity. Option D is incorrect because reducing the number of fine-tuning layers may harm adaptation.

Answer

Increase the number of fine-tuning epochs.

Answer

Reduce the number of layers being fine-tuned.

Answer

Switch to a smaller model variant such as Cohere Light.

Question 14

A multinational corporation plans to deploy OCI Generative AI in multiple OCI regions for disaster recovery. They have fine-tuned a custom model in the primary region. What is the recommended approach to make the fine-tuned model available in the secondary region with minimal manual effort?

Accepted Answer

Copy the model artifact to the secondary region's object storage bucket and create a new dedicated endpoint there.. Option D is correct because fine-tuned models are stored in object storage; replicating the bucket and using custom automation to recreate the dedicated endpoint ensures availability. Option A is incorrect because there is no automatic cross-region replication for models. Option B is incorrect because redeploying from scratch is time-consuming. Option C is incorrect because manual policy changes are not the main issue.

Answer

Create an IAM policy to allow cross-region access to the model from the secondary region.

Answer

Use OCI Cross-Region Replication for the model's underlying object storage bucket and the dedicated AI cluster.

Answer

Redeploy the fine-tuning job in the secondary region using the same training data.

Question 15

When using OCI Generative AI with a fine-tuned model, what is the primary benefit of creating a dedicated AI cluster?

Accepted Answer

Consistent low latency and high throughput for production workloads.. Option A is correct because a dedicated cluster provides guaranteed throughput and low latency. Option B is incorrect because it does not affect cost per token directly. Option C is incorrect because capacity is managed by the service. Option D is incorrect because security is not inherently better with a dedicated cluster.

Answer

Automatic scaling based on demand.

Answer

Reduced cost per inference token compared to on-demand.

Answer

Enhanced security through network isolation from other tenants.