1Z0-1127-25 Using OCI Generative AI Service Practice Test 5 — 15 Questions

Question 1

A startup is building a chatbot for customer support using OCI Generative AI Service. The chatbot needs to answer queries about product features based on a knowledge base of product documentation. Which configuration is most appropriate for this use case?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Use a Cohere Command model with the knowledge base as context in a prompt, and enable retrieval-augmented generation (RAG) via OCI Generative AI Agents.. OCI Generative AI Agents with retrieval-augmented generation (RAG) allows the chatbot to dynamically retrieve relevant chunks from the product documentation knowledge base and inject them as context into a Cohere Command model prompt. This approach ensures answers are grounded in the latest documentation without requiring fine-tuning, and it scales efficiently as the knowledge base grows.

Answer

Use the Summarization task type to generate concise answers from the documentation.

Answer

Fine-tune a Llama 2 70B model on the product documentation to create a custom model.

Answer

Use the Code Generation model to produce SQL queries that retrieve answers from a database.

Question 2

An enterprise deployed a custom fine-tuned model for generating financial reports. After the first month, the model's outputs began to include outdated information and occasional factual errors. The team suspects data drift. What is the best course of action?

Accepted Answer

Retrain the model on the latest financial data and monitor for drift.. Data drift occurs when the input data distribution changes over time, causing the model's outputs to become outdated or inaccurate. Retraining the model on the latest financial data realigns it with the current data distribution, and ongoing monitoring helps detect future drift. Option A is incorrect because switching to a newer base model like Llama 3.1 without retraining does not incorporate the latest financial data and may not address domain-specific drift. Option B is incorrect because decreasing the temperature parameter reduces randomness in outputs but does not correct factual errors stemming from data drift. Option D is incorrect because increasing the max tokens value only allows longer responses and does not improve accuracy or address drift.

Answer

Switch to a newer base model like Llama 3.1 without retraining.

Answer

Decrease the temperature parameter to 0.1 to reduce model creativity.

Answer

Increase the max tokens value to allow longer responses.

Question 3

A healthcare company is deploying OCI Generative AI Service for clinical decision support. They must ensure that model outputs are auditable, explainable, and free from patient data exposure. Which combination of OCI features should they use?

Accepted Answer

Use OCI Data Masking to de-identify inputs, and enable model monitoring with explainability outputs via OCI Monitoring and OCI Logging.. OCI Data Masking can de-identify patient data in inputs before they reach the generative AI model, ensuring no protected health information (PHI) is exposed. Enabling model monitoring with explainability outputs via OCI Monitoring and OCI Logging provides an auditable trail of model decisions and explanations, meeting the requirements for auditability and explainability in clinical decision support.

Answer

Fine-tune a model on de-identified patient notes and use default inference settings.

Answer

Use Retrieval-Augmented Generation with an internet search index for up-to-date medical knowledge.

Answer

Deploy the model in a private endpoint and disable all logging to prevent data leaks.

Question 4

A developer is using OCI Generative AI Service to generate product descriptions. The outputs are often too generic and lack brand-specific tone. The developer has a small set of 20 high-quality example descriptions. What is the most efficient approach to improve output quality?

Accepted Answer

Use few-shot prompting by including the 20 examples in the prompt.. Few-shot prompting is the most efficient approach when you have a small set of high-quality examples (20 in this case). It allows the model to infer the desired tone and style directly from the provided examples without requiring any training or fine-tuning, which would be inefficient and potentially ineffective with such a small dataset. In OCI Generative AI Service, few-shot prompting leverages the model's in-context learning capability to adapt its output to the brand-specific tone.

Answer

Fine-tune a base model on the 20 examples.

Answer

Use a more detailed system prompt describing the brand tone.

Answer

Use chain-of-thought prompting to guide the model step by step.

Question 5

A team is using OCI Generative AI Agents to build a customer support bot. The bot sometimes generates answers that contradict the knowledge base. What is the most likely cause?

Accepted Answer

The chunking strategy for the knowledge base does not capture enough context overlap.. When the chunking strategy lacks sufficient context overlap, the retrieved chunks may omit critical surrounding information, causing the generative AI model to infer missing details incorrectly and produce answers that contradict the knowledge base. In OCI Generative AI Agents, the chunking strategy determines how documents are split into smaller pieces for retrieval; without adequate overlap, the model loses the semantic continuity needed to stay faithful to the source material.

Answer

The max tokens value is too low, truncating the response.

Answer

The temperature parameter is set too high, causing the model to hallucinate.

Answer

The model's repetition penalty is too high.

Question 6

A company is deploying a multi-language chatbot using OCI Generative AI Service. The chatbot must support English, Spanish, and French. The team finds that responses in Spanish are less accurate than in English. They have a small bilingual dataset. What is the best approach?

Accepted Answer

Use a multilingual base model (e.g., mT5) and fine-tune on the bilingual dataset (English and Spanish) using cross-lingual transfer learning.. Fine-tuning a multilingual base model like mT5 on a small bilingual dataset leverages cross-lingual transfer learning, where knowledge from high-resource languages (English) improves performance on low-resource languages (Spanish). This approach is specifically designed for scenarios with limited data and directly addresses the accuracy gap without requiring separate models or translation pipelines.

Answer

Use prompt engineering with language-specific instructions in the system prompt.

Answer

Translate all user queries to English, process them, then translate responses back.

Answer

Train separate fine-tuned models for each language.

Question 7

Which TWO measures can help reduce the risk of generating toxic or unsafe content when using OCI Generative AI Service?

Accepted Answer

Use few-shot prompting with examples that demonstrate safe and appropriate responses.. Few-shot prompting provides the model with explicit examples of safe, appropriate responses, which helps steer the model's behavior toward desired outputs and reduces the likelihood of generating toxic or unsafe content. This technique leverages in-context learning to align the model's responses with the provided examples, making it a practical measure for content safety.

Answer

Disable model monitoring and logging to reduce overhead.

Answer

Increase the temperature parameter to make output more deterministic.

Answer

Fine-tune the model on a large dataset without any safety filtering.

Question 8

Which THREE factors are important when designing a multi-turn conversational agent using OCI Generative AI Agents?

Accepted Answer

Manage the context window size to avoid truncating important earlier messages.. Managing the context window size is critical because OCI Generative AI Agents have a fixed token limit for the conversation history. If the context window is exceeded, the agent truncates the oldest messages, which can remove essential context from earlier turns, leading to incoherent or incorrect responses. Proper management ensures that the most relevant history is retained without exceeding the model's maximum input length.

Answer

Always generate the longest possible response to be thorough.

Answer

Disable logging to reduce latency and cost.

Question 9

A financial services company deployed a fine-tuned model using OCI Generative AI Service to generate investment advice based on quarterly reports. The model was trained on 10,000 labeled examples and achieved high accuracy in testing. However, after three months in production, the model's outputs have become inconsistent and sometimes recommend investments based on outdated market conditions. The team has received multiple complaints from users about inaccurate advice. The model is deployed on a dedicated AI cluster with auto-scaling disabled. The OCI audit logs show no configuration changes. The team suspects data drift and wants to mitigate it without incurring high costs. They have a pipeline that can collect new labeled data monthly, but it takes two weeks to process. What should the team do?

Accepted Answer

Set up a monthly retraining schedule using the new labeled data as soon as it is available, and use a champion/challenger deployment to validate the new model before full rollout.. It directly addresses data drift by establishing a regular retraining cycle with the new labeled data, which is the standard mitigation strategy for model degradation over time. The champion/challenger deployment pattern allows the team to validate the updated model's performance against the current production model before full rollout, ensuring no regression in accuracy. This approach balances cost efficiency (monthly retraining) with the operational constraint of a two-week data processing pipeline.

Answer

Decrease the temperature parameter to 0.1 to make outputs more deterministic.

Answer

Revert to the base model (Cohere Command) and use few-shot prompting with recent reports.

Answer

Enable auto-scaling on the dedicated AI cluster to handle increased load.

Question 10

A retail company uses OCI Generative AI Agents to power a product recommendation chatbot on their e-commerce website. The chatbot is integrated with a knowledge base containing product descriptions, customer reviews, and inventory data. Recently, the chatbot has started recommending out-of-stock products frequently, leading to customer frustration. The development team verified that the knowledge base is updated in real-time with inventory data. The chatbot's configuration uses a chunking strategy with a chunk size of 500 tokens and an overlap of 50 tokens. The team suspects the issue is related to how the agent retrieves information. They have access to OCI Logging and Monitoring. Which course of action should the team take first?

Accepted Answer

Increase the chunk overlap from 50 to 150 tokens to ensure inventory status is captured in multiple chunks.. The core issue is that the chatbot retrieves chunks that contain product descriptions but may miss the inventory status because the chunking strategy does not reliably include both pieces of information together. Increasing the chunk overlap from 50 to 150 tokens ensures that inventory data, which may be at the boundary of a chunk, is captured in multiple overlapping chunks, thereby increasing the likelihood that the retrieval step returns a chunk containing both the product and its current stock level. This directly addresses the retrieval gap without altering model behavior or infrastructure.

Answer

Decrease the chunk size to 250 tokens to make chunks more specific.

Answer

Reduce the temperature parameter of the model to 0.2 to reduce hallucinations.

Answer

Enable auto-scaling on the AI cluster to improve response speed.

Question 11

A company is building a customer support chatbot that uses Retrieval-Augmented Generation (RAG) with OCI Generative AI. They need low-latency responses and the ability to update the knowledge base daily. Which architecture best meets these requirements?

Accepted Answer

Use OCI Search with OpenSearch for the vector database, OCI Generative AI for inference, and Oracle Database for metadata.. It combines OCI Search with OpenSearch as a vector database for efficient similarity search, OCI Generative AI for inference, and Oracle Database for metadata management. This architecture provides low-latency responses by leveraging OpenSearch's optimized vector indexing and allows daily knowledge base updates through Oracle Database's robust data management capabilities.

Answer

Store embeddings in OCI Object Storage and use OCI Functions to perform similarity search.

Answer

Use OCI Data Science Notebook Sessions to run the RAG pipeline with a managed Cohere model.

Answer

Use OCI Streaming to ingest documents and OCI Data Flow to update a knowledge base in OCI Object Storage.

Question 12

Which model family is NOT currently available in OCI Generative AI service?

Accepted Answer

OpenAI GPT-4. OpenAI GPT-4 is not available in OCI Generative AI service because OCI's native generative AI offerings are built on open-source and partner models like Meta Llama, Anthropic Claude, and Cohere, but not on OpenAI's proprietary models. OCI Generative AI service provides access to models hosted on OCI, and OpenAI GPT-4 is only accessible via Azure OpenAI Service or direct OpenAI API, not through OCI's managed service.

Answer

Meta Llama

Answer

Anthropic Claude

Answer

Cohere

Question 13

A multinational corporation plans to deploy OCI Generative AI in multiple OCI regions for disaster recovery. They have fine-tuned a custom model in the primary region. What is the recommended approach to make the fine-tuned model available in the secondary region with minimal manual effort?

Accepted Answer

Copy the model artifact to the secondary region's object storage bucket and create a new dedicated endpoint there.. The recommended approach to make a fine-tuned custom model available in a secondary OCI region with minimal manual effort is to copy the model artifact (the trained weights and configuration files) to the secondary region's object storage bucket and then create a new dedicated endpoint there. This avoids re-running the expensive fine-tuning job and leverages OCI's object storage cross-region copy capabilities, while the dedicated AI cluster in the secondary region can serve the model directly from the copied artifact.

Answer

Create an IAM policy to allow cross-region access to the model from the secondary region.

Answer

Use OCI Cross-Region Replication for the model's underlying object storage bucket and the dedicated AI cluster.

Answer

Redeploy the fine-tuning job in the secondary region using the same training data.

Question 14

A data scientist receives an error when calling the embed_text API: "InvalidRequest: input too long". What is the most likely cause and solution?

Accepted Answer

The input text exceeds the maximum token limit for the model; truncate the input.. The error 'InvalidRequest: input too long' indicates that the input text exceeds the maximum token limit for the embedding model. OCI Generative AI embedding models, like all transformer-based models, have a fixed context window (e.g., 512 or 1024 tokens). The solution is to truncate the input to fit within that limit, as the API will reject overly long inputs.

Answer

The model specified is not supported for embeddings; use a different model.

Answer

The API request rate exceeds the tenancy limit; reduce the request rate.

Answer

The API key is invalid or expired; regenerate the key.

Question 15

Which TWO deployment options are available for using fine-tuned models with OCI Generative AI service?

Accepted Answer

On-Demand Endpoint. The OCI Generative AI service provides two deployment options for fine-tuned models: On-Demand Endpoint and Managed Dedicated Endpoint. The On-Demand Endpoint (Option C) is a serverless, pay-per-token option that automatically scales, suitable for variable workloads. The Managed Dedicated Endpoint (Option E) provides a dedicated, single-tenant endpoint with guaranteed throughput and lower latency for production workloads.

Answer

Bring Your Own Container (BYOC)

Answer

Serverless Endpoint

Answer

Edge Deployment