1Z0-1127 Practice Test 36 — 15 Questions

Question 1

You are a data scientist at a legal firm. The firm uses OCR to digitize court documents and then indexes them in OCI OpenSearch for a RAG application. The application uses OCI Generative AI Service (Cohere Command) to answer questions about case law. Recently, the team noticed that the answers are often factually incorrect or include information not present in the retrieved documents. After reviewing the pipeline, you find that the chunking strategy splits documents into 512-token chunks with 128-token overlap. The embedding model is Cohere Embed v3 (English), and the retrieval returns the top 5 chunks. The LLM has a context window of 4096 tokens. The team suspects that the chunking strategy is causing loss of context. What is the best course of action to improve answer accuracy?

Accepted Answer

Increase the chunk size to 1024 tokens and overlap to 256 tokens.. Increasing the chunk size to 1024 tokens and overlap to 256 tokens directly addresses the loss of context by ensuring each chunk contains more complete semantic units (e.g., entire paragraphs or legal arguments) while the larger overlap preserves continuity across chunk boundaries. This improves the quality of the embeddings and the relevance of retrieved chunks, leading to more factually accurate answers from the LLM.

Answer

Reduce the chunk overlap to 64 tokens to avoid redundancy.

Answer

Switch to a smaller LLM with a larger context window.

Answer

Increase the number of retrieved chunks from 5 to 10.

Question 2

A healthcare company is building a RAG-based chatbot to answer patient queries using medical documents stored in OCI Object Storage. They use OCI Generative AI service with Cohere Command R+ model and OCI OpenSearch as the vector database. The chatbot is deployed on OCI Compute with a Flask application. After deployment, the latency for each query is 15-20 seconds, which is unacceptable. Logs show that the embedding generation step (using OCI Generative AI embedding API) takes 8-10 seconds, and the vector search in OpenSearch takes 5-7 seconds. The team has already enabled connection pooling and increased the compute instance shape to the maximum allowed. Which action would MOST effectively reduce the overall latency?

Accepted Answer

Pre-generate embeddings for all documents during ingestion and store them in the vector database, so at query time only the query embedding is generated and compared.. The primary bottleneck is the embedding generation step (8-10 seconds). By pre-generating embeddings for all documents during ingestion and storing them in the vector database, the query-time embedding generation is eliminated, reducing the per-query latency to only the time needed to generate the query embedding and perform the vector search. This directly addresses the largest contributor to the 15-20 second latency.

Answer

Implement a caching layer with Redis to store previous query results and serve cached responses for identical queries.

Answer

Reindex the OpenSearch vector index with optimal settings (e.g., HNSW algorithm, ef_search param) to speed up vector search.

Answer

Switch to a faster embedding model like Cohere Embed v3 (English) which has lower latency.

Question 3

A generative AI model deployed on OCI Model Deployment is experiencing high tail latency. The model is a large language model that processes variable-length input sequences. Profiling shows that inference time varies significantly: short inputs (100 tokens) take 100ms, while long inputs (2000 tokens) take 2 seconds. The application requires consistent low latency (<500ms) for most requests. You want to reduce the variance in inference time without major changes to the model architecture. Which technique should you apply?

Accepted Answer

Implement dynamic batching that groups requests of similar lengths together before inference. Dynamic batching groups requests of similar input lengths together, which reduces the variance in inference time by ensuring that each batch processes tokens of comparable size. This minimizes the padding overhead and keeps the per-request latency more predictable, directly addressing the high tail latency caused by variable-length sequences without altering the model architecture.

Answer

Increase the number of replicas to distribute the load evenly

Answer

Reduce the model size by removing layers or using a smaller version

Answer

Deploy multiple model endpoints for different length ranges and route requests accordingly

Question 4

Your company uses OCI Data Science for model development and deployment. You have a generative AI model that requires dynamic batching for efficient inference. You deployed the model using the OCI Model Deployment service with a custom inference script in a Docker container. However, you notice that the batch size is fixed at 1, leading to low throughput. The model can process multiple requests together efficiently. You want to implement dynamic batching to increase throughput without significantly increasing latency for individual requests. What is the best approach?

Accepted Answer

Implement a queuing mechanism in the inference script that collects incoming requests and processes them in batches. Option D is correct because dynamic batching must be implemented at the application level within the custom inference script when using OCI Model Deployment. The service does not provide built-in request batching; instead, you need to collect incoming requests in a queue and process them together in a single forward pass, which maximizes GPU utilization while controlling latency via a timeout or max batch size.

Answer

Modify the model deployment to use a larger GPU shape to handle larger batches

Answer

Enable the model deployment's built-in request batching feature

Answer

Use OCI Streaming service to buffer requests and then invoke the model in batches from a consumer

Question 5

A data science team at a healthcare company has fine-tuned a Llama 2 model using OCI Data Science and registered it in the Model Catalog. They want to deploy it as a managed endpoint using OCI Generative AI. The model requires 64 GB of GPU memory. The team has created a dedicated AI cluster with a single node shape that has 48 GB GPU memory. When they attempt to deploy the model, the deployment fails with an error indicating insufficient resources. The team has verified that the model artifact is correct and that the compartment policies allow deployment. What should the team do to successfully deploy the model?

Accepted Answer

Select a node shape with higher GPU memory, such as 80 GB.. Option C is correct because the model requires 64 GB of GPU memory, but the dedicated AI cluster uses a node shape with only 48 GB. The only way to satisfy the memory requirement is to select a node shape with higher GPU memory, such as 80 GB, as OCI Generative AI managed endpoints require a single node to host the entire model. Increasing nodes or enabling model parallelism does not help because OCI Generative AI does not support distributed inference across nodes for managed endpoints, and reducing precision may not guarantee the model fits or may degrade accuracy.

Answer

Increase the number of nodes in the cluster to 2.

Answer

Enable model parallelism to split the model across nodes.

Answer

Reduce the model's precision from FP16 to INT8 to lower memory usage.

Question 6

A company has deployed a fine-tuned GPT model on OCI Generative AI using a dedicated AI cluster with 2 nodes. The endpoint is used by an internal application that generates product descriptions. Recently, the application started receiving timeouts and slow responses. The monitoring dashboard shows that the cluster's CPU utilization is consistently above 90%, and the request queue is growing. The team has verified that the model and code have not changed. The application traffic has increased by 20% over the past month. What should the team do to resolve the issue?

Accepted Answer

Increase the number of nodes in the dedicated AI cluster from 2 to 4.. Option D is correct because the dedicated AI cluster with 2 nodes is experiencing sustained CPU utilization above 90% and a growing request queue due to a 20% increase in traffic. Scaling out the cluster by adding more nodes (from 2 to 4) increases the available compute capacity, allowing the cluster to handle the higher inference load without timeouts. This directly addresses the resource bottleneck without requiring code or model changes.

Answer

Switch to a serverless endpoint to handle variable traffic.

Answer

Reduce the batch size in the inference requests to lower CPU usage.

Answer

Implement a caching layer for frequently requested descriptions.

Question 7

Your organization has deployed a generative AI model for a multilingual translation service on OCI Model Deployment. The model is a 13B parameter transformer hosted on a single VM.GPU.A100.1 shape with 2 replicas. Recently, the service experiences intermittent timeouts when a burst of requests arrives. You have enabled autoscaling based on CPU utilization, but the scaling is too slow. After investigation, you find that the model inference time is highly variable due to different sequence lengths. You need to ensure the service can handle sudden spikes without timeouts. Which solution should you implement?

Accepted Answer

Implement a request queue (e.g., OCI Queue) to buffer requests and process them asynchronously. Option A is correct because implementing a request queue (e.g., OCI Queue) decouples request ingestion from processing, allowing the service to buffer bursts of requests and process them asynchronously. This prevents timeouts by smoothing out the variable inference times caused by differing sequence lengths, as the queue absorbs spikes and the model processes at its own pace. Autoscaling based on CPU utilization is too slow for sudden spikes, but a queue provides immediate relief by not dropping requests.

Answer

Increase the maximum number of replicas and prewarm additional replicas before expected traffic

Answer

Reduce the model size to a 7B parameter model to decrease inference time

Answer

Use autoscaling based on the number of messages in the request queue

Question 8

A financial institution uses OCI GenAI to power a customer support chatbot. The compliance team requires that responses are strictly consistent with regulatory guidelines and approved responses. The company has a curated set of question-answer pairs that cover common scenarios. They want to ensure that the chatbot never deviates from these approved answers. The data science team is considering various approaches to enforce this consistency. Which approach is most effective?

Accepted Answer

Fine-tuning the model on the curated dataset of question-answer pairs.. Option B is correct because fine-tuning the model on the curated dataset of approved responses teaches the model to output similar responses for related questions, ensuring consistency. Option A is wrong because few-shot prompting may fail for unseen variations and does not guarantee strict adherence. Option C is wrong because using a large context window does not enforce specific content. Option D is wrong because setting a low temperature reduces randomness but does not guarantee the model will choose approved responses.

Answer

Few-shot prompting with three example responses in every query.

Answer

Using a large context window to include all regulatory guidelines in the prompt.

Answer

Setting a low temperature (0.1) to make outputs deterministic.

Question 9

A customer support company uses Cohere Command on OCI to answer user queries. They have enabled grounding with a knowledge base of product manuals. However, for about 20% of queries, the model provides incorrect product recommendations that are not in the manuals. The team has verified the knowledge base is up to date. What is the most likely cause and solution?

Accepted Answer

The query phrasing may not match the knowledge base; improve the retrieval system or use query rewriting.. Option D is correct because query phrasing may not match the knowledge base, leading to retrieval of irrelevant documents. Improving retrieval or using query rewriting bridges the gap. Option A might help if temperature were high, but the core issue is retrieval. Option B could introduce noise, and Option C may not solve the grounding issue.

Answer

The model's temperature is too high, causing creative responses. Lower temperature to 0.

Answer

The model is hallucinating; switch to a larger model.

Answer

The grounding settings are too restrictive; increase the number of retrieved documents.

Question 10

A healthcare company is using OCI Generative AI to analyze patient records and generate clinical summaries. The company must comply with HIPAA regulations, which require that all protected health information (PHI) be encrypted at rest and in transit, and that access be logged and audited. The current architecture uses an OCI Data Science model deployment with a public endpoint. The model is stored in an OCI Object Storage bucket that is publicly accessible for testing. The company is now moving to production. The compliance officer has flagged the following issues: (1) The model endpoint is publicly accessible. (2) The bucket containing the model is public. (3) No audit logs are enabled. The company wants to remediate these issues while maintaining the ability to invoke the model from on-premises applications via a secure connection. Which set of actions should the architect take?

Accepted Answer

Switch the model endpoint to a private subnet with a service gateway, update the bucket policy to block all public access, enable OCI Audit service, and set up a VPN or FastConnect for on-premises access.. Option C is correct because it addresses all three compliance issues: moving the model endpoint to a private subnet with a service gateway removes public exposure, making the bucket private with a policy that blocks all public access secures the model artifacts, and enabling OCI Audit provides the required logging. Additionally, setting up a VPN or FastConnect allows secure on-premises access without exposing the endpoint to the public internet, fully satisfying HIPAA encryption and audit requirements.

Answer

Switch the model endpoint to a private subnet with a service gateway, change the bucket to be accessible only via pre-authenticated requests, and enable OCI Logging for the model deployment.

Answer

Keep the public endpoint but restrict access using IAM policies and source IP addresses, make the bucket private, and enable OCI Audit.

Answer

Use a public load balancer with SSL termination, restrict bucket access to the load balancer's OCID, and enable OCI Audit.

Question 11

A large enterprise is deploying a generative AI model for internal document summarization. The model is deployed on OCI Data Science using a custom container. The inference endpoint is behind a public load balancer. The security team requires that all traffic between the client and the endpoint be encrypted in transit and that the endpoint not be accessible from the public internet. The current setup uses a public load balancer with an SSL certificate. The VCN has a public subnet for the load balancer and a private subnet for the model deployment. The security team is concerned that the load balancer is publicly accessible. The enterprise wants to maintain high availability and low latency. What should the architect do to meet the security requirements?

Accepted Answer

Replace the public load balancer with a private load balancer in a private subnet, and attach an SSL certificate for encryption.. Option D is correct because replacing the public load balancer with a private load balancer in a private subnet ensures the endpoint is not accessible from the public internet, while attaching an SSL certificate maintains encryption in transit. This satisfies both security requirements without sacrificing high availability or low latency, as the private load balancer still provides load balancing and TLS termination within the VCN.

Answer

Use a site-to-site VPN to connect clients to the VCN and access the endpoint via private IP.

Answer

Remove the load balancer and use a service gateway to access the model deployment directly from the VCN.

Answer

Keep the public load balancer but add a Web Application Firewall (WAF) to block unauthorized IPs.

Question 12

A multinational corporation uses OCI Generative AI to power a customer support chatbot. The chatbot uses a fine-tuned model deployed on a dedicated AI cluster in the us-ashburn-1 region. The application is used globally, and users in Europe are experiencing high latency (over 2 seconds) compared to users in North America (under 500 ms). The company has a requirement to keep all data within the US due to compliance, so they cannot deploy in Europe. The latency is not due to network bandwidth but due to the inference time. The monitoring shows that the cluster is at 80% utilization during peak hours. The team wants to reduce the latency for European users without violating data residency. What is the best course of action?

Accepted Answer

Optimize the model using techniques like quantization or pruning to reduce inference time.. Option A is correct because the latency issue is explicitly due to inference time, not network bandwidth or cluster utilization. Model optimization techniques like quantization (reducing precision of weights from FP32 to INT8) and pruning (removing redundant neurons) directly reduce the computational cost per inference, thereby lowering the response time without moving data or changing the deployment region. This approach satisfies the data residency constraint while addressing the root cause of high latency for European users.

Answer

Implement an edge caching layer in Europe to serve common queries.

Answer

Increase the number of nodes in the cluster to distribute the load.

Answer

Deploy an additional endpoint in a European region and use a global load balancer.

Question 13

You deployed a generative AI model on OCI Model Deployment with autoscaling configured based on average CPU utilization. The model is a large language model that heavily utilizes the GPU. During peak hours, the scaling is too slow to keep up with demand, resulting in high latency for users. You want to improve the responsiveness of autoscaling. Which change should you make?

Accepted Answer

Use GPU utilization as the scaling metric instead of CPU utilization. Option C is correct because the model heavily utilizes GPU, not CPU. Autoscaling based on CPU utilization is irrelevant for GPU-bound workloads, leading to delayed scale-out. Using GPU utilization as the scaling metric directly reflects the actual resource bottleneck, enabling faster and more accurate scaling decisions.

Answer

Decrease the target CPU utilization threshold for scale-out

Answer

Increase the maximum number of replicas in the autoscaling configuration

Answer

Increase the cooldown period between scale-out events

Question 14

A research team is using OCI Data Science and OCI GenAI to build a multilingual chatbot for customer service. They have training data in English, Spanish, and French. The model currently struggles with code-switching—users often mix languages in a single query (e.g., 'Quiero cancel my order'), and the model responds inconsistently, sometimes in English, sometimes mixing incorrectly. The team wants to improve performance on code-switching while maintaining fluency in each language. They have limited compute resources and cannot deploy separate models per language. Which approach should they take?

Accepted Answer

Fine-tune a multilingual model on a combined dataset that includes code-switching examples.. Option C is correct because fine-tuning a multilingual model (e.g., Cohere Command with multilingual support) on a combined dataset that includes code-switching examples directly teaches the model to handle mixed-language inputs. Option A is wrong because multilingual embeddings improve retrieval but do not address generation fluency for code-switching. Option B is wrong because training separate models per language would prevent any code-switching capability. Option D is wrong because language detection and routing is complex, may not handle mixed queries, and could lose cross-lingual context.

Answer

Train separate fine-tuned models for each language and route queries based on detected language.

Answer

Use language detection to route the query to a specific language model, then translate the response.

Answer

Use a multilingual embedding model for retrieval to improve context understanding.

Question 15

A company uses OCI GenAI to build a content moderation system that filters toxic language in user-generated comments. They have a small labeled dataset of 1,000 comments (500 toxic, 500 non-toxic) and need an efficient solution that balances accuracy, cost, and latency. They are considering different model options: fine-tuning a large LLM (e.g., Cohere Command), using a pre-trained LLM with prompting, fine-tuning a smaller BERT-based classifier, or building a rule-based system. The team has moderate ML experience and wants to deploy using OCI Data Science. Which approach is most efficient for this binary classification task?

Accepted Answer

Fine-tune a BERT-based classifier (e.g., 'bert-base-uncased') on the dataset.. Fine-tuning a BERT-based classifier (e.g., 'bert-base-uncased') is the most efficient approach because BERT is specifically designed for text classification tasks, requiring far fewer computational resources and lower latency than large LLMs. With only 1,000 labeled samples, BERT can achieve high accuracy through transfer learning, while keeping inference costs minimal—ideal for a production content moderation system on OCI Data Science.

Answer

Develop a rule-based system using regular expressions and keyword lists.

Answer

Use a pre-trained LLM with a toxic/non-toxic prompt.

Answer

Fine-tune the Cohere Command model on the labeled dataset.