Should You Fine-Tune or Use Prompt Engineering in OCI GenAI? Key Factors
Which THREE factors should be considered when choosing between fine-tuning a model and using a pre-trained model with prompt engineering? (Select three.)
Quick Answer
The answer is the need for domain-specific terminology, along with dataset size and cost constraints, as the three key factors when choosing between fine-tuning and prompt engineering in OCI GenAI. Fine-tuning adjusts the model’s weights using a large, labeled dataset to internalize specialized jargon, making it ideal for domains like legal or medical text where prompt engineering alone may fail to elicit precise responses. In contrast, prompt engineering relies on cleverly crafted instructions and works with zero or few examples, but it cannot teach the model new terminology—it can only guide existing knowledge. On the Oracle Cloud Infrastructure Generative AI Professional 1Z0-1127 exam, this question tests your understanding of when to invest in fine-tuning versus leveraging a pre-trained model, with a common trap being to overlook dataset size as a limiting factor. Remember the mnemonic “DTC” for Domain, Dataset, and Cost—if you lack large labeled data or budget, stick with prompt engineering.
⚠ Common exam trap
Oracle often tests the misconception that response time or internet connectivity are decisive factors, when in reality the core trade-off is between data availability and the need for deep domain adaptation versus lightweight, zero-shot customization.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Size of available dataset
The size of the available dataset is a critical factor: fine-tuning requires a sufficiently large, labeled dataset (typically thousands of examples) to adjust model weights effectively, while prompt engineering can work with zero or few examples. If the dataset is too small, fine-tuning risks overfitting and poor generalization, making prompt engineering the safer choice.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Required response time
Why it's wrong here
Both approaches have similar response times; not a differentiator.
- ✓
Size of available dataset
Why this is correct
Fine-tuning requires a sufficiently large dataset; prompt engineering can work with few examples.
- ✗
Internet connectivity
Why it's wrong here
Both approaches require internet connectivity to access the service.
- ✓
Available budget for compute resources
Why this is correct
Fine-tuning incurs training costs; prompt engineering is typically cheaper.
- ✓
Need for domain-specific terminology
Why this is correct
Fine-tuning can embed domain knowledge; prompt engineering may require careful crafting.
Go deeper
Related to this question
About these practice questions
One of 768 original 1Z0-1127-25 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
2 more ways this is tested on 1Z0-1127-25
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A company wants to use OCI Generative AI service to automatically generate product descriptions for an e-commerce catalog. They have 10,000 products. What is the best approach to ensure high-quality, consistent descriptions?
medium- A.Use a pre-trained summarization model.
- B.Use a template-based generation with keyword insertion.
- C.Use the built-in chat model with few-shot examples in the prompt.
- ✓ D.Fine-tune a base model on a dataset of existing product descriptions.
Why D: Fine-tuning a base model on a dataset of existing product descriptions is the best approach because it adapts the model to the specific domain, style, and vocabulary of the e-commerce catalog. This ensures high-quality, consistent outputs across 10,000 products by learning the patterns and terminology from the company's own data, rather than relying on generic or template-based methods.
Variation 2. A healthcare startup uses OCI Generative AI to automatically generate patient summary reports from clinical notes. They use the Cohere command model (command-r-plus) with default parameters. Over the past week, the team has noticed two issues: (1) the summaries occasionally contain medical inaccuracies, such as incorrect drug dosages or misinterpreted lab results, and (2) the response time has increased from an average of 2 seconds to over 10 seconds. The application has a high volume of concurrent requests, and the startup has already increased the max tokens to 4096 and set temperature to 0.1. The model appears to perform well on general language tasks but struggles with specialized medical terminology. The team is looking for a long-term solution that balances accuracy, latency, and cost. What should they do?
medium- A.Switch to a larger base model, such as Llama 2 70B, to improve knowledge of medical terms
- ✓ B.Fine-tune the Cohere command model using a curated dataset of medical notes and correct summaries
- C.Implement a caching layer to store and reuse responses for identical queries
- D.Reduce the max tokens parameter from 4096 to 1024 to decrease response time
Why B: Fine-tuning the Cohere command model on a curated dataset of medical notes and correct summaries directly addresses the core issue: the model's poor performance on specialized medical terminology. Unlike prompt engineering or parameter adjustments, fine-tuning adapts the model's weights to the medical domain, improving accuracy without sacrificing latency or incurring the high cost of a larger base model. This approach balances accuracy, latency, and cost by using a smaller, optimized model that can handle concurrent requests efficiently.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This 1Z0-1127-25 practice question is part of Courseiva's free Oracle certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the 1Z0-1127-25 exam.