1Z0-1127 Fundamentals of Large Language Models Practice Test 1 — 15 Questions

Question 1

A company is deploying a large language model for a customer service chatbot. The model needs to understand industry-specific jargon and maintain low latency. Which approach best balances these requirements?

Accepted Answer

Fine-tune a small open-source LLM on domain-specific data. Fine-tuning a small open-source LLM on domain-specific data is the best approach because it adapts the model to understand industry-specific jargon while keeping the model small enough to maintain low latency. Unlike larger models, a fine-tuned small model can run efficiently on local hardware, reducing inference time and avoiding the overhead of external API calls or large model sizes.

Answer

Employ retrieval-augmented generation (RAG) with a general model

Answer

Rely solely on prompt engineering with a general model

Answer

Use a large general-purpose LLM with zero-shot prompting

Question 2

A data scientist observes that their fine-tuned LLM performs well on training data but generates repetitive and dull responses in production. What is the most likely cause and best solution?

Accepted Answer

The temperature is set too low; increase temperature during inference. The model's repetitive and dull responses indicate that the temperature parameter is too low, causing the model to always select the most probable tokens, leading to deterministic and monotonous outputs. Increasing temperature during inference introduces randomness into token sampling, allowing for more diverse and creative responses. This is a common issue in production LLMs where low temperature settings optimized for training metrics fail to produce engaging real-world outputs.

Answer

The model is overfitted; apply stronger regularization

Answer

The training data lacks diversity; add more varied examples

Answer

The model has too many layers; reduce model size

Question 3

An organization wants to use an LLM to summarize legal documents. Which consideration is most important for ensuring accurate summaries?

Accepted Answer

Fine-tune the model on a curated legal corpus. Legal documents require precise understanding, so fine-tuning on legal data is critical. Option B is wrong because larger models don't guarantee domain accuracy. Option C is wrong because pre-training from scratch is expensive and unnecessary. Option D is wrong because zero-shot may miss legal nuances.

Answer

Use the largest available general-purpose model

Answer

Rely on zero-shot summarization with careful prompting

Answer

Pre-train a new model from scratch on legal texts

Question 4

A developer is building a code generation assistant. The model occasionally produces syntactically correct but semantically wrong code. Which technique directly addresses semantic correctness?

Accepted Answer

Apply RLHF using human-validated code examples. Reinforcement Learning from Human Feedback (RLHF) directly addresses semantic correctness by fine-tuning the model using human-validated code examples. This process teaches the model to prefer outputs that are not only syntactically valid but also logically correct and aligned with developer intent, reducing semantically wrong code generation.

Answer

Expand the token vocabulary

Answer

Lower the temperature to 0

Answer

Increase beam search width

Question 5

A company fine-tunes an LLM on internal support tickets. After deployment, the model hallucinates company-specific product names. What is the most effective mitigation?

Accepted Answer

Implement RAG with a verified product database. RAG (Retrieval-Augmented Generation) grounds the LLM's output in a verified product database, providing factual context that prevents hallucination of company-specific product names. Unlike fine-tuning, which only adjusts model weights and can still produce plausible but incorrect names, RAG retrieves exact records at inference time, ensuring accuracy for proprietary terminology.

Answer

Switch to a smaller model to reduce hallucination risk

Answer

Use prompt engineering to remind the model to be accurate

Answer

Fine-tune further with more ticket data

Question 6

A team wants to evaluate an LLM's performance on a text classification task. Which metric is most appropriate for a balanced dataset?

Accepted Answer

Accuracy. Accuracy is the most appropriate metric for evaluating an LLM on a text classification task with a balanced dataset because it directly measures the proportion of correctly predicted labels out of total predictions. For balanced classes, accuracy provides a reliable and intuitive performance indicator without the distortion caused by class imbalance.

Answer

BLEU score

Answer

Perplexity

Answer

ROUGE score

Question 7

An LLM-based application must comply with data privacy regulations by not memorizing personally identifiable information (PII). Which technique best reduces memorization of PII?

Accepted Answer

Train with differential privacy. Differential privacy (DP) is the correct technique because it directly limits the model's ability to memorize training data, including PII, by adding calibrated noise to the gradient updates during training. This ensures that the model's parameters do not encode specific individual records, providing a formal mathematical guarantee against memorization. Other options like model size, temperature, or training epochs do not address the root cause of memorization in the training process.

Answer

Use a larger model with more parameters

Answer

Decrease the temperature during inference

Answer

Increase the number of training epochs

Question 8

Which TWO factors most significantly influence the computational cost of fine-tuning a large language model?

Accepted Answer

Number of model parameters. Model size (parameters) directly determines FLOPs and memory. Training sequence length affects memory and compute per step. Option C is wrong because batch size affects throughput but not fundamental cost per token. Option D is wrong because quantization usually reduces cost. Option E is wrong because dataset size affects total steps but per-step cost is dominated by model size and sequence length.

Answer

Batch size

Answer

Quantization bits

Answer

Dataset size

Question 9

Which TWO techniques are commonly used to reduce the memory footprint of LLM inference?

Accepted Answer

Quantization. Quantization reduces the memory footprint by lowering the precision of model weights and activations from FP32 to lower bit-widths like INT8 or FP16, which directly decreases the memory required to store and compute with the model. KV cache optimization reduces memory usage by efficiently managing the key-value cache during autoregressive decoding, often through techniques like shared memory, pruning, or compression, which is critical for long-context inference.

Answer

Increasing batch size

Answer

Gradient checkpointing

Answer

Using full precision (FP32)

Question 10

Which THREE are essential steps in the prompt engineering process for an LLM?

Accepted Answer

Test the prompt with a variety of input examples. Option A is correct because testing the prompt with a variety of input examples is essential to evaluate the LLM's generalization, robustness, and sensitivity to different phrasing or contexts. This step helps identify edge cases, biases, or inconsistencies in the model's responses before deployment.

Answer

Fine-tune the model on a domain corpus

Answer

Quantize the model to INT8

Question 11

A data scientist is using a large language model to summarize customer support tickets. The model occasionally generates summaries that include hallucinated details not present in the original ticket. Which technique would best reduce hallucinations while maintaining summary quality?

Accepted Answer

Implement retrieval-augmented generation (RAG) to ground the model in relevant documents.. Retrieval-Augmented Generation (RAG) reduces hallucinations by grounding the model's output in external, verifiable documents retrieved from a knowledge base. Instead of relying solely on the model's parametric memory, RAG fetches relevant context (e.g., the original ticket) at inference time, ensuring the summary is factually aligned with the source. This maintains summary quality because the model can still generate fluent text while being constrained to the retrieved evidence.

Answer

Use a longer system prompt instructing the model to be factual.

Answer

Fine-tune the model on a large corpus of general text to improve its knowledge.

Answer

Increase the temperature parameter to 0.9 to encourage more deterministic outputs.

Question 12

An enterprise is deploying a chat application using a large language model. Users report that the model sometimes generates toxic or biased responses. Which best practice should be applied to mitigate this issue?

Accepted Answer

Implement a content filtering layer using a safety classifier to detect and block toxic outputs.. Option D is correct because implementing a content filtering layer using a safety classifier is a proven best practice to detect and block toxic or biased outputs in real-time. This approach acts as a guardrail, intercepting harmful responses before they reach users, and is independent of the model's internal parameters or training data.

Answer

Use few-shot prompting with examples of toxic responses so the model learns to avoid them.

Answer

Increase the max_tokens parameter to allow the model more context to correct itself.

Answer

Disable the temperature parameter to make outputs deterministic.

Question 13

A team is fine-tuning a large language model for a domain-specific Q&A application. After fine-tuning, they observe that the model performs well on the training distribution but struggles with out-of-distribution (OOD) questions. Which approach would best improve OOD robustness?

Accepted Answer

Include a diverse set of examples from related domains in the fine-tuning dataset.. Option C is correct because incorporating diverse data during fine-tuning helps the model generalize to OOD inputs. Option A is wrong because increasing learning rate may cause catastrophic forgetting. Option B is wrong because reducing model size reduces capacity. Option D is wrong because early stopping on training loss may not help OOD.

Answer

Use early stopping based on training loss to avoid overfitting.

Answer

Reduce the model size to prevent overfitting to the training data.

Answer

Increase the learning rate during fine-tuning to adapt faster to new patterns.

Question 14

A developer is using a large language model to generate code snippets. The model often produces code that is syntactically correct but functionally incorrect. What is the most effective way to improve the functional correctness of the generated code?

Accepted Answer

Provide few-shot examples of correct code in the prompt.. Option A is correct because providing few-shot examples of correct code in the prompt directly demonstrates the desired functional behavior to the model. This technique, known as few-shot prompting, grounds the model's output in concrete examples, significantly improving the likelihood that the generated code will be functionally correct by aligning the model's pattern completion with the intended logic, not just syntax.

Answer

Increase the temperature parameter to generate more creative solutions.

Answer

Ask the model to only output syntactically valid code.

Answer

Set max_tokens to a very high value to allow the model more room to think.

Question 15

A company is deploying a large language model in a customer-facing chatbot. The model's responses must be both accurate and safe. Which combination of techniques should be employed?

Accepted Answer

Use retrieval-augmented generation (RAG) for factual accuracy and a content safety filter for safe outputs.. Option B is correct because RAG grounds the model's responses in a verified external knowledge base, reducing hallucinations and improving factual accuracy, while a content safety filter (e.g., a classifier or guardrail) actively blocks toxic or unsafe outputs before they reach the user. This combination addresses both accuracy and safety independently, unlike a single system prompt which is easily bypassed.

Answer

Use only a system prompt instructing the model to be accurate and safe.

Answer

Use a high temperature for creativity and a safety classifier for blocking toxic outputs.

Answer

Fine-tune the model on all historical chat logs and use a high temperature.