Generative AI Leader Fundamentals of Generative AI Practice Test 2 — 15 Questions

Question 1

A team is fine-tuning a large language model on custom data using Vertex AI. They find that the training loss decreases but validation loss increases. What is the best course of action?

Accepted Answer

Reduce the model size or add dropout regularization.. The increasing validation loss while training loss decreases is a classic sign of overfitting, where the model memorizes the training data but fails to generalize. Reducing model size or adding dropout regularization directly combats overfitting by limiting the model's capacity or introducing noise during training, which forces the model to learn more robust features. This is the best course of action because it addresses the root cause without further exacerbating the problem.

Answer

Increase the number of training epochs.

Answer

Increase the learning rate.

Answer

Switch to a smaller batch size.

Question 2

A developer wants to generate product descriptions from a list of features using Vertex AI. Which model type is best suited for this task?

Accepted Answer

A text generation model (e.g., text-bison@001).. Text-bison@001 is a dedicated text generation model optimized for tasks like summarization, translation, and content creation from structured inputs. It can take a list of features as a prompt and generate coherent, descriptive product descriptions without needing conversational context or code-specific outputs.

Answer

An embedding model (e.g., textembedding-gecko@001).

Answer

A chat model (e.g., chat-bison@001).

Answer

A code generation model (e.g., code-bison@001).

Question 3

A company is using Vertex AI to generate email responses. They want to ensure sensitive customer data (PII) is not included in the output. What is the most effective approach?

Accepted Answer

Configure safety filters to block PII categories.. Safety filters in Vertex AI are specifically designed to block categories of harmful content, including PII, at the model's output layer. This provides a deterministic, automated guardrail that prevents sensitive data from being generated, unlike prompt-based instructions which can be overridden by the model's training. Safety filters operate on the model's response before it is returned, ensuring PII is caught even if the model attempts to generate it.

Answer

Use a system prompt instructing the model to avoid PII.

Answer

Fine-tune the model on a dataset that excludes PII.

Answer

Manually review each output before sending.

Question 4

Which TWO statements are true about generative AI models?

Accepted Answer

They are typically pre-trained on large datasets.. Generative AI models, such as GPT-4 or DALL-E, are typically pre-trained on vast, diverse datasets (e.g., terabytes of text or images) using unsupervised or self-supervised learning. This pre-training phase allows the model to learn statistical patterns, grammar, and world knowledge, which is then fine-tuned for specific tasks. Without this large-scale pre-training, the model would lack the foundational understanding needed to generate coherent and contextually relevant outputs.

Answer

They are deterministic by design.

Answer

They always produce the same output for the same input.

Answer

They require no data for training.

Question 5

A company is deploying a generative AI model for medical diagnosis support. Which THREE considerations are critical for responsible AI?

Accepted Answer

Ensure the training data is diverse and representative.. Diverse and representative training data is critical for responsible AI in medical diagnosis. If the data lacks diversity, the model may exhibit bias, leading to inaccurate or harmful diagnoses for underrepresented groups. This directly impacts fairness, safety, and regulatory compliance in healthcare AI.

Answer

Maximize model throughput to handle high volumes.

Answer

Use the cheapest model to reduce costs.

Question 6

A team is evaluating generative AI models for a content moderation system. Which THREE metrics are most important to assess?

Accepted Answer

Percentage of outputs flagged by safety filters.. Safety filters are a primary mechanism for detecting and blocking harmful or policy-violating content in generative AI outputs. In a content moderation system, the percentage of outputs flagged by these filters directly measures the model's tendency to produce unsafe content, which is critical for maintaining platform safety and compliance.

Answer

Cost per million tokens.

Answer

BLEU score against human-written moderation guidelines.

Question 7

A company wants to build a chatbot using Vertex AI that can answer customer questions based on their internal knowledge base. Which Google Cloud service should they use to store and retrieve the knowledge base efficiently?

Accepted Answer

Vertex AI Vector Search. Vertex AI Vector Search is the correct choice because it is purpose-built for semantic similarity search over embeddings, enabling the chatbot to retrieve relevant chunks from the knowledge base based on meaning rather than exact keyword matches. It integrates natively with Vertex AI and supports high-dimensional vector indexing, making it efficient for large-scale retrieval-augmented generation (RAG) workflows.

Answer

Cloud Storage

Answer

BigQuery

Answer

Vertex AI Matching Engine

Question 8

A company is deploying a generative AI application that generates medical reports. They need to ensure the output is factual and minimizes hallucinations. Which approach is most effective?

Accepted Answer

Implement retrieval-augmented generation (RAG) with a curated knowledge base. Retrieval-Augmented Generation (RAG) is the most effective approach because it grounds the model's output in a curated, authoritative knowledge base of medical data. By retrieving relevant, verified documents at inference time, RAG directly reduces the model's reliance on its parametric memory, which is the primary source of hallucinations in generative AI. This is especially critical in high-stakes domains like medical reporting, where factual accuracy is paramount.

Answer

Fine-tune the model with RLHF

Answer

Set the temperature to 0.0

Answer

Use prompt engineering to instruct the model to be accurate

Question 9

A developer is using Vertex AI PaLM API to generate code snippets. The responses sometimes contain security vulnerabilities. What is the best practice to mitigate this?

Accepted Answer

Implement input validation and output filtering with safety attributes. Input validation and output filtering with safety attributes directly address security vulnerabilities by sanitizing user inputs and filtering model outputs for harmful content. The Vertex AI PaLM API provides safety attribute scores (e.g., toxicity, harassment) that allow developers to programmatically block or flag responses that exceed defined thresholds, reducing the risk of generating insecure code snippets.

Answer

Disable safety filters to allow more output

Answer

Increase the max output tokens

Answer

Set safety settings to block all categories

Question 10

A machine learning engineer is building a text-to-image model using Vertex AI. They want to reduce inference latency. Which strategy is most effective?

Accepted Answer

Use a smaller model variant. Using a smaller model variant directly reduces the number of parameters and computational operations required per inference pass, which lowers latency. In text-to-image models like Imagen or Stable Diffusion, the model size is the primary driver of forward-pass time, so a smaller variant (e.g., fewer layers or reduced latent dimensions) yields faster generation.

Answer

Use a larger image resolution

Answer

Enable batch processing

Answer

Increase the number of inference steps

Question 11

A company is using Vertex AI to generate personalized marketing emails. The model sometimes produces biased content. What is the most effective way to detect and mitigate bias?

Accepted Answer

Use Vertex AI Explainable AI to analyze predictions and detect bias in training data. Vertex AI Explainable AI provides feature attributions and model explanations that help identify which input features (e.g., demographic attributes, phrasing patterns) contribute most to biased outputs. By analyzing these attributions against training data, you can pinpoint and mitigate bias at the source, rather than relying on post-hoc manual review or model swapping.

Answer

Add more diverse training data

Answer

Manually review all generated emails before sending

Answer

Switch to a different generative model

Question 12

Which TWO options are best practices for deploying generative AI models on Vertex AI? (Choose two.)

Accepted Answer

Enable automatic scaling to handle variable traffic. Vertex AI's automatic scaling dynamically adjusts the number of serving instances based on incoming traffic, ensuring low latency during spikes and cost efficiency during lulls. This is a best practice for production workloads where traffic patterns are unpredictable, as it eliminates the need for manual capacity planning.

Answer

Disable logging to reduce cost

Answer

Manually scale instances based on expected load

Answer

Serve the model directly without optimization

Question 13

Which THREE factors should be considered when choosing between fine-tuning and prompt engineering for a generative AI task? (Choose three.)

Accepted Answer

Availability of labeled training data. Fine-tuning requires a labeled dataset specific to the target task to adjust model weights via supervised learning, whereas prompt engineering relies on the model's existing knowledge without additional training data. Without sufficient labeled data, prompt engineering is often the only viable approach, as fine-tuning would risk overfitting or poor generalization.

Answer

Cost of API calls per request

Answer

Size of the base model

Question 14

A data scientist sees the above error when trying to deploy a model to an endpoint. What is the most likely cause?

Accepted Answer

The model import into Vertex AI Model Registry is still in progress. The error indicates that the model is not yet fully imported into the Vertex AI Model Registry. Deploying a model to an endpoint requires the model resource to be in an 'ACTIVE' state; if the import is still in progress, the deployment request will fail. This is a common timing issue when a model is uploaded but not yet registered.

Answer

The IAM permissions are insufficient

Answer

The endpoint does not exist

Answer

The model is already deployed to another endpoint

Question 15

A developer receives the above JSON response from a Vertex AI PaLM API call for a medical advice application. What should the developer be most concerned about?

Accepted Answer

The output falls under the 'health' category, which may require compliance with regulations. The JSON response includes a 'category' field with the value 'health', which triggers stringent regulatory compliance requirements such as HIPAA in the US or GDPR in Europe. For a medical advice application, the developer must ensure data handling, model transparency, and output validation meet these legal standards, as failure could result in severe penalties. The PaLM API's safety attributes and category labels are designed to flag such sensitive domains, making compliance the primary concern over other technical issues.

Answer

The safety score is very low (0.01)

Answer

The deployed model ID is not recognized

Answer

The prediction content is incorrect