Generative AI Leader Practice Test 2 — 25 Questions

Question 1

A company has a large dataset of proprietary documents and wants to build a Q&A system using a foundation model without exposing the documents to the model. Which approach is most appropriate?

Accepted Answer

Use RAG with Vertex AI Vector Search and embeddings. Retrieval-Augmented Generation (RAG) with Vertex AI Vector Search allows the system to retrieve relevant document chunks via embeddings without exposing the full documents to the foundation model. The model only sees the retrieved context in the prompt, ensuring proprietary data remains isolated and not used for training or memorization.

Answer

Use a zero-shot model with context in prompt

Answer

Fine-tune the model on the documents

Answer

Use prompt engineering to instruct the model

Question 2

A financial services company wants to use generative AI to generate personalized investment advice. They must ensure responses comply with regulatory requirements (e.g., no guarantees of returns). Which Vertex AI safety feature should they primarily use?

Accepted Answer

Safety filters with a custom blocklist that includes phrases like 'guaranteed return'.. Safety filters with a custom blocklist allow the company to define specific prohibited phrases (e.g., 'guaranteed return') that the model must avoid generating. This provides a deterministic, rule-based enforcement layer that directly addresses regulatory compliance by blocking disallowed content at inference time, without relying on the model's probabilistic behavior.

Answer

Vertex AI Grounding with their compliance database.

Answer

Prompt engineering with instructions to avoid guarantees.

Answer

Reinforcement learning from human feedback (RLHF) on the model.

Question 3

A legal firm wants to automate contract analysis to extract key clauses and risks. They have 10,000 contracts in PDF format. The solution must handle varying layouts and be cost-effective. Which approach is BEST?

Accepted Answer

Use Document AI to convert PDFs to structured text, then use Vertex AI with a prompt that specifies clauses to extract. Using Document AI to parse PDFs into text, then Vertex AI with a structured prompt for clause extraction combines robust document understanding with flexible GenAI. Fine-tuning on 100 contracts is insufficient for layout variation. Agent Builder is overkill. Direct Gemini API on raw PDFs loses document structure.

Answer

Build a retrieval-augmented generation (RAG) system in Vertex AI Agent Builder

Answer

Use the Gemini API directly with the raw PDF files as input

Answer

Fine-tune a Gemini model on 100 annotated contracts and run inference on all contracts

Question 4

A research team is training a large language model from scratch using TPUs on Google Cloud. Which storage solution provides the highest throughput for training data?

Accepted Answer

Cloud Storage. Cloud Storage provides the highest throughput for training data because it is designed for high-bandwidth, parallel access from TPU pods via the Google Cloud Storage FUSE or gRPC-based data loading. TPUs benefit from Cloud Storage's ability to serve data at hundreds of GB/s when using the `tf.data` service with `tf.io.gfile` or the `gcloud storage` API, avoiding the I/O bottlenecks of block storage. Persistent Disk and Filestore have lower aggregate throughput limits and are not optimized for the distributed, streaming read patterns typical of large-scale training.

Answer

Persistent Disk

Answer

Cloud Filestore

Answer

Cloud Spanner

Question 5

An organization uses an IAM policy for Vertex AI as shown. A security audit reveals that engineer@example.com deployed a model that inadvertently exposed sensitive data. What is the most likely reason this happened?

Accepted Answer

The engineer had the aiplatform.user role, which includes permissions to deploy models without additional review.. The `aiplatform.user` role in Vertex AI includes the `aiplatform.model.deploy` permission, which allows any user with that role to deploy models without requiring additional approvals or administrative review. This lack of a secondary authorization step means the engineer could deploy a model that exposed sensitive data, even if the model had not been properly vetted for data leakage.

Answer

Audit logging is not enabled for DATA_WRITE events.

Answer

The admin user did not review the deployment.

Answer

The policy does not include a separation of duties between development and production.

Question 6

Which THREE are valid methods to reduce bias in generative AI outputs?

Accepted Answer

Using a more diverse training dataset. Training on a more diverse dataset reduces representational bias by exposing the model to a wider range of demographics, cultures, and perspectives. This directly mitigates the model's tendency to overrepresent majority groups or underrepresent minorities, which is a root cause of biased outputs in generative AI.

Answer

Using only English prompts

Answer

Increasing model size

Question 7

A company is deploying a generative AI application that generates medical reports. They need to ensure the output is factual and minimizes hallucinations. Which approach is most effective?

Accepted Answer

Implement retrieval-augmented generation (RAG) with a curated knowledge base. Retrieval-Augmented Generation (RAG) is the most effective approach because it grounds the model's output in a curated, authoritative knowledge base of medical data. By retrieving relevant, verified documents at inference time, RAG directly reduces the model's reliance on its parametric memory, which is the primary source of hallucinations in generative AI. This is especially critical in high-stakes domains like medical reporting, where factual accuracy is paramount.

Answer

Fine-tune the model with RLHF

Answer

Set the temperature to 0.0

Answer

Use prompt engineering to instruct the model to be accurate

Question 8

A data scientist is fine-tuning a large language model for a specialized domain using limited labeled data. To avoid catastrophic forgetting and reduce computational cost, which approach is recommended?

Accepted Answer

Adapter-based fine-tuning using LoRA. Adapter-based fine-tuning using LoRA (Low-Rank Adaptation) is recommended because it freezes the pre-trained model weights and injects trainable low-rank matrices into the transformer layers. This approach drastically reduces the number of parameters to update (often by 10,000x), lowering memory and compute requirements, while preserving the original knowledge to prevent catastrophic forgetting on limited domain data.

Answer

Using prompt engineering with in-context learning

Answer

Full fine-tuning of all model parameters

Answer

Training a new model from scratch on the domain data

Question 9

A company uses Gemini for Google Workspace to help employees draft emails. After rollout, the IT team notices that the Smart Compose suggestions are sometimes inappropriate for external communications. What is the BEST way to address this while maintaining productivity gains?

Accepted Answer

Train employees to write more specific prompts and provide few-shot examples for desired tone. Providing few-shot examples or using custom prompts for tone can guide the model to produce more appropriate suggestions. Disabling the feature or using a generic model would not leverage Workspace integration.

Answer

Switch to a third-party email assistant not integrated with Workspace

Answer

Disable Smart Compose for all external email accounts

Answer

Fine-tune the Gemini model on the company's past external emails

Question 10

A healthcare startup wants to generate synthetic patient notes for training medical residents. They need the output to follow a strict template with sections: Chief Complaint, History, Assessment, Plan. Which prompt engineering strategy should they use to ensure consistent structure?

Accepted Answer

Provide a few-shot example of the template filled out and instruct the model to follow that format for new cases. Structured output via few-shot examples showing the exact template ensures the model learns the required format. Adding instructions alone may not enforce the structure as reliably.

Answer

Use a zero-shot prompt asking for a patient note in bullet points

Answer

Set temperature to 0 and max tokens to a high value

Answer

Use a system prompt that lists the sections as instructions

Question 11

A developer deployed a large language model on Vertex AI for real-time chat. Users report slow response times. The model generates sentences one word at a time. Which optimization should be applied to reduce latency?

Accepted Answer

Use streaming responses to start output earlier.. Streaming responses allow the model to send tokens to the client as they are generated, rather than waiting for the full sequence to complete. This reduces perceived latency significantly in real-time chat, as users see the first word appear almost immediately, even though the total generation time remains similar.

Answer

Batch multiple user queries together.

Answer

Deploy the model with more accelerators.

Answer

Enable prompt caching to reuse previous queries.

Question 12

A sales team wants to use Gemini for Google Workspace to draft emails in Gmail. Which feature should they enable to generate full email drafts from a brief prompt?

Accepted Answer

Help me write. 'Help me write' is the specific Gemini for Google Workspace feature designed to generate full email drafts from a brief prompt. It leverages the underlying large language model to compose complete, context-aware email content, unlike features that only suggest short phrases or replies.

Answer

Translate

Answer

Smart Reply

Answer

Smart Compose

Question 13

A developer is using Vertex AI Gemini API for a chatbot. The chatbot sometimes outputs harmful content. What is the best first step to mitigate this?

Accepted Answer

Use safety filters and safety settings in the API request. The Vertex AI Gemini API provides built-in safety filters and configurable safety settings (e.g., `safety_settings` parameter with categories like `HARM_CATEGORY_HARASSMENT` and thresholds like `BLOCK_ONLY_HIGH`) that allow developers to block harmful outputs at inference time without retraining. This is the fastest and most direct first step to mitigate harmful content, as it requires no additional infrastructure or model modification.

Answer

Fine-tune the model on curated safe data

Answer

Add a human-in-the-loop review

Answer

Switch to a smaller model

Question 14

Which TWO techniques are effective for reducing bias in generative AI model outputs?

Accepted Answer

Training on diverse and representative datasets. Training on diverse and representative datasets directly reduces sampling bias and coverage gaps in the training distribution, which are primary sources of stereotypical or skewed outputs. By ensuring the model sees balanced examples across demographics, contexts, and edge cases, it learns more equitable representations and reduces the likelihood of generating biased content.

Answer

Increasing model size to learn more patterns

Answer

Relying solely on post-hoc filters

Answer

Limiting the model to only factual prompts

Question 15

According to Google's AI Principles, AI systems should be 'accountable to people.' What does this principle primarily require?

Accepted Answer

Organizations should provide avenues for feedback and recourse when AI systems cause harm. Accountability means providing mechanisms for feedback and recourse when AI systems cause harm or make mistakes.

Answer

AI systems should always have a human monitor present during operation

Answer

The AI system should be able to explain all its decisions to end users

Answer

AI systems should be designed to maximize shareholder value

Question 16

A data scientist wants to compare the performance of three different foundation models for a text summarization task. They have a labeled dataset of summaries. Which Vertex AI tool should they use to perform this evaluation?

Accepted Answer

Vertex AI Studio - Evaluation. Vertex AI Studio provides a model evaluation interface where you can compare model outputs using automatic metrics. Model Garden is a model hub. Agent Builder is for building agents. RAG Engine is for retrieval.

Answer

Vertex AI RAG Engine - Retrieval evaluation

Answer

Vertex AI Agent Builder - Agent evaluation

Answer

Model Garden - Model comparison view

Question 17

A security team wants to prevent prompt injection attacks on their generative AI application hosted on Vertex AI. Which best practice should they implement?

Accepted Answer

Implement input validation and output filtering. Prompt injection attacks exploit the model's inability to distinguish between user instructions and untrusted input. Implementing input validation (e.g., sanitizing special characters or known injection patterns) and output filtering (e.g., using a classifier to detect and block malicious responses) directly mitigates this risk by controlling what the model processes and returns. On Vertex AI, this can be enforced via custom safety attributes or integration with services like Cloud DLP for data loss prevention.

Answer

Use a custom model instead of a foundation model

Answer

Disable all logging

Answer

Use a private endpoint

Question 18

A team uses PaLM 2 API to generate product descriptions, but the output sometimes contains factual inaccuracies. What is the best approach to improve accuracy?

Accepted Answer

Use grounding with Google Search. Grounding with Google Search is the correct approach because it allows the PaLM 2 API to retrieve real-time, verifiable information from the web, directly reducing factual inaccuracies in generated product descriptions. Unlike parameter adjustments, grounding provides an external knowledge source that the model can cite, ensuring outputs are based on current and accurate data rather than relying solely on its training data.

Answer

Increase the temperature parameter

Answer

Reduce the top_k value

Answer

Set the max_output_tokens higher

Question 19

A retail company has deployed a customer support chatbot using Vertex AI Agent Builder. The chatbot is configured with a knowledge base stored in BigQuery (user manuals) and Cloud Storage (product images). The agent uses a Gemini 1.5 Pro model for response generation. Users report that the chatbot frequently gives incorrect answers and sometimes does not reference the knowledge base at all. Logs show high latency (average response time > 10 seconds) and many responses are generic or hallucinated. The agent's grounding configuration currently uses the default settings. The development team is considering the following actions: A) Switch to a smaller model like Gemini 1.5 Flash to reduce latency. B) Increase the context window of the model to allow more knowledge base content. C) Enable Vertex AI Search for grounding and configure a search aggregation strategy that retrieves relevant documents from the knowledge base. D) Fine-tune the Gemini model with the company's historical chat logs to improve domain-specific responses. Which action should the team take FIRST to address the issues?

Accepted Answer

Enable Vertex AI Search for grounding and configure a search aggregation strategy that retrieves relevant documents from the knowledge base.. The core issue is that the chatbot is not grounding its responses in the provided knowledge base, leading to hallucinations and generic answers. Enabling Vertex AI Search for grounding directly addresses this by forcing the model to retrieve and cite relevant documents from BigQuery and Cloud Storage before generating a response. This is the foundational step to fix the accuracy problem, as no amount of model tuning or context window expansion will help if the model is not consulting the correct data sources.

Answer

Switch to a smaller model like Gemini 1.5 Flash to reduce latency.

Answer

Increase the context window of the model to allow more knowledge base content.

Answer

Fine-tune the Gemini model with the company's historical chat logs to improve domain-specific responses.

Question 20

A company is using Vertex AI to generate personalized marketing emails. The model sometimes produces biased content. What is the most effective way to detect and mitigate bias?

Accepted Answer

Use Vertex AI Explainable AI to analyze predictions and detect bias in training data. Vertex AI Explainable AI provides feature attributions and model explanations that help identify which input features (e.g., demographic attributes, phrasing patterns) contribute most to biased outputs. By analyzing these attributions against training data, you can pinpoint and mitigate bias at the source, rather than relying on post-hoc manual review or model swapping.

Answer

Add more diverse training data

Answer

Manually review all generated emails before sending

Answer

Switch to a different generative model