Generative AI Leader Practice Test 46 — 15 Questions

Question 1

A retail company wants to build a customer service chatbot that can handle returns, order status, and FAQs. They need to integrate with their existing backend systems. Which Google Cloud service should they use?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Vertex AI Agent Builder. Vertex AI Agent Builder is the correct choice because it provides a low-code platform specifically designed for building conversational AI agents (chatbots) that can be integrated with enterprise backend systems via APIs, connectors, and custom tools. It supports grounding in enterprise data, multi-turn dialogue management, and seamless integration with existing systems for handling returns, order status, and FAQs, making it the most suitable service for this use case.

Answer

Vertex AI Model Garden

Answer

Vertex AI Search

Answer

Vertex AI Codey API

Question 2

A company wants to evaluate the ROI of deploying a GenAI tool for customer support. They plan to measure productivity gains. Which metric is most directly tied to productivity improvement?

Accepted Answer

Average handling time per ticket. Average handling time (AHT) per ticket is the most direct metric for productivity improvement because it quantifies the time an agent spends resolving a customer issue. A GenAI tool that generates response drafts or retrieves knowledge base articles reduces the agent's wrap-up and research time, directly lowering AHT. This is a standard contact center metric (e.g., measured in seconds or minutes) that maps to cost savings and throughput gains.

Answer

Total token consumption

Answer

Ticket deflection rate

Answer

Customer satisfaction score (CSAT)

Question 3

Refer to the exhibit. A team attempted to start a model tuning job but received the error 'Quota limit exceeded for tuning jobs in region us-central1'. What is the most appropriate action?

Accepted Answer

Request a quota increase for tuning jobs in us-central1. The error 'Quota limit exceeded for tuning jobs in region us-central1' indicates that the project has reached its predefined resource quota for model tuning operations in that specific region. The most appropriate action is to request a quota increase from Google Cloud, as this directly resolves the capacity limitation without altering the job's configuration or data. Quotas are per-region limits enforced by the AI Platform to ensure fair resource allocation, and increasing the quota is the standard procedure when legitimate tuning needs exceed the default allowance.

Answer

Change the region to us-west1 and retry

Answer

Reduce the size of the training data

Answer

Use a different base model

Question 4

A research lab is planning to train a massive protein folding model similar to AlphaFold. They want to use Google Cloud infrastructure and tools. Which THREE components are most relevant?

Accepted Answer

Cloud TPU pods. Cloud TPU pods (A) are correct because training massive protein folding models like AlphaFold requires enormous matrix/tensor computation, and TPU pods provide the tightly-coupled, high-bandwidth interconnects and thousands of TPU chips needed for large-scale distributed training. Vertex AI Pipeline (C) is correct because it orchestrates the multi-step ML workflow — data preprocessing, training, evaluation, and deployment — as a reproducible, managed pipeline on Google Cloud, which is essential for a complex research training process. Google DeepMind collaboration (E) is correct because AlphaFold itself was developed by DeepMind, and partnering with DeepMind gives the lab access to the domain expertise, model architectures, and research guidance specific to protein folding. Cloud Vision API (B) is not relevant because it is a pre-trained service for image classification, OCR, and object detection, not protein structure prediction. Google AI Studio (D) is not relevant because it is a lightweight developer tool for prototyping prompts with Gemini models, not a platform for large-scale scientific model training.

Answer

Cloud Vision API

Answer

Google AI Studio

Question 5

A data scientist wants to fine-tune a foundation model from Vertex AI Model Garden on their custom dataset. They want to choose a cost-effective method that updates only a small subset of parameters. Which fine-tuning approach should they use?

Accepted Answer

Parameter-Efficient Fine-Tuning (PEFT) like LoRA. Parameter-Efficient Fine-Tuning (PEFT) methods like LoRA (Low-Rank Adaptation) are specifically designed to update only a small subset of parameters (e.g., low-rank matrices injected into transformer layers) while keeping the majority of the foundation model frozen. This drastically reduces memory and compute costs compared to full fine-tuning, making it the most cost-effective choice for customizing a model from Vertex AI Model Garden on a custom dataset.

Answer

Full fine-tuning

Answer

Prompt tuning

Answer

Reinforcement Learning from Human Feedback (RLHF)

Question 6

A developer is building a code‑generation assistant using the Codey API on Vertex AI. The assistant should generate Python functions based on natural language descriptions. However, the generated code sometimes contains syntax errors. Which parameter adjustment would MOST directly help reduce syntax errors?

Accepted Answer

Lower the temperature (e.g., from 0.8 to 0.2). Reducing temperature makes the model more deterministic, which typically reduces creative but incorrect outputs like syntax errors. Prompt engineering can also help, but adjusting temperature is the simplest direct fix. Increasing max tokens or changing top-k does not directly address syntax correctness.

Answer

Increase the context window

Answer

Set top-k to 1

Answer

Increase the max output tokens

Question 7

A company wants to use Generative AI for customer support chatbots. They are concerned about cost and latency. Which deployment option best balances these concerns?

Accepted Answer

Use a fine-tuned version of a smaller model on Vertex AI with response caching. Using a fine-tuned smaller model on Vertex AI with response caching reduces both cost and latency. Smaller models require fewer computational resources, and caching avoids redundant inference calls, directly addressing the company's concerns without sacrificing accuracy for the specific task.

Answer

Deploy an open-source model on-premise to avoid cloud costs

Answer

Rely on a third-party chatbot API that abstracts the model

Answer

Use the largest available foundation model via API for highest accuracy

Question 8

A company is evaluating the ROI of deploying a GenAI-powered code review assistant. Which metric would BEST capture the quality improvement from using the assistant?

Accepted Answer

Defect escape rate (bugs found in production). Defect escape rate measures bugs that reach production; a reduction indicates higher code quality. Productivity metrics like lines of code per hour measure speed, not quality. User acceptance is a satisfaction measure, not direct quality.

Answer

Number of code reviews completed per week

Answer

Lines of code written per developer per day

Answer

Developer satisfaction survey score

Question 9

A company is evaluating the ROI of a generative AI project. Which metric is most appropriate?

Accepted Answer

Reduction in time to complete tasks using the generative AI tool. The primary business justification for a generative AI project is operational efficiency, measured directly by the reduction in time to complete tasks. Unlike technical metrics such as model error rate, this metric ties the AI's output to tangible productivity gains, which is the core of ROI analysis in a business context. Generative AI tools are designed to augment human workflows, so time savings translate into cost savings and increased throughput, making it the most appropriate metric for evaluating return on investment.

Answer

Reduction in model error rate on a test set

Answer

Increase in user satisfaction scores

Answer

Cost per inference compared to historical average

Question 10

A company wants to build a proof-of-concept generative AI application quickly. They have limited ML expertise and need to test multiple foundation models with different prompts. Which Vertex AI tool should they use?

Accepted Answer

Vertex AI Studio. Vertex AI Studio is designed for rapid prototyping with prompt design, model testing, and evaluation without requiring coding. Model Garden is for browsing models but not for interactive testing. Agent Builder is for building agents. Custom training is for production.

Answer

Vertex AI Agent Builder

Answer

Model Garden

Answer

Vertex AI Training

Question 11

A startup wants to quickly prototype a multimodal AI application that can process images and text using Gemini. They have minimal budget and need a free tier for initial development. Which access tier should they use?

Accepted Answer

Google AI Studio. Google AI Studio is the correct choice because it offers a free tier specifically designed for rapid prototyping with Gemini models, including multimodal capabilities for processing images and text. It provides a web-based interface and API access without requiring a billing account, making it ideal for startups with minimal budget. Vertex AI, while powerful, requires a paid Google Cloud project and is intended for production deployment, not free-tier prototyping.

Answer

Vertex AI

Answer

Cloud TPU

Answer

TensorFlow Hub

Question 12

A financial institution wants to deploy a generative AI system for automated report generation. They require that the model does NOT expose sensitive information from its training data and that outputs are factually accurate. Which THREE techniques should they combine?

Accepted Answer

Use Retrieval-Augmented Generation (RAG) to ground outputs in verified documents. Option A is correct because Retrieval-Augmented Generation (RAG) grounds the model's outputs in an external, verified document store at inference time, so factual claims are anchored to authoritative sources rather than the model's parametric memory, directly improving factual accuracy. Option B is correct because training with differential privacy (e.g., DP-SGD) adds calibrated noise to gradients and bounds per-example influence, providing a formal guarantee that the model cannot memorize and expose sensitive training-data details. Option D is correct because Reinforcement Learning from Human Feedback (RLHF) fine-tunes the model against human preference and safety signals, aligning its behavior to refuse leakage and to prefer truthful, accurate responses. Option C does not belong because simply scaling parameters increases capacity and can worsen memorization of training data without any privacy or factuality guarantee. Option E does not belong because raising temperature to 2.0 increases randomness and hallucination, degrading factual accuracy rather than improving it.

Answer

Use a larger model with more parameters

Answer

Increase the temperature to 2.0 for creativity

Question 13

A financial services firm wants to deploy generative AI for automated investment advice. They are subject to strict regulatory oversight requiring explainability and audit trails. Which strategy best meets these requirements?

Accepted Answer

Implement human-in-the-loop with full logging of model inputs, outputs, and human decisions.. It directly addresses the regulatory requirements for explainability and audit trails by incorporating human oversight and comprehensive logging. The human-in-the-loop (HITL) mechanism ensures that critical investment decisions are reviewed by qualified professionals, while full logging of model inputs, outputs, and human decisions creates a transparent, auditable record. This approach satisfies financial regulations like MiFID II or SEC rules that mandate explainability and accountability in automated advice systems.

Answer

Fine-tune a model on historical trading data without human review.

Answer

Use a black-box large language model with monitoring.

Answer

Deploy a rule-based system augmented with generative AI for content generation.

Question 14

A healthcare company is building a clinical decision support system using Gemini 1.5 Pro on Vertex AI. They need responses that are highly accurate and comply with medical regulations, including traceability to source documents. They have a large corpus of curated medical guidelines stored in PDFs in Cloud Storage. Their team has experience with both fine-tuning and prompt engineering. Which approach best ensures regulatory compliance and accuracy?

Accepted Answer

Use a combination of grounding to the medical guidelines and prompt engineering with system instructions specifying compliance requirements.. Grounding the model to the curated medical guidelines in Cloud Storage ensures responses are directly traceable to source documents, which is critical for medical regulatory compliance. Combining this with system instructions that specify compliance requirements (e.g., HIPAA, FDA guidelines) enforces behavioral constraints without altering the model's weights, maintaining accuracy and auditability.

Answer

Use prompt engineering with system instructions and few-shot examples, but no grounding.

Answer

Use grounding to the medical guidelines but rely on prompt engineering only for compliance instructions.

Answer

Fine-tune the model on the medical guidelines corpus to internalize the knowledge.

Question 15

Refer to the exhibit. What is the most likely cause of this error?

Accepted Answer

The user does not have the required IAM role. The error shown in the exhibit is an HTTP 403 Forbidden response, which indicates that the server understood the request but refuses to authorize it. In Google Cloud, this is most commonly caused by the user's identity lacking the necessary IAM role or permission to call the specific API or access the resource. Even if the project ID is correct and the network is functional, a missing IAM role (e.g., `aiplatform.user` or `roles/aiplatform.user`) will result in this exact error.

Answer

The model is too large

Answer

The network is down

Answer

The project ID is incorrect