Databricks-GenAI-Assoc Exam Simulation 1 — 100 Questions

Question 1

A GenAI engineer is building a RAG application on Databricks. They have registered a foundation model endpoint in Unity Catalog as a model. The application needs to query the endpoint, and the engineer wants to ensure that only members of the group 'genai_team' can invoke it. Which Unity Catalog privilege must be granted on the model object to allow invocation?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

EXECUTE. To invoke a model registered in Unity Catalog, a user must have the EXECUTE privilege on that model. Granting EXECUTE to the genai_team group ensures that only its members can call the model endpoint, aligning with the requirement to restrict access. Other privileges like SELECT, USE, or CREATE do not authorize model invocation.

Answer

USE

Answer

SELECT

Answer

CREATE

Question 2

An organization is deploying a GenAI application using Databricks Model Serving. Which TWO steps are required to ensure the deployment environment handles model governance and observability effectively?

Accepted Answer

Enable Unity Catalog for the registered model and its versions.. Effective model governance and observability require integrating Unity Catalog for centralized access control and MLflow for tracking inference payloads. These components allow organizations to monitor model performance, lineage, and bias over time. Mastering these tools ensures that production deployments remain compliant, transparent, and auditable, which is essential for regulated industries using generative AI to make data-driven decisions while minimizing operational risks associated with model drift and unauthorized access.

Answer

Hardcode API credentials within the model inference script.

Answer

Disable automatic scaling to maintain consistent latency.

Answer

Manually deploy the model via the standard cluster user interface.

Question 3

Refer to the exhibit. What is the most likely cause for this error in a production RAG application?

Accepted Answer

Network connectivity between Model Serving and the vector store is misconfigured.. The error indicates a network timeout when connecting to the vector store. This is a common connectivity issue between the serving endpoint and the data source. Investigating network security groups, firewall rules, or DNS resolution issues within the Databricks environment is necessary to resolve it. Ensuring robust, low-latency connectivity to the retrieval source is fundamental for reliable RAG performance and minimizing application downtime in production.

Answer

The model is too large for the GPU memory.

Answer

The model weights are corrupted.

Answer

The input prompt is too long for the model.

Question 4

Which Databricks feature is best suited for maintaining the lineage of data used during the preparation of training sets for Generative AI?

Accepted Answer

Unity Catalog. Unity Catalog provides centralized governance, including automated data lineage tracking. This allows engineers to trace the source of data used for model training, which is vital for reproducibility and regulatory compliance. Knowing the exact provenance of training data helps in troubleshooting model bias and ensures that sensitive data sources are correctly identified and managed throughout the lifecycle of the model training process.

Answer

Delta Lake Time Travel

Answer

Cluster Policies

Answer

MLflow Experiments

Question 5

Refer to the exhibit. What is the impact of min_instances: 0 on this deployment?

Accepted Answer

The endpoint will scale to zero when idle, reducing costs.. Setting min_instances to 0 in Databricks Model Serving enables 'scale-to-zero'. This feature is highly effective for cost optimization, as it automatically shuts down the GPU resources when no traffic is present. Upon receiving a new request, the endpoint will automatically scale up, though this may introduce a slight 'cold start' latency. This trade-off is often acceptable for non-critical or low-traffic services to drastically reduce infrastructure costs.

Answer

The endpoint will be permanently disabled.

Answer

The endpoint will have higher latency than a fixed instance.

Answer

The endpoint will be restricted to CPU usage only.

Question 6

A team needs to provide fine-grained access control to an LLM application that uses a vector index stored in a Delta table. Which Unity Catalog feature should they use to restrict access to specific rows based on user identity?

Accepted Answer

Row-level security (RLS). Row-level security (RLS) in Unity Catalog allows administrators to define policies that filter data returned from tables based on the user's identity. By applying these policies to the Delta table used as a knowledge base, the team ensures that the LLM only retrieves information the user is authorized to see. This is essential for compliance and security in multi-tenant or sensitive information application environments.

Answer

Column-level masking

Answer

Workspace-level permissions

Answer

Access Control Lists (ACLs)

Question 7

An enterprise LLM application on Databricks is experiencing high latency and inconsistent responses. Which approach best enables observability to identify the root cause of these performance bottlenecks within the LLM pipeline?

Accepted Answer

Use MLflow Tracing to record inputs, outputs, and execution duration of each step in the chain.. Integrating MLflow Tracing provides granular visibility into the execution flow, including model inputs, outputs, and latency per step. This is critical for diagnosing complex chains where intermediate calls may be stalling. By instrumenting the code, engineers can identify which specific retrieval step or prompt generation block is contributing to the high latency, allowing for targeted optimization of the RAG pipeline components.

Answer

Enable standard Spark UI logs to monitor cluster resource utilization during inference.

Answer

Review the Databricks SQL query history to identify slow retrieval operations.

Answer

Deploy an external monitoring agent to scan the model server network traffic.

Question 8

A Generative AI engineer is building a Delta Live Tables pipeline that ingests raw JSON event logs into a bronze table, then uses ai_query to classify each event's free-text field. The classification call is expensive, so the engineer wants to avoid re-running it on events that have already been processed in previous pipeline updates. The source table is append-only and new events arrive continuously. Which Delta Live Tables feature should the engineer configure on the bronze table to prevent reprocessing of previously ingested rows?

Accepted Answer

Configure the bronze table as a streaming table so it processes only new data on each pipeline update.. An append-only bronze ingestion table should be defined as a streaming table so each pipeline update consumes only new source records. This makes expensive operations like ai_query run once per new event rather than on the full history. Materialized views and batch-style definitions re-read all source data, and storage properties like Auto Optimize only affect file layout, not incremental read behavior.

Answer

Add a QUALIFY clause that filters out rows where the classification column is already populated.

Answer

Enable change data capture by setting pipelines.cdcEnabled to true on the bronze table.

Answer

Set the table property pipelines.autoOptimize.managed to true on the bronze table.

Question 9

A data team is developing a Mosaic AI Agent application. Which TWO of the following are mandatory for deploying this application using the Databricks Model Serving infrastructure?

Accepted Answer

A logged model signature defining input and output schemas. Deploying Mosaic AI Agents requires defining a signature for the model input/output and ensuring the agent code is packaged with its dependencies. These steps are crucial because the Serving environment needs to understand how to route requests and instantiate the environment. Properly defining the signature ensures type safety during inference, while dependency management prevents runtime errors, ensuring the agent operates as expected within the serverless environment.

Answer

A manual provisioning of a dedicated GPU worker pool

Answer

A hardcoded API key for external vector store access

Answer

A pre-configured Kubernetes manifest file

Question 10

What is the primary benefit of using MLflow Model Evaluation for generative AI applications compared to manual evaluation methods?

Accepted Answer

It enables consistent, repeatable evaluation metrics across different model versions.. MLflow Model Evaluation provides a standardized framework to calculate metrics like RAGAS and perform side-by-side comparisons of model versions. By automating this process, organizations can ensure consistency across releases, track performance history over time, and reduce human bias. This systematic approach allows teams to make data-driven decisions when deciding whether to promote a model to production, ensuring reliability and auditability in the AI lifecycle.

Answer

It automatically rewrites the prompt templates based on user feedback.

Answer

It removes the need for ground truth datasets during the testing phase.

Answer

It creates the vector index automatically from raw unstructured data.

Question 11

When evaluating LLM outputs, which TWO metrics are most appropriate for measuring the 'quality' of a response in a RAG system? (Choose two)

Accepted Answer

Faithfulness. Answering quality in RAG requires looking at two distinct dimensions: the correctness of the content (faithfulness) and the relevance of the answer to the user's intent. Faithfulness ensures the model remains grounded in the provided evidence, while answer relevance captures whether the model actually addressed the specific user question. These metrics provide a balanced view, ensuring the system is both accurate and useful, which is essential for end-user satisfaction.

Answer

Inference Latency

Answer

GPU Utilization

Answer

Training Iterations

Question 12

A developer needs to deploy a custom Python model that requires non-standard library dependencies. Which MLflow feature should the developer use to specify these environment requirements during model logging?

Accepted Answer

MLflow environment requirements (pip_requirements). When logging a custom model with MLflow, the developer should use the `pip_requirements` or `conda_env` parameter in the `mlflow.pyfunc.log_model` function. This ensures that the environment is correctly packaged and reproducible. During deployment, the Databricks Model Serving service reads these requirements to recreate the identical software environment, preventing runtime errors caused by missing dependencies when the model is loaded and served in the production environment.

Answer

Model Schema definition

Answer

Global workspace library settings

Answer

Custom model signatures

Question 13

Refer to the exhibit. An engineer wants to perform a canary deployment by routing 10% of traffic to a new version (version 6). How should the JSON traffic configuration be modified?

Accepted Answer

Add a new route for version 6 and set its traffic_percentage to 10, then set version 5 to 90.. Canary deployments involve splitting traffic between an established model version and a new candidate. To achieve this, the 'routes' list must include both versions, with the 'traffic_percentage' values summing to 100%. This controlled rollout allows teams to monitor the performance and accuracy of the new model on a small segment of production traffic before committing the full load to the new version.

Answer

Set the traffic_percentage of version 6 to 10 and keep version 5 at 100.

Answer

Remove version 5 and set version 6 to 10.

Answer

Create a new endpoint entirely for version 6 and switch the DNS record.

Question 14

A data scientist is using Databricks to fine-tune a large language model. The training data is stored in a Unity Catalog table that contains sensitive customer information. The data scientist needs to read the table but should not be able to see the raw values of certain columns. Which Unity Catalog feature should be used to dynamically mask the sensitive columns based on the user's group membership?

Accepted Answer

Dynamic column masking. Dynamic column masking in Unity Catalog enables the data scientist to see masked values for sensitive columns based on their group membership. By applying a column mask that checks group membership, the raw values are hidden from unauthorized users while still allowing the data scientist to read the table for fine-tuning.

Answer

Column-level encryption

Answer

Attribute-based access control

Answer

Row-level security

Question 15

When evaluating the performance of a RAG application, which metric is most useful for measuring the quality of the retrieved context?

Accepted Answer

Context Precision.. Context Precision measures how much of the retrieved information is actually relevant to the user query. This is a critical metric for RAG systems because high retrieval precision directly reduces the noise in the LLM input, leading to more accurate and focused answers. Measuring this allows engineers to iteratively improve the retrieval pipeline, which is essential for maximizing the utility of the application.

Answer

Total number of documents retrieved.

Answer

The total latency of the RAG pipeline.

Answer

The number of parameters in the LLM.

Question 16

Refer to the exhibit. An engineer is configuring a canary deployment for a churn prediction model. Based on the provided traffic configuration, what is the expected behavior of the endpoint?

Accepted Answer

90% of requests are routed to churn_v1 and 10% to churn_v2.. The configuration implements a traffic-splitting strategy, directing 90% of requests to 'churn_v1' and 10% to 'churn_v2'. This is a standard pattern for A/B testing or canary releases, allowing teams to validate new models in production with minimal risk. By monitoring the performance of the 10% traffic slice, engineers can decide whether to promote the model, ensuring stability before a full rollout.

Answer

The endpoint will error because total traffic must equal 100% for each model version individually.

Answer

The endpoint will only route traffic to churn_v1 after churn_v2 reaches capacity.

Answer

The endpoint will round-robin requests between v1 and v2 regardless of the weights.

Question 17

Which CI/CD approach for model deployment best minimizes downtime during a model update?

Accepted Answer

Use a blue-green deployment pattern.. A blue-green deployment strategy is the gold standard for minimizing downtime. By spinning up a new version of the model (green) alongside the existing one (blue) and switching traffic only after verifying the health of the green endpoint, engineers ensure zero downtime and an immediate rollback path if issues occur. This approach is critical for high-availability AI services where any interruption would negatively impact users.

Answer

Delete the old model and immediately deploy the new version.

Answer

Deploy all updates directly to the production endpoint.

Answer

Schedule deployments during peak traffic hours.

Question 18

When evaluating a generative AI model using the Mosaic AI Model Evaluation tool, what is the primary purpose of providing a 'baseline' dataset?

Accepted Answer

To provide a reference for comparative performance analysis.. A baseline dataset serves as a ground-truth reference point. By comparing the model's current outputs against this known high-quality set, engineers can objectively measure performance degradation or improvement. This benchmarking approach is fundamental to scientific model evaluation, ensuring that updates to the model or data retrieval logic do not silently introduce regressions in the quality of the generated answers during the deployment process.

Answer

To increase the number of tokens the model can generate.

Answer

To act as a secondary training set for fine-tuning.

Answer

To optimize the vector database search latency.

Question 19

Which TWO of the following are mandatory requirements for developing an AI application using the Databricks Mosaic AI Model Serving environment?

Accepted Answer

The model must be registered as a model version within a Unity Catalog schema.. Mosaic AI Model Serving requires specific configurations to ensure secure and performant access. Firstly, the model must be registered in Unity Catalog to maintain governance and lineage. Secondly, the serving endpoint requires defined compute resources, typically GPU-accelerated for LLMs, to handle inference requests. These requirements are essential for productionizing models, as they ensure that models are discoverable, governed, and have the necessary hardware to meet low-latency performance targets in real-time scenarios.

Answer

The model must be stored in a legacy Databricks Workspace folder.

Answer

The model must be served using a shared-access mode interactive cluster.

Answer

The application code must perform manual model sharding across nodes.

Question 20

An engineer is designing a Databricks RAG application that must support multi-turn conversations where follow-up questions refer to earlier turns. They want the retrieval step to remain accurate as the conversation progresses. Which TWO design elements should they include? (Choose two.)

Accepted Answer

Maintain a conversation history buffer and condense prior turns into a standalone query before invoking Vector Search.. Conversational RAG needs two coordinated elements: a rewritten, standalone query for retrieval, and conversation history for generation. Rewriting resolves references so Vector Search returns on-topic chunks, while including prior turns helps the model produce coherent follow-ups. Simply enlarging the retrieval window or removing filters does not address the ambiguity that multi-turn questions introduce.

Answer

Increase the number of retrieved chunks for every turn to compensate for conversational ambiguity.

Answer

Store the conversation history in the prompt and pass it unchanged to the retriever as the search query.

Answer

Disable metadata filtering during multi-turn conversations so more historical documents are eligible.