AI Associate AI Fundamentals Practice Test 4 — 15 Questions

Question 1

In Salesforce Data Cloud, which AI capability is used to automatically generate audience segments based on customer behavior patterns?

Accepted Answer

Einstein AI (Data Cloud's machine learning capabilities). Einstein AI in Salesforce Data Cloud provides machine learning capabilities that automatically analyze customer behavior patterns, such as purchase history and engagement metrics, to generate predictive audience segments. This enables marketers to target specific groups without manual rule creation, leveraging Data Cloud's unified data model and Einstein's propensity scoring.

Answer

Prompt Builder

Answer

Einstein Discovery

Answer

Einstein GPT

Question 2

A data scientist is evaluating a custom Einstein model for a lead scoring use case. The model's precision is 0.9, recall is 0.5. What is the most important improvement priority?

Accepted Answer

Increase recall to reduce false negatives. With a precision of 0.9 and recall of 0.5, the model is highly selective but misses many actual leads (high false negatives). In lead scoring, false negatives mean lost sales opportunities, which is typically more costly than false positives. Therefore, increasing recall to capture more true positives is the most important improvement priority.

Answer

Increase precision to reduce false positives

Answer

Optimize for an F1 score of 0.7

Answer

Improve overall accuracy above 80%

Question 3

A retail company implements an AI chatbot to recommend products. After launch, they notice the chatbot frequently suggests expensive items to budget-conscious customers. Which AI bias is most likely occurring?

Accepted Answer

Sample bias (biased training data). The chatbot's frequent suggestion of expensive items to budget-conscious customers indicates that the training data was biased toward high-cost products, leading the model to learn and replicate that preference. This is a classic case of sample bias (biased training data), where the dataset does not accurately represent the target user population, causing systematic errors in the model's recommendations.

Answer

Confirmation bias

Answer

Anchoring bias

Answer

Overconfidence bias

Question 4

What is the primary purpose of Einstein Studio in the Salesforce AI ecosystem?

Accepted Answer

Train, test, and deploy custom AI models using AutoML. Einstein Studio is specifically designed to allow users to train, test, and deploy custom AI models using AutoML, without requiring deep data science expertise. It provides a no-code interface for building models on Salesforce Data Cloud data, enabling predictive scoring and recommendations directly within the Salesforce ecosystem.

Answer

Create and manage prompt templates

Answer

Unify customer data from multiple sources

Answer

Deploy pre-built Einstein GPT models

Question 5

Which TWO of the following are ethical considerations when deploying AI in Salesforce?

Accepted Answer

Providing transparency in AI-generated outcomes. Transparency in AI-generated outcomes is a core ethical principle, especially in Salesforce's Einstein platform, where users must understand how predictions (e.g., lead scoring or opportunity insights) are made. Salesforce provides tools like 'Why This Prediction?' to explain model outputs, ensuring trust and accountability. Without transparency, users cannot validate or challenge AI decisions, leading to potential bias or misuse.

Answer

Maximizing model complexity for better accuracy

Answer

Using only historical data without review for biases

Question 6

Which THREE factors can affect the accuracy of an Einstein GPT response?

Accepted Answer

Model temperature setting. The model temperature setting directly controls the randomness of the output. A higher temperature (e.g., 0.9) produces more creative but potentially less accurate responses, while a lower temperature (e.g., 0.1) makes the model more deterministic and factual. This parameter is a core hyperparameter in large language models like those powering Einstein GPT, and it significantly influences response accuracy.

Answer

Brightness of the user interface

Answer

Length of the response generated

Question 7

Refer to the exhibit. A developer configured a grounding policy for Einstein GPT. What is the effect of the fallbackBehavior set to 'USE_MODEL_KNOWLEDGE'?

Accepted Answer

The AI will rely on its pre-trained knowledge when no grounding data meets the relevance threshold. When fallbackBehavior is set to 'USE_MODEL_KNOWLEDGE', the Einstein GPT grounding policy instructs the AI to fall back to its pre-trained (model) knowledge if the retrieved grounding data does not meet the configured relevance threshold. This ensures the AI still generates a response based on its internal training rather than returning no answer or ignoring the policy entirely.

Answer

The AI will return all retrieved grounding data in the response

Answer

The AI will not generate a response if no grounding data is found

Answer

The AI will ignore the grounding policy and only use model knowledge

Question 8

Refer to the exhibit. A Salesforce admin runs an audit command for an Einstein model. What conclusion can be drawn from the output?

Accepted Answer

The model's average response time of 350ms is within typical performance expectations. The output shows an average response time of 350ms for the Einstein model, which is within the typical performance expectation of under 500ms for real-time AI inference in Salesforce. This indicates the model is responding efficiently without significant latency issues, making option C correct.

Answer

Token usage indicates the average response length is 300 tokens

Answer

The model experienced significant slowdowns

Answer

The model has a high error rate and needs retraining

Question 9

Refer to the exhibit. A data scientist built a model using training data where 80% of leads were won. The model achieved 80% accuracy. What is the main issue with this evaluation?

Accepted Answer

Accuracy is not a reliable metric because the data is imbalanced. Correct: Accuracy is misleading due to class imbalance; a model that always predicts 'won' would get 80% accuracy. Option A: Data size is fine. Option B: XGBoost is good for tabular data. Option D: Confidence score not provided.

Answer

The model lacks confidence scoring

Answer

The algorithm choice (XGBoost) is inappropriate

Answer

The training data size is insufficient

Question 10

A sales manager wants to automatically prioritize leads based on their likelihood to convert. Which Einstein feature should the admin enable?

Accepted Answer

Einstein Lead Scoring. Einstein Lead Scoring uses historical data to predict lead conversion probability and assign scores, enabling prioritization.

Answer

Einstein Activity Capture

Answer

Einstein Prediction Builder

Answer

Einstein Bot

Question 11

A company wants to use Einstein Discovery to analyze sales data and automatically uncover key drivers of deal closure. What must the admin provide to create a story?

Accepted Answer

At least one numeric field to predict. Einstein Discovery requires at least one numeric field as the prediction target (e.g., deal amount, probability score) to train its regression or classification model. Without a numeric field to predict, the story cannot define what outcome the AI should analyze or uncover key drivers for.

Answer

A date field for time series analysis

Answer

A foreign key to relate objects

Answer

A text field for sentiment analysis

Question 12

A service team trains an Einstein Bot on historical chat transcripts. After deployment, the bot frequently fails to understand customer intents. Which action is most likely to improve performance?

Accepted Answer

Add more diverse training phrases per intent. Adding more diverse training phrases per intent directly addresses the root cause of the bot's failure to understand customer intents: insufficient coverage of the varied ways customers express the same goal. Einstein Bot uses natural language understanding (NLU) models that rely on example phrases to learn intent patterns; increasing the diversity of these phrases improves the model's ability to generalize to unseen utterances, reducing misclassification.

Answer

Increase the confidence threshold to 90%

Answer

Use a hierarchical intent structure

Answer

Reduce the number of intents to two

Question 13

An admin creates a predictive model in Einstein Prediction Builder to forecast customer churn. The model shows high accuracy on test data but poor performance in production. What is the most likely cause?

Accepted Answer

Data drift between training and production environments. The model's high accuracy on test data but poor performance in production is a classic symptom of data drift. In Einstein Prediction Builder, the model was trained on historical data that may not reflect current customer behavior patterns, leading to a mismatch between training and production distributions. This is not a model training issue but a data environment shift.

Answer

Improper feature scaling in the training pipeline

Answer

The model is overfitted to the training data

Answer

Target leakage in the training dataset

Question 14

A data scientist notices that an Einstein Discovery model predicts a low probability of conversion for all leads in a new campaign, even though the campaign targets high-value accounts. Which initial diagnostic step should be taken?

Accepted Answer

Compare the feature distributions of the training and campaign data. The most likely cause of a model predicting low conversion for all leads in a new campaign is a shift in feature distributions between the training data and the campaign data (covariate shift). Checking these distributions is the standard initial diagnostic step to identify if the model is encountering data it was not trained on, which would invalidate its predictions. This aligns with best practices for model monitoring and data validation in Einstein Discovery.

Answer

Retrain the model with the new campaign data included

Answer

Check the Einstein model recipe for incorrect filters

Answer

Increase the prediction confidence threshold

Question 15

A marketing manager wants to use AI to recommend next-best actions for customers based on their previous purchases. Which Einstein feature is most appropriate?

Accepted Answer

Einstein Recommendations. Einstein Recommendations is the correct choice because it is specifically designed to analyze customer purchase history and behavioral data to suggest next-best actions, such as products or content, in real time. It uses collaborative filtering and deep learning models to generate personalized recommendations, directly matching the use case of suggesting actions based on previous purchases.

Answer

Einstein Discovery

Answer

Einstein Bot

Answer

Einstein Prediction Builder