Drag and drop the steps to evaluate a trained model using SageMaker Model Monitor in the correct order.
Drag steps to the numbered slots on the right, or tap a step then tap a slot.
Trap 1: Step 1: Create a baseline from training data
Incorrect: Creating a baseline before enabling data capture would leave no live data to compare against. Data capture must be enabled first to accumulate data for monitoring.
Trap 2: Step 1: Enable data capture on the endpoint
Incorrect: Scheduling the monitoring job before creating the baseline fails because the baseline is required for drift detection. Also, baseline comes after data capture.
Trap 3: Step 1: Create a baseline from training data
Incorrect: Scheduling before enabling capture means no data to monitor, and baseline before capture is unnecessary without live data.
- A
Step 1: Enable data capture on the endpoint. Step 2: Create a baseline from training data. Step 3: Schedule the monitoring job. Step 4: Review the monitoring reports.
Correct order: Enable data capture to start collecting inference data, then create a baseline from training data, schedule the monitoring job, and finally review reports.
- B
Step 1: Create a baseline from training data. Step 2: Enable data capture on the endpoint. Step 3: Schedule the monitoring job. Step 4: Review the monitoring reports.
Why wrong: Incorrect: Creating a baseline before enabling data capture would leave no live data to compare against. Data capture must be enabled first to accumulate data for monitoring.
- C
Step 1: Enable data capture on the endpoint. Step 2: Schedule the monitoring job. Step 3: Create a baseline from training data. Step 4: Review the monitoring reports.
Why wrong: Incorrect: Scheduling the monitoring job before creating the baseline fails because the baseline is required for drift detection. Also, baseline comes after data capture.
- D
Step 1: Create a baseline from training data. Step 2: Schedule the monitoring job. Step 3: Enable data capture on the endpoint. Step 4: Review the monitoring reports.
Why wrong: Incorrect: Scheduling before enabling capture means no data to monitor, and baseline before capture is unnecessary without live data.