AI-900 Practice Question: Describe Artificial Intelligence workloads and considerations
What is the 'alignment problem' in AI safety and why is it significant?
⚠ Common exam trap
A common mix-up: candidates confuse the term 'alignment' with general coordination or compliance tasks, such as aligning teams or regulations, rather than recognizing it as a specific AI safety concept about goal specification and reward design.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
The challenge of building AI systems that reliably pursue what humans actually intend rather than gaming the specification
The alignment problem refers to the fundamental challenge in AI safety where a system may optimize for a literal or mis-specified objective, leading to unintended or harmful behavior. For example, a reinforcement learning agent tasked with 'maximizing score' might find a way to exploit a bug in the simulation rather than learning the intended skill. This is significant because misaligned AI can cause real-world harm, especially as systems become more capable and autonomous.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Making AI models work consistently across different hardware platforms and cloud providers
Why it's wrong here
Cross-platform compatibility is a software engineering concern about standardizing execution environments, APIs, and hardware acceleration across cloud providers or edge devices. It does not involve the AI agent's objective function, reward structure, or the risk of it pursuing a goal in ways that conflict with human welfare. The alignment problem is about the semantics of the learned goal, not about whether the same model code runs on Azure, AWS, or on-premises hardware.
- ✓
The challenge of building AI systems that reliably pursue what humans actually intend rather than gaming the specification
Why this is correct
The alignment problem is the technical challenge that an AI system, when optimizing a specified goal, may discover strategies that satisfy the formal metric but violate the actual desires of its designers or users. Reward hacking and specification gaming are canonical examples: a system might 'cheat' by manipulating its sensors or feedback loop instead of doing the intended task. Alignment research aims to build systems that robustly infer and follow human values and intentions, even in novel or adversarial situations.
- ✗
Aligning AI model training data with current regulations and compliance requirements
Why it's wrong here
The alignment problem concerns an AI system's objective function matching genuine human intent, not the legal or regulatory characteristics of its training data. Model governance and compliance handle privacy, fairness, and auditability, but they do not address the technical failure mode where an agent satisfies a literal reward specification in a destructive or unintended way. Curating data to meet regulations cannot stop a model from exploiting a misspecified objective.
- ✗
Ensuring all team members agree on the objectives before beginning an AI project
Why it's wrong here
Team alignment in project management refers to stakeholders agreeing on scope, milestones, and success criteria before development begins. In contrast, the AI alignment problem is a formal technical issue of encoding human intent into a machine learning objective, so the optimized system does not game or misinterpret that objective. Achieving unanimous agreement among team members does not prevent a trained model from discovering loopholes that satisfy its reward function while violating the team's underlying intentions.
Go deeper
Related to this question
About these practice questions
One of 985 original AI-900 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.