Azure AI Fundamentals and Solution Planning is the blueprint for building any intelligent application on Microsoft's cloud. It defines the crucial process of analysing a business problem, understanding available AI tools, and designing a solution that is ethical, secure, and cost-effective before writing a single line of code. For the AI-102 exam, this foundation is essential because every question about deploying a model or calling an API hinges on understanding why you chose that specific approach in the first place.
Jump to a section
A simple way to picture Azure AI Fundamentals and Solution Planning
A restaurant kitchen is a complex system of tools, ingredients, and skilled workers.
Planning a new AI solution on Azure is like planning a major kitchen renovation for a busy restaurant. You don't just buy a new oven and hope for the best. First, you analyse your menu (the problem you want to solve). What dishes do customers keep asking for that you cannot make? Maybe you need a faster way to chop vegetables (automate document processing) or a system to predict how many steaks to order each week (forecast demand). Next, you inspect your existing kitchen layout (current IT infrastructure). Do you have enough gas lines (network bandwidth) and counter space (compute power)? Then comes sourcing: you do not build a stove from scratch; you choose a pre-built, powerful model from a trusted supplier, like Azure's pre-trained AI services. You consider your budget (cost management) and your head chef's skills (your team's expertise). Finally, you decide if the new equipment will be installed in your kitchen (on-premises) or if you will use a cloud catering service that handles everything (fully managed PaaS). This entire planning phase ensures you buy exactly what you need, avoid electrical fires, and serve better food — not just buy the shiniest new gadget.
Azure AI Fundamentals and Solution Planning is the systematic process of defining the 'what' and 'why' before the 'how' of building an AI project. It is a structured approach to problem solving that ensures you invest time and money into the right solution for the right problem. This is not about writing code — it is about creating a clear roadmap to guide development.
At its core, the process begins with requirement analysis. You ask: what is the actual business problem? A common trap is to start with a cool AI technology and try to force it onto a problem. Instead, you must start with the problem itself. For example, a hospital wants to reduce the time doctors spend reading radiology reports. The requirement is not 'we need a Generative AI model' — it is 'we need to surface key findings faster'. This leads you to explore several possible Azure services.
The next major concept is feasibility assessment. Not every problem benefits from AI. You must evaluate if you have enough high-quality data. If you only have 50 patient records, training a large neural network is impossible. You also need to consider the ethical implications. Will the AI produce biased results? Microsoft provides the Responsible AI Standard as a framework. For the exam, you must recognise that every AI solution must be evaluated for fairness, reliability, safety, privacy, security, inclusiveness, transparency, and accountability.
Once the problem is defined and deemed feasible, you move to solution planning. This involves selecting the right Azure service for the job. Azure offers three main tiers:
Pre-built AI services (Azure AI Services): These are ready-to-use APIs for common tasks like recognising objects in images (Azure AI Vision), extracting text from documents (Azure AI Document Intelligence), or translating languages (Azure AI Translator). You do not need to train or manage a model. You just call the API.
Custom AI services that you train (Azure Machine Learning): You use this when you have unique data and need to train a model from scratch or fine-tune an existing one. This gives you full control but requires significant expertise and data.
Generative AI using Azure OpenAI Service: This is for tasks that involve creating new content, like writing summaries, generating code, or building chatbots. It uses powerful Large Language Models (LLMs) — advanced neural networks trained on vast amounts of text.
Your solution plan must also define the architecture: how data flows, where the AI model lives, and how users interact with it. For instance, will the model be deployed as a real-time endpoint that responds in milliseconds, or will it run as a batch process overnight? This maps to concepts like compute (CPU/GPU power), storage (where data sits, like Azure Blob Storage), and networking (how services talk to each other, using virtual networks and firewalls).
Finally, cost management and governance are critical. In the cloud, you pay for what you use. You must estimate usage—how many API calls per month, how long the compute runs. You also need to set up access control using Microsoft Entra ID to ensure only authorised users can call the AI service or view the data. The plan must include monitoring (using Azure Monitor and Application Insights) and a strategy for retraining the model when new data arrives, to prevent 'model drift' where predictions become less accurate over time.
In summary, Azure AI Fundamentals and Solution Planning is the blueprint that prevents you from building an AI solution that solves the wrong problem, costs too much, or produces harmful results. It is the single most important step for passing the AI-102 exam because every subsequent topic—deployment, security, ethics—is built on this planning foundation.
Define the Business Problem
Interview stakeholders to identify the specific pain point. For example, 'mortgage processing takes 45 minutes per application due to manual data entry.' This step ensures you solve the right problem.
Analyse Data Availability and Quality
Evaluate if you have enough labelled, clean data to train or fine-tune a model. If not, you may need to use a pre-built API or plan a data labelling project.
Choose the Right Azure Service Tier
Based on data and problem, select between Azure AI Services (pre-built), Azure Machine Learning (custom), or Azure OpenAI Service (generative AI). Document the justification for your choice.
Design the Architecture and Plan for Security
Map out data flow, choose the Azure region for data residency, decide on compute and storage, and configure Microsoft Entra ID for authentication. This step ensures the solution is secure and performant.
Estimate Costs and Set Governance Policies
Use the Azure Pricing Calculator to project monthly costs. Set up budget alerts, resource locks, and define who can create or modify resources. This step prevents financial surprises.
A large UK retail bank wants to automate the processing of mortgage application forms to reduce approval times. An IT professional specialising in AI would begin with a discovery session with the mortgage team. They would ask: what does the process look like today? What data is used? What is the bottleneck? The answer: loan officers manually read dozens of pages of PDFs and enter key data like income, property value, and applicant name into a system. This takes 45 minutes per application and is prone to typos.
The professional then evaluates the requirements. The goal is to extract specific fields from unstructured documents. They consider Azure AI Document Intelligence, which is purpose-built for this. They check if the current PDFs are scanned images or text-based, which affects the optical character recognition (OCR) settings. They also assess data privacy: applicant data is highly sensitive, so the solution must run on Azure's UK South region to comply with GDPR, and the data must never leave that boundary.
Next, they build a simple prototype using the Azure AI Document Intelligence Studio. They upload a sample form, see which fields are correctly extracted, and adjust the model configuration. They run a cost calculator: 10,000 applications per month at £0.50 per thousand pages comes to a manageable figure. They also plan for failure modes: what if the form is handwritten? They decide to build a fallback process that routes unrecognised forms to a human reviewer (human-in-the-loop design).
For deployment, the professional sets up an Azure Logic App that triggers whenever a new PDF lands in an Azure Blob Storage container. The Logic App calls the Document Intelligence API, extracts the JSON output, and writes it into a SQL database. They configure monitoring in Azure Application Insights to track API call latency and error rates. They set up a cost alert to notify the team if usage spikes unexpectedly. Finally, they document the entire architecture and present it to the bank's security team for approval. This step-by-step, methodical planning is the difference between a successful deployment and a costly failure that frustrates users and wastes money.
The AI-102 exam tests your ability to apply the planning process, not just recall definitions. Expect scenario-based multiple-choice questions where you are given a business problem and must select the correct Azure service or approach. The exam loves to set traps around false distinctions. For example, they will ask you when to use Azure Machine Learning versus Azure AI Services. The correct pattern is: use Azure AI Services (pre-built APIs) when the task is common and you have no custom data requirements. Use Azure Machine Learning when you need to train a model on your own labelled dataset.
Another common trap is the 'Responsible AI' principle. The exam will offer answers that suggest ignoring fairness because it is too costly. The correct answer always aligns with all six principles mandated by Microsoft: fairness, reliability, safety, privacy, security, inclusiveness, transparency, and accountability. A wrong answer will justify a shortcut.
Key definitions to memorise:
Azure AI Services: Pre-built, managed APIs for vision, speech, language, and decision tasks.
Azure Machine Learning: A platform for building, training, and deploying custom machine learning models.
Azure OpenAI Service: Access to large language models for generating text, code, and images.
Responsible AI: The framework ensuring AI is developed ethically.
Cost Calculator: Tool to estimate monthly costs.
Microsoft Entra ID: Identity and access management service for controlling who can access the AI resource.
The exam will also test your knowledge of the 'discovery' phase. They might present a vague requirement like 'improve customer service' and ask what the first step is. Your answer must be 'perform a feasibility analysis to determine if the available data and technology can solve the specific problem.' They often list 'deploy the model immediately' as a distractor.
Finally, expect questions on the 'human-in-the-loop' concept. They want you to recognise that for high-risk applications like healthcare or finance, you must design a system where a human reviews the AI's output before it takes action. This is a core part of the planning stage.
To pass, you must be able to justify your choice of service in terms of cost, data requirements, customisation need, and ethical constraints. Practise reading scenarios and eliminating the two obviously wrong options first, then choose between the remaining two based on the specific details provided.
Always start an AI project by defining the business problem, not by selecting a technology.
Use pre-built Azure AI Services for common tasks like image recognition or translation; use Azure Machine Learning for custom models on proprietary data.
Every Azure AI solution must be evaluated against all six Microsoft Responsible AI principles: fairness, reliability, safety, privacy, security, inclusiveness, transparency, and accountability.
Cost management, including using the Azure Pricing Calculator, is a mandatory part of solution planning.
High-risk AI applications require a human-in-the-loop review process to be planned from the beginning.
Access control for AI solutions is managed through Microsoft Entra ID, which must be configured during the planning phase.
These come up on the exam all the time. Here's how to tell them apart.
Azure AI Services
Pre-built APIs for common tasks.
No custom training or data needed.
Faster to deploy, lower initial cost.
Azure Machine Learning
Platform for building custom models.
Requires labelled training data.
Full control over model, higher cost.
Cost Estimation
Done during planning phase using calculator.
Predicts monthly spend.
Focuses on input numbers like API calls.
Cost Optimisation
Ongoing process after deployment.
Reduces waste through rightsizing.
Uses tools like Azure Advisor.
Responsible AI Principles
Ethical framework: fairness, transparency, etc.
Mandatory for all AI solutions.
Checked during planning and testing.
System Requirements
Technical specifications: latency, storage, compute.
Defined by the business need.
Used to design the architecture.
Microsoft Entra ID
Manages user identities and permissions.
Supports multifactor authentication.
Granular control over who accesses the AI.
API Keys
Simple secret string for programmatic access.
No user identity management.
Less secure; should be rotated regularly.
Mistake
Planning an AI solution just means picking the most advanced model available, like GPT-4.
Correct
Planning is a multi-step process that starts with defining the business problem and assessing feasibility, not with picking a model.
Beginners are excited by the hottest technology and want to use it immediately, skipping the critical analysis that prevents expensive mistakes.
Mistake
If I have good data, I should always train my own custom machine learning model for the best accuracy.
Correct
Pre-built Azure AI Services are often cheaper, faster to deploy, and perfectly adequate for common tasks. Custom training is only needed when the pre-built APIs cannot handle your specific data format or domain.
There is a bias towards 'do it yourself' for control, but cloud providers have invested heavily in their pre-built models which already handle millions of variations.
Mistake
Ethical AI considerations are optional and can be handled after the solution is deployed.
Correct
Responsible AI principles must be incorporated into the planning phase from the very start, as they affect data selection, model choice, and architecture design.
Many think ethics is an add-on, but Microsoft mandates it for all AI solutions. Ignoring it during planning can lead to costly rework or regulatory fines.
Mistake
Cost estimation is unnecessary because Azure services are cheap.
Correct
Running AI models, especially large ones, can become very expensive at scale. Accurate cost estimation during planning prevents budget overruns.
The 'pay-as-you-go' model is appealing, but beginners often underestimate the cumulative cost of thousands of API calls or hours of GPU compute time.
Reveal each answer, then mark whether you got it right. Score 60%+ to unlock the next chapter.
No, this planning phase is about analysis and decision-making. You learn to choose the right service and architecture — coding comes later in development.
Azure AI Services are pre-trained APIs you call directly. Azure Machine Learning is a platform where you build, train, and deploy your own models using your data.
It means a human must review and approve the AI's output before it takes action. This is planned for high-risk cases to prevent errors and ensure ethical use.
The first step is always to define the business problem you are solving. You do not pick the technology until you understand the problem completely.
Yes, for security and governance. Microsoft Entra ID controls who can call your AI resource, preventing unauthorised usage and data breaches.
Use the Azure Pricing Calculator, input the expected number of API calls or compute hours, and the service tier. This gives you a monthly estimate to include in your plan.
You've finished Azure AI Fundamentals and Solution Planning. Continue through the AI-102 study guide to build a complete picture of the exam.
Done with this chapter?