Courseiva
AIF-C01Chapter 15 of 16Objective 5.3

AWS AI Services for Language and Conversation

Failing to make your app understand user speech or translate content means losing customers who speak a different language or who prefer talking over typing. That is why AWS AI Services for Language and Conversation exist: they give your application the ability to hear, speak, read, and translate without you needing a PhD in linguistics or machine learning. For the AIF-C01 exam, you must know which service handles listening (Transcribe), which one speaks (Polly), which one translates (Translate), and which one holds a conversation (Lex).

12 min read
Intermediate
Updated Jul 23, 2026
Reviewed by Johnson Ajibi· Senior Network & Security Engineer · MSc IT Security

A simple way to picture AWS AI Services for Language and Conversation

The Hotel Concierge Analogy

A hotel concierge. That is the person at a fancy hotel who speaks multiple languages, translates menus, writes down voicemails, reads out天气预报, and helps you order room service in a foreign country. They take a messy, human request and turn it into something the hotel staff can act on. You say, 'I need a quiet table for two near a window, no nuts in the food,' and the concierge writes it down, translates it, and hands it to the restaurant manager. That is exactly what AWS AI Services for Language and Conversation do for your applications.

Amazon Translate is the concierge who turns English into Japanese menus instantly. Amazon Transcribe is the concierge who listens to your slurred voicemail and types it out perfectly. Amazon Polly is the concierge who reads the typed note back to the kitchen staff in a clear, calm voice. Amazon Lex is the concierge who understands your garbled request over the phone, figures out you want to book a spa appointment, and passes that intent to the spa team. The concierge never gets tired, never forgets a language, and handles hundreds of guests at once. That is AWS's job: take the messy, multilingual, spoken, or typed mess of human communication and turn it into structured, usable data for your systems. The hotel is your application. The guests are your users. The concierge desk is AWS.

How It Actually Works

AWS offers four main services that handle language and conversation: Amazon Transcribe, Amazon Polly, Amazon Translate, and Amazon Lex. Each one solves a specific human-computer communication problem. They are all fully managed, meaning AWS runs the servers, updates the software, and scales up capacity when demand spikes. You just call an API.

Amazon Transcribe converts speech into text. It uses automatic speech recognition (ASR) technology. Think of ASR as the software equivalent of a court stenographer who types every word spoken in a courtroom. You give Transcribe an audio file or a live audio stream, and it returns a text transcript. It can handle multiple speakers, identify who said what, and even add punctuation. Why does this matter? Before Transcribe, companies had to hire human transcribers or build their own speech recognition models, which required massive amounts of labelled audio data and deep expertise in machine learning. AWS did that work once. Now any developer can add speech-to-text to an app with a few lines of code.

Amazon Polly is the opposite. It converts text into lifelike speech. This is called text-to-speech (TTS) technology. Polly can read out any string of text in dozens of voices and languages. You can choose between standard voices (robotic but fast) and neural voices (natural-sounding, with human-like intonation and emphasis). Neural TTS uses deep learning to predict how a real human would stress syllables and pause between sentences. Why does this exist? Before Polly, developers had to record human voice actors for every possible phrase their app might say, which was expensive and inflexible. Polly lets you generate speech on the fly, for any text, in any language it supports. Common uses: reading aloud news articles, giving voice to a chatbot, or providing audio feedback for visually impaired users.

Amazon Translate translates text between languages. It uses neural machine translation (NMT) models trained on billions of sentence pairs. Unlike older statistical machine translation (which looked like word-by-word substitution and often produced gibberish), NMT considers entire sentences or paragraphs as a single unit. This produces much more accurate and natural-sounding translations. You pass it a source text and a target language code (like 'en' for English, 'fr' for French). It returns the translated text. You can also set up a custom terminology list to force the translation of specific brand names or technical terms. Why is this useful? If your e-commerce site sells to customers in Japan, France, and Brazil, you do not need three separate teams of translators. Translate does the heavy lifting instantly.

Amazon Lex is the conversational AI service. It is the same technology that powers Amazon Alexa. Lex uses automatic speech recognition (the same as Transcribe) plus natural language understanding (NLU). NLU is the part that figures out the user's intention, not just the words. For example, if a user says 'I want to book a flight to London next Tuesday,' Lex identifies the intent (BookFlight) and extracts the entities (destination: London, date: next Tuesday). It then triggers a Lambda function (a piece of code you write) to actually book the flight in your database. Lex can handle both voice and text input. Why build with Lex instead of coding a chatbot from scratch? Building NLU models is incredibly hard. Lex gives you a pre-trained engine that you simply configure with your intents, sample utterances, and slot types.

These four services are often used together. A common pattern: a user speaks into a phone, Transcribe turns that speech into text, Lex interprets the text and triggers a database action, Polly reads the result back to the user in a natural voice, and Translate converts the entire exchange if the user speaks a different language. This combination is called a conversational AI pipeline. The exam will ask you to identify which service belongs at each stage of this pipeline.

All four services integrate with other AWS services. Transcribe can output transcripts directly to Amazon S3 (a storage service) or Amazon Comprehend (a service that analyses sentiment). Polly can generate audio files and store them in S3. Lex logs conversations to Amazon CloudWatch Logs for debugging. Translate can process documents stored in S3. Knowing these integrations is exam-relevant because the questions often present a scenario with multiple AWS services and ask you to pick the correct combination.

Pricing for each service is usage-based. You pay per second of audio processed (Transcribe), per character of text synthesised (Polly), per character of text translated (Translate), and per request processed (Lex). There are free tiers for experimentation. The exam may ask which pricing model applies to which service, though this is tested less frequently than the core functionality.

Flowchart showing how a user input moves through Transcribe or Translate into Lex, then to a backend action, and finally to Polly or text response.

Walk-Through

1

Identify the Input Type

Determine whether your user is speaking into a microphone (audio input), typing text, or providing a pre-recorded audio file. This dictates the first service. Audio input points to Transcribe or Lex. Text input points to Translate or Lex.

2

Select the Processing Service

If you need a transcript for storage or analysis, choose Amazon Transcribe. If you need to understand the user's intention and hold a conversation, choose Amazon Lex. If you need to translate written text, choose Amazon Translate.

3

Configure Intents and Slots (for Lex)

If using Lex, define the user's possible goals (intents) like 'OrderPizza' or 'CheckWeather'. For each intent, list example phrases the user might say (utterances), and identify pieces of information you need to collect (slots) like pizza size or delivery address.

4

Build the Response

Decide how your application will reply. If the reply must be spoken aloud, use Amazon Polly to convert your response text into audio. If the reply must be in a different language, pass it through Amazon Translate first. Lex can handle both steps internally if configured.

5

Integrate with Backend and Monitor

Connect your services to a backend function (often AWS Lambda) that executes the user's intent, such as querying a database or placing an order. Enable logging with Amazon CloudWatch to capture errors and user utterances for debugging and improvement.

6

Test and Iterate

Use the AWS Console for each service to test your configuration. For Lex, run sample utterances in the test window. For Transcribe, upload sample audio files. Adjust custom vocabularies, sample utterances, or SSML tags based on test results to improve accuracy.

What This Looks Like on the Job

An IT professional, perhaps a solutions architect at a call centre software company, is tasked with building a multilingual voice assistant that handles customer returns. The scenario: a Spanish-speaking customer calls to return a jacket. The system must understand the speech, validate the order, and confirm the return in Spanish.

Step 1: The architect selects Amazon Lex as the core conversational engine. They define an intent called 'ReturnOrder' with sample utterances like 'quiero devolver una chaqueta' and 'I want to return a jacket'. They add a slot for the order number, which Lex will ask for if not provided. The architect configures Lex to use Amazon Polly for voice responses, choosing the neural Spanish voice 'Lucia' so the replies sound natural.

Step 2: The architect sets up Amazon Transcribe to handle the speech-to-text piece. But Lex actually includes its own built-in ASR, so in this scenario the architect uses Lex's native speech recognition rather than calling Transcribe separately. This is a key decision point: Lex can handle both text and voice natively, while Transcribe is typically used when you need a standalone transcript for record-keeping or analysis. The architect chooses to use Lex's built-in ASR to minimise latency and cost.

Step 3: For the translation requirement, the architect uses Amazon Translate to handle the Spanish-to-English conversion of the order details internally. When the customer gives their order number, Lex extracts it. The architect's backend Lambda function then calls Translate to translate the customer's spoken reason for return from Spanish to English, so the English-speaking return processing team can read it. The confirmation message is sent back through Lex and Polly in Spanish, so the customer never sees the English side.

Step 4: The architect configures Lex to fall back to a human agent if the user says 'agent' or if Lex's confidence score drops below 0.7. This is a standard pattern for production deployments. Lex integrates with Amazon Connect (a cloud contact centre service) to transfer the call to a human operator with the conversation history.

Step 5: The architect sets up monitoring. They enable Amazon CloudWatch Logs to capture all utterances and responses. They also enable Amazon Comprehend to detect sentiment in the transcripts, flagging angry customers for priority routing. The architect tests the bot in the Lex console simulator, adjusting sample utterances when the bot misinterprets certain phrases.

What does the architect actually do day to day? They spend time defining intents and slots, writing the Lambda function that queries the order database, testing pronunciation in Polly by using SSML tags (Speech Synthesis Markup Language — a way to add pauses and emphasis), and reviewing transcription logs to improve the bot's accuracy. They do not train machine learning models from scratch. They do not hire linguists. They configure AWS services. That is the exam's focus: knowing which service to use for which task, not the deep math behind it.

How AIF-C01 Actually Tests This

The AIF-C01 exam tests your ability to match a real-world requirement to the correct AWS AI service for language and conversation. This appears in multiple-choice format, often with scenario-based questions. You will see a short paragraph describing a business need and four AWS service options. You must pick the right one.

Key exam patterns:

Question type 1: 'Which service converts speech to text?' Answer: Amazon Transcribe. Trap: they might list Polly (text to speech) or Lex (conversational AI). Remember the direction: speech in, text out = Transcribe. Text in, speech out = Polly.

Question type 2: 'Which service translates a live chat conversation from French to English?' Answer: Amazon Translate. Trap: they might say Transcribe, but Transcribe only converts speech to text, it does not translate languages. Translate is the only one that converts from one written language to another.

Question type 3: 'Which service would you use to build a chatbot that can place pizza orders over the phone?' Answer: Amazon Lex. Trap: they might suggest Polly for the voice output (which is part of the solution) but Lex is the service that handles the conversation logic and intent recognition. Polly is just the voice output component within Lex.

Question type 4: 'Which service generates audio from a written news article for a podcast?' Answer: Amazon Polly. Trap: Transcribe. Remember Polly synthesises speech, Transcribe analyses it.

Question type 5: Scenario with multiple services: 'A travel app allows users to speak their destination in German. The app must turn that speech into text, translate to English, then read the translation aloud.' Correct sequence: Transcribe -> Translate -> Polly. Lex could replace Transcribe if you needed conversational flow, but a simple one-shot translation does not need Lex.

Common traps:

Confusing Transcribe and Translate: they sound similar but one is for audio, one is for text.

Forgetting that Lex includes built-in speech recognition and text-to-speech: Lex can handle the same job as Transcribe and Polly in a conversational context. The exam may ask when to use Lex versus a combination of Transcribe + Polly. The answer: use Lex when you need a back-and-forth dialogue with intent recognition. Use Transcribe and Polly separately when you need one-way processing.

Assuming all four services are always needed together: each service can run independently. The exam will test that understanding.

Specific concepts to memorise:

Neural voices versus standard voices in Polly: neural sounds more natural but costs more per character.

Lex slots and intents: an intent is the user's goal (e.g., BookHotel). A slot is a required piece of information (e.g., check-in date). The exam may use the term 'utterances' to mean example phrases.

Custom vocabulary in Transcribe: you can add domain-specific words (e.g., medical terms) to improve accuracy.

Custom terminology in Translate: forces specific translations for brand names.

SSML tags in Polly: allows control over pronunciation, pauses, and emphasis. The exam might present a scenario where a developer needs to change how a word is pronounced and ask what technology to use.

The exam will not ask you to write code or configure these services. It will ask you to recognise the correct service for a described task, and to understand what each service's main features are. Practise by reading scenarios out loud and asking yourself: is this about speech, text, translation, or conversation?

Key Takeaways

Amazon Transcribe converts speech to text and supports custom vocabulary for domain-specific words, but it does not translate languages.

Amazon Polly converts text to speech using either standard or neural voices, and you can control pronunciation with SSML tags.

Amazon Translate converts text from one language to another using neural machine translation and supports custom terminology for brand names.

Amazon Lex builds conversational chatbots that can understand intent, extract slot data, and respond via text or voice, using built-in ASR and TTS.

The four services are often used in a pipeline: Transcribe for speech-to-text, Translate for language conversion, Lex for dialogue management, and Polly for text-to-speech output.

Lex includes its own speech-to-text and text-to-speech capabilities, so you do not automatically need Transcribe and Polly when building a voice chatbot with Lex.

Easy to Mix Up

These come up on the exam all the time. Here's how to tell them apart.

Amazon Transcribe

Converts speech to text only

No understanding of user intent

Output is a static transcript

Amazon Lex

Converts speech to text AND understands intent

Detects user goals and extracts slot data

Engages in back-and-forth dialogue

Amazon Polly

Turns text into speech (Text-to-Speech)

Input is written text

Output is an audio file or stream

Amazon Transcribe

Turns speech into text (Speech-to-Text)

Input is audio file or stream

Output is written text

Amazon Translate

Input and output are both written text

Changes language of the text

Does not process audio at all

Amazon Transcribe

Input is audio, output is written text

Keeps the same language

Does not change the language

Amazon Lex (with voice)

Includes speech recognition and dialogue logic

Can trigger backend code based on user intent

Output is typically a response, not standalone audio

Amazon Polly

Only converts text to speech

No dialogue logic or intent recognition

Produces audio files or streams on demand

Watch Out for These

Mistake

Amazon Transcribe can translate languages while transcribing.

Correct

Transcribe converts speech to text in the original language. It does not translate. Amazon Translate handles language translation separately.

The words 'transcribe' and 'translate' sound similar, and people assume one service does both. Also, some vendors combine these features, but AWS keeps them separate.

Mistake

Amazon Polly can understand the meaning of the text it reads.

Correct

Polly only converts text into speech. It does not understand or analyse the text's meaning, sentiment, or context. That would require Amazon Comprehend.

Beginners think that because a voice sounds natural, the AI must 'understand' what it says. Text-to-speech does not involve comprehension.

Mistake

Amazon Lex automatically works with any language without configuration.

Correct

Lex supports multiple languages, but you must explicitly configure each language version of your bot separately, including defining intents and sample utterances for each language.

People assume AWS handles multilingual support magically, but each language requires its own training data and configuration. It is not automatic.

Mistake

You must always use Transcribe if you want to process voice input in any application.

Correct

Amazon Lex has built-in automatic speech recognition (ASR). You can process voice directly through Lex without separately calling Transcribe. Transcribe is used when you need a standalone transcript, not when you need a conversational flow.

Because Transcribe's name explicitly mentions 'transcription', people assume any voice processing must go through it. They forget that Lex includes ASR as a built-in component.

Do You Actually Know This?

Reveal each answer, then mark whether you got it right. Score 60%+ to unlock the next chapter.

Frequently Asked Questions

Can Amazon Transcribe translate Spanish to English at the same time as transcribing?

No. Transcribe only converts speech to text in the original language. To translate the resulting text, you must pass it to Amazon Translate separately.

What is the difference between Amazon Lex and Amazon Polly?

Polly only turns text into speech. Lex is a full conversational AI service that can understand user intent, manage a dialogue, and optionally use Polly for voice output. Polly is a component that Lex can use internally.

Do I need to train custom machine learning models to use Amazon Translate?

No. Amazon Translate comes with pre-trained neural machine translation models for dozens of languages. You only need to train a custom model if you have domain-specific jargon or a specialised parallel corpus, using Amazon Translate Custom Terminology or Custom Translation.

Can Amazon Lex handle multiple languages in the same bot?

Yes, but you must create a separate language version of your bot for each language, with its own set of sample utterances and slot types. Lex does not automatically translate between languages.

Is there a free tier for Amazon Polly?

Yes, AWS offers a free tier for Polly that includes a certain number of characters per month for standard and neural voices. Check the current AWS Free Tier page for exact limits, as they can change.

What is SSML and why would I use it with Polly?

SSML stands for Speech Synthesis Markup Language. It is a set of tags you add to your text to control how Polly speaks, like adding pauses, changing emphasis, or pronouncing words phonetically. Use it when the default pronunciation is incorrect.

Terms Worth Knowing

Keep going

You've finished AWS AI Services for Language and Conversation. Continue through the AIF-C01 study guide to build a complete picture of the exam.

Done with this chapter?