A museum wants to create an application that automatically generates descriptive captions for uploaded photos of artworks. The captions should describe the main subject, scene, and artistic style. Which Azure Computer Vision capability should they use?
Trap 1: Optical Character Recognition (OCR)
Azure's OCR (Optical Character Recognition, provided by the Read API) is specialized for extracting printed or handwritten text from images, returning bounding boxes and the recognized text characters. It does not infer image semantics, scene context, or relationships between visual elements, so it would only capture any literal text painted on an artwork rather than describing its subject or style. For artworks without text, OCR would produce no useful caption at all.
Trap 2: Face API
The Face API performs face detection, recognition, and attribute analysis, such as estimating age, emotion, and facial landmarks. It is strictly scoped to human faces and will not generate meaningful output for landscapes, abstract art, or still-life paintings that lack faces. Even when a face appears in an artwork, the Face API merely labels facial attributes and does not construct a descriptive sentence about the overall image content.
Trap 3: Custom Vision (object detection)
Custom Vision's object detection feature requires you to upload and label training images to create a model that recognizes specific objects, outputting bounding boxes and class labels (e.g., 'cat', 'defect'). It does not generate natural-language descriptions or full sentences, and it would need extensive labeled data for every type of artwork in the museum's collection. This is overkill and misaligned with the general-purpose captioning task, so it is not suitable.
- A
Optical Character Recognition (OCR)
Why wrong: Azure's OCR (Optical Character Recognition, provided by the Read API) is specialized for extracting printed or handwritten text from images, returning bounding boxes and the recognized text characters. It does not infer image semantics, scene context, or relationships between visual elements, so it would only capture any literal text painted on an artwork rather than describing its subject or style. For artworks without text, OCR would produce no useful caption at all.
- B
Image Analysis (with description feature)
The Image Analysis service in Azure AI Vision includes a dedicated 'description' feature that generates human-readable captions by detecting objects, actions, and scene context using a transformer-based neural model. It returns complete sentences with confidence scores, such as 'a person looking at a painting in a museum,' which directly satisfies the need to auto-generate artwork captions. This capability is general-purpose and does not require custom training data, making it the correct choice.
- C
Face API
Why wrong: The Face API performs face detection, recognition, and attribute analysis, such as estimating age, emotion, and facial landmarks. It is strictly scoped to human faces and will not generate meaningful output for landscapes, abstract art, or still-life paintings that lack faces. Even when a face appears in an artwork, the Face API merely labels facial attributes and does not construct a descriptive sentence about the overall image content.
- D
Custom Vision (object detection)
Why wrong: Custom Vision's object detection feature requires you to upload and label training images to create a model that recognizes specific objects, outputting bounding boxes and class labels (e.g., 'cat', 'defect'). It does not generate natural-language descriptions or full sentences, and it would need extensive labeled data for every type of artwork in the museum's collection. This is overkill and misaligned with the general-purpose captioning task, so it is not suitable.