NCP-GENL LLM Architecture Practice Question
A developer is building a retrieval-augmented generation pipeline and needs to choose a component that produces dense vector representations of passages for semantic search. The passages are up to 512 tokens long, and the developer wants a model specifically trained to map semantically similar text to nearby points in embedding space. Which type of model should be selected?
⚠ Common exam trap
The trap here is assuming any transformer can serve as an embedding model, when in fact only models trained with a contrastive or similar objective produce reliable dense vectors for semantic search.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
A bidirectional encoder model trained with a contrastive objective on sentence pairs.
Dense retrieval requires a model that maps each passage to a single vector such that semantically similar passages are close in the embedding space. Bidirectional encoders trained with contrastive objectives are purpose-built for this, producing high-quality passage embeddings efficiently. Generative LLMs, cross-encoders, and summarization models are designed for other tasks and do not provide the required independent passage vectors.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
An autoregressive sequence-to-sequence model fine-tuned for summarization.
Why it's wrong here
A sequence-to-sequence summarization model generates text and is not trained to produce fixed-size embeddings for similarity search. Its encoder states could be pooled, but without a contrastive training objective the resulting vectors would not reliably reflect semantic similarity. This model type is designed for generation tasks, not for dense retrieval indexing.
- ✗
A cross-encoder that jointly encodes the query and passage.
Why it's wrong here
A cross-encoder jointly processes the query and passage and outputs a relevance score, but it does not produce independent dense vectors for passages. It is used for reranking a small candidate set, not for first-stage retrieval over a large corpus, because it must run once per query-passage pair. This makes it unsuitable for building a searchable passage index.
- ✗
A decoder-only generative LLM fine-tuned for instruction following.
Why it's wrong here
A decoder-only generative LLM is optimized to predict the next token, not to produce a single fixed-size embedding for semantic similarity. While hidden states can be pooled into a vector, this is not its primary training objective, and the resulting embeddings are typically inferior to those from a dedicated embedding model. Using it for retrieval would also be computationally heavier than necessary.
- ✓
A bidirectional encoder model trained with a contrastive objective on sentence pairs.
Why this is correct
Bidirectional encoders trained with contrastive objectives, such as sentence-transformer style models, are explicitly optimized to place semantically similar passages close together in vector space. They produce a single dense embedding per passage and are efficient for semantic search over 512-token chunks. This matches the developer's requirement for a model specifically trained for embedding-based retrieval.
About these practice questions
This NCP-GENL question is part of Courseiva's 352-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official NVIDIA exam blueprint
This NCP-GENL practice question is part of Courseiva's free NVIDIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the NCP-GENL exam.