NCP-GENL Data Preparation Practice Test 2 — 15 Questions

Question 1

When training a model for a highly technical domain with a scarcity of high-quality data, which data augmentation strategy is most likely to preserve the model's reliability?

Accepted Answer

Generating synthetic examples based on ground-truth technical documentation templates.. In technical domains, synthetic data generation must be grounded in existing, verified documents to avoid 'hallucinating' technical facts. Using LLMs to paraphrase or summarize existing high-quality technical content while maintaining strict constraints ensures that the new data follows the same logic and terminology. This method expands the training set while minimizing the risk of introducing incorrect facts, which is essential for high-stakes technical domains.

Answer

Randomly masking 50% of the words in the training documents.

Answer

Using a smaller, unverified LLM to generate completely new technical scenarios.

Answer

Translating the dataset into multiple languages using a generic online translator.

Question 2

You are fine-tuning a LLM on a large corpus of technical documentation. You notice the model struggles with domain-specific terminology that frequently appeared in the training data but was inconsistently formatted. Which data preparation technique best addresses this issue?

Accepted Answer

Applying consistent text normalization and domain-specific tokenization rules.. Consistent normalization, such as lemmatization or standardizing case and special characters, ensures the tokenizer treats synonymous terms identically. In NVIDIA NeMo workflows, data quality directly impacts convergence speed and model accuracy. By reducing vocabulary noise during the preprocessing stage, the model can dedicate more capacity to learning semantic relationships rather than mapping variants of the same technical term to different embedding spaces, ultimately improving downstream performance on domain-specific benchmarks.

Answer

Increasing the batch size during the training phase.

Answer

Expanding the model's depth with additional transformer layers.

Answer

Reducing the learning rate to prevent overfitting on the noise.

Question 3

You are preparing a massive dataset for training a NeMo-based LLM. Which TWO data preprocessing steps are critical to prevent data leakage and ensure model quality?

Accepted Answer

Performing temporal or content-based splitting to isolate the validation set.. Data leakage occurs when test data is inadvertently included in the training set, leading to inflated performance metrics. Deduplication is equally vital, as repetitive data causes the model to memorize samples rather than generalize. In NVIDIA workflows, these steps are typically performed via distributed scripts on the cluster before tokenization, ensuring that the model learns unique, non-overlapping information across all shards.

Answer

Increasing the frequency of data augmentation in the training pipeline.

Answer

Adding metadata tags to all training sequences for classification.

Answer

Converting all text to lowercase to increase vocabulary efficiency.

Question 4

Refer to the exhibit. You are reviewing the configuration file for a data preprocessing pipeline. Why is the 'min_words' filter set to 50 in the context of LLM training?

Accepted Answer

It removes low-quality snippets to ensure meaningful semantic context.. The 'min_words' filter removes low-information or malformed snippets that lack sufficient context for effective transformer learning. In large-scale training, such as those performed on NVIDIA H100 GPU clusters, including very short strings increases noise and consumes valuable compute cycles without contributing to meaningful semantic representation. Setting a minimum length ensures the model learns from coherent passages rather than disjointed fragments, promoting better structural understanding of the training corpus.

Answer

It limits the memory footprint of the dataloader.

Answer

It enables faster tokenization by reducing the number of input files.

Answer

It forces the model to ignore PII-heavy documents.

Question 5

An enterprise is preparing a massive multi-terabyte corpus of specialized PDF documents containing technical schematics and dense tables for training a domain-specific LLM using NeMo Curator. During the document extraction pipeline, you notice that tabular data layouts are scrambled into unstructured string tokens, destroying spatial relationships. Which data preparation strategy should you implement first within NeMo Curator to preserve tabular integrity before tokenization?

Accepted Answer

Deploy NeMo Curator's layout-aware PDF extraction modules featuring visual bounding box detection to parse tables into structured Markdown formatting.. NeMo Curator provides specialized PDF extraction utilities that leverage advanced computer vision and layout parsing models to accurately identify bounding boxes for tables and figures. Preserving tabular markdown structures prevents spatial collapse, ensuring downstream tokenizers capture relational data accurately. This step is critical in domain-specific LLM training because scrambled tables introduce severe noise that degrades reasoning capabilities.

Answer

Apply aggressive regex-based whitespace removal across all extracted string buffers to normalize sentence boundaries prior to embedding generation.

Answer

Increase the chunk size parameter in the tokenizer configuration so that entire table blocks fit inside a single oversized context window.

Answer

Convert all PDF pages into low-resolution JPEG images to bypass text extraction errors and feed raw pixels directly into a text-only causal language model.

Question 6

You are curating a 2 TB corpus of NVIDIA technical documentation and Python code for continued pretraining of a NeMo-based LLM. A colleague proposes filtering out any document containing the token sequence 'CUDA' to reduce hardware-specific bias. What is the most appropriate response?

Accepted Answer

Reject the filter, because removing documents based on a single high-signal domain token destroys the domain-specific signal the model needs and is better handled by deduplication and quality scoring.. Keyword-based deletion of a domain-defining token is a destructive filter, not a quality filter. Effective NeMo data curation relies on deduplication, quality heuristics, and classifier scoring to remove low-value or redundant records while preserving coherent, in-domain technical content. The corpus exists to teach NVIDIA-specific concepts, so removing 'CUDA' would directly undermine the training objective.

Answer

Accept the filter, because removing every occurrence of a hardware-specific token guarantees the model will not overfit to NVIDIA-specific APIs and will generalize better to other vendors.

Answer

Accept the filter but apply it only to documents where 'CUDA' appears more than ten times, since low-frequency occurrences are harmless and high-frequency ones indicate redundant marketing material.

Answer

Accept the filter, because NVIDIA NeMo requires that proprietary product names be excluded from pretraining corpora to comply with the model card's data provenance requirements.

Question 7

A team is building an instruction-tuning dataset in NeMo from 40,000 internal support tickets. Each ticket contains a customer problem and a resolved answer, but the resolution text sometimes includes the customer's name, account number, and internal case IDs. The team plans to use NeMo Curator to produce training-ready JSONL. Which approach best prepares this data for instruction tuning while limiting personally identifiable information exposure?

Accepted Answer

Run a PII redaction stage that detects and replaces names, account numbers, and case IDs with placeholders, then convert problem-resolution pairs into the instruction, input, and output schema before export.. Sensitive identifiers must be removed from the corpus before training, not mitigated after the fact. Running a PII detection and replacement stage in NeMo Curator, then mapping problem-resolution pairs into the instruction, input, and output schema, produces compliant JSONL that the fine-tuning job can consume directly. This ordering keeps identifiers out of both the training data and the resulting model weights.

Answer

Hash the entire ticket text with a cryptographic digest and train on the hashes, since the model can learn the mapping between hashed problems and hashed answers without ever seeing the original identifiers.

Answer

Convert the tickets into instruction, input, and output JSONL first, then fine-tune the model and rely on a post-training output filter to block any generated response that contains an account number or customer name.

Answer

Drop every ticket whose resolution contains any digit, since account numbers and case IDs always contain numeric characters, and train only on the remaining text-only resolutions.

Question 8

You are using NVIDIA NeMo Curator to filter a 600 GB web-crawl corpus before pre-training. Your team wants to remove exact duplicates and near-duplicates to reduce memorization and speed up training. Which NeMo Curator stage should you apply?

Accepted Answer

ExactDuplicates and FuzzyDuplicates stages. NeMo Curator's ExactDuplicates and FuzzyDuplicates stages are purpose-built for removing redundant documents. ExactDuplicates handles byte-level matches, while FuzzyDuplicates uses MinHash and LSH to catch near-identical texts. Together they reduce corpus size without discarding unique content, which directly lowers memorization risk and training cost on a large web-crawl dataset.

Answer

HeuristicFilter stage with a quality threshold

Answer

DocumentDownloader stage followed by DocumentResolver

Answer

ClassifierFilter stage using a domain classifier

Question 9

You are preparing a large instruction-tuning dataset with NVIDIA NeMo Curator. The dataset contains many near-duplicate instruction-response pairs that differ only in punctuation or minor wording. Which NeMo Curator stage should you apply to remove these near-duplicates before fine-tuning?

Accepted Answer

Fuzzy deduplication using MinHash locality-sensitive hashing.. Near-duplicate instruction-response pairs that differ only slightly require fuzzy matching, not exact hashing or heuristic quality filters. MinHash locality-sensitive hashing estimates Jaccard similarity between records and clusters near-identical ones, letting you retain a single representative. Applying fuzzy deduplication in NeMo Curator reduces redundancy, prevents the model from overfitting repeated patterns, and improves generalization on the instruction-tuning task.

Answer

Exact substring deduplication to remove overlapping text spans.

Answer

Heuristic filtering to remove short or malformed records.

Answer

Exact duplicate removal using a hash of the full instruction-response pair.

Question 10

You are preparing a large instruction-tuning dataset for an NVIDIA NeMo-based LLM. The raw data consists of user queries and assistant responses collected from a customer support system, stored as JSON lines. During preprocessing, you notice that many responses contain personally identifiable information (PII) such as names, email addresses, and phone numbers. You need to ensure the dataset is safe for training while preserving as much semantic content as possible. Which approach is most appropriate for handling PII in this dataset?

Accepted Answer

Use a named entity recognition (NER) model to detect PII and replace each entity with a generic placeholder (e.g., [NAME]).. Replacing PII with generic placeholders using an NER model is the most balanced approach: it removes sensitive information while preserving the linguistic patterns and context needed for instruction tuning. This method aligns with NVIDIA NeMo's data preprocessing recommendations for responsible AI. It also avoids the pitfalls of discarding data or introducing unintelligible tokens.

Answer

Leave the PII intact but exclude the dataset from production use and train only in a sandbox environment.

Answer

Hash each detected PII string with SHA-256 and substitute the hash into the text.

Answer

Apply a rule-based regex filter to remove any line containing PII, then train on the remaining data.

Question 11

A team is preparing a customer-support chat dataset for instruction fine-tuning of an LLM. The raw data contains HTML tags, inconsistent date formats, and emoji. Which data preparation step should be performed first to make the text usable for tokenization?

Accepted Answer

Normalize and clean the text. Cleaning and normalizing the raw chat data first removes HTML, standardizes dates, and handles emoji, producing consistent text for tokenization. This order prevents noisy artifacts from becoming tokens and ensures both training and validation splits receive the same treatment. It is the foundational step before tokenization and dataset splitting.

Answer

Tokenize the text with the model's tokenizer

Answer

Convert the text to lowercase

Answer

Split the dataset into train and validation sets

Question 12

A team is building a NeMo-based LLM pipeline and must tokenize a corpus that mixes English, Japanese, and Python source code. They plan to train a custom tokenizer with NVIDIA NeMo. Which tokenizer configuration best supports all three content types without excessive sequence length?

Accepted Answer

Byte-level Byte-Pair Encoding with a vocabulary of 64,000 to 128,000 tokens trained on a balanced sample of all three content types.. Byte-level BPE with a large vocabulary trained on a balanced multilingual and code sample handles arbitrary scripts and symbols without unknown tokens. It compresses common English words, Japanese subwords, and Python identifiers into single tokens, controlling sequence length. Training on all three distributions aligns merge statistics with actual usage, unlike English-only or Japanese-only training, and the 64k-128k range provides enough capacity for multilingual plus code coverage.

Answer

SentencePiece unigram tokenizer trained exclusively on Japanese text.

Answer

WordPiece tokenization trained only on the English portion of the corpus.

Answer

Byte-Pair Encoding with a vocabulary limited to 8,000 tokens.

Question 13

You are preparing a 2 TB corpus of English and German web text for continued pretraining of a NeMo-based LLM. The German portion includes many pages with unescaped HTML entities and mixed-language sentences. Which NeMo Curator stage should you apply to remove boilerplate, fix HTML artifacts, and filter low-quality documents before tokenization?

Accepted Answer

NeMo Curator's text cleaning and heuristic filtering pipeline, including HTML unescaping, language identification, and quality classifier stages.. NeMo Curator is the correct tool because it supplies production-grade stages for HTML unescaping, language identification, and quality filtering that operate on large-scale text before tokenization. These stages directly address the German/English mixed-language and malformed HTML issues. The other options are training, runtime safety, or serving components, none of which clean a pretraining corpus.

Answer

NeMo's Megatron-LM pretraining script with an increased dropout rate on the embedding layer.

Answer

NeMo Guardrails with a custom Colang flow that blocks documents containing HTML tags.

Answer

NVIDIA Triton Inference Server with a Python backend that preprocesses each document at inference time.

Question 14

You are preparing a dataset of customer reviews for fine-tuning an LLM to generate concise summaries. The reviews are in multiple languages, but the target summaries must be in English. You have a limited budget for translation. Which data preparation step is most critical to ensure the fine-tuned model produces high-quality English summaries?

Accepted Answer

Ensure that each training example pairs a review in its original language with a high-quality English summary.. Pairing original-language reviews with English summaries directly trains the model for cross-lingual summarization, which is the end goal. This avoids translation errors and preserves the original semantics. It also prepares the model for real-world multilingual inputs, ensuring it can generate English summaries without an intermediate translation step.

Answer

Translate all reviews into English and then train the model to summarize English text.

Answer

Use a multilingual LLM to translate all non-English reviews into English before training.

Answer

Filter the dataset to include only reviews originally written in English.

Question 15

You are preparing a dataset for continued pre-training of an LLM on internal engineering documents. The corpus contains many documents with boilerplate headers, footers, and legal disclaimers repeated across files. Which NeMo Curator approach best reduces this boilerplate while preserving unique technical content?

Accepted Answer

Use the n-gram or sentence-level deduplication stage to remove repeated spans. Span-level deduplication in NeMo Curator detects repeated n-grams or sentences across documents and removes them, which precisely targets boilerplate headers, footers, and legal disclaimers. Unlike document-level filtering, it preserves the unique technical content within each file, making it the best choice for a corpus where redundancy is localized rather than whole-document.

Answer

Apply a heuristic filter that drops documents below a word-count threshold

Answer

Lowercase all text and remove punctuation

Answer

Split documents into fixed-size chunks and keep only the first chunk