A team is building a batch prediction pipeline that processes raw data from Cloud Storage, performs complex preprocessing, and then runs predictions using a large model. The preprocessing step is compute-intensive and the prediction step is I/O-bound. Which TWO Google Cloud services should they combine to optimize cost and performance? (Choose 2)
Trap 1: Cloud Functions to preprocess data row by row
Cloud Functions has timeout and scalability limitations for large volumes.
Trap 2: Cloud Run to serve the preprocessed data as an API
Cloud Run is for online serving, not batch preprocessing.
Trap 3: Vertex AI Batch Prediction with BigQuery source
BigQuery source is not suitable for complex preprocessing; Dataflow is better.
- A
Dataflow for preprocessing and writing results to Cloud Storage
Dataflow can perform complex transforms at scale.
- B
Cloud Functions to preprocess data row by row
Why wrong: Cloud Functions has timeout and scalability limitations for large volumes.
- C
Cloud Run to serve the preprocessed data as an API
Why wrong: Cloud Run is for online serving, not batch preprocessing.
- D
Vertex AI Batch Prediction with Cloud Storage source
Batch Prediction reads preprocessed data from GCS efficiently.
- E
Vertex AI Batch Prediction with BigQuery source
Why wrong: BigQuery source is not suitable for complex preprocessing; Dataflow is better.