Data Pipeline Orchestration

You are using Airflow with a Cloud Composer environment. You want to ensure that a specific task runs on a specific day of the week. How do you configure the schedule?

Which TWO of the following are true about Workflows' serverless nature?

What is the primary function of the Airflow 'Executor' in Cloud Composer?

Which THREE of the following are components of a Workflows definition?

Which TWO of the following services can trigger Workflows executions?

A task in your Airflow DAG involves a long-running process that might exceed the default Airflow worker pod timeout. How should you handle this?

Which THREE of the following are key benefits of using Cloud Composer for data orchestration?

In Cloud Composer, what is the default behavior if a DAG execution takes longer than the 'dagrun_timeout' setting?

A Cloud Composer environment is experiencing high latency in the Airflow UI. What is a common cause and mitigation for this?

You need to pass a JSON object into a Workflows execution. How should you format the argument in the 'gcloud workflows executions' command?

Which TWO of the following are best practices for managing Cloud Composer DAG dependencies?

You are migrating a legacy Airflow environment to Cloud Composer. You need to ensure that local Python packages used by custom operators are installed correctly. What is the recommended approach?

Which THREE of the following are valid methods for troubleshooting failed tasks in Cloud Composer?

You are orchestrating a pipeline with Workflows that invokes several Cloud Functions. You need to pass the output of one function as an argument to the next. What is the correct syntax?

Which THREE of the following Cloud Composer 2 features provide improved performance over Composer 1?

Which TWO of the following are valid ways to trigger a Cloud Composer DAG?

Which Cloud Composer metric should you monitor to identify if your Airflow scheduler is struggling to parse your DAGs in a timely manner?

You are deploying a Cloud Composer 2 environment and need to ensure that the DAG files are automatically synchronized to all workers. Where should you store these files?

Which THREE of the following are valid Airflow connection types in Cloud Composer?

A Cloud Composer DAG is failing because the Airflow database is locking up during high-concurrency periods. What is the most effective way to address this?

You are troubleshooting a stuck task in Cloud Composer. You want to see the stdout/stderr logs for that specific task attempt. Where can you find them?

You have a Workflow that must wait for a specific time duration before proceeding. Which step type is most appropriate?

Which property in a Workflows YAML definition is required to define the entry point of the workflow?

Which component of Cloud Composer acts as the primary interface for managing and triggering DAGs manually?

In a Cloud Composer DAG, you need to trigger a BigQuery job that runs as a service account other than the one assigned to the GKE nodes. How should you implement this?

Your organization uses Workflows to orchestrate multi-step API calls. You need to handle transient failures in a specific HTTP request by retrying it up to 5 times with exponential backoff. Which block should you use?

You want to dynamically generate tasks in an Airflow DAG based on the number of files in a GCS bucket. What is the standard way to do this?

Which THREE of the following are common steps in a typical data pipeline orchestration pattern?

Which TWO of the following are common reasons a Workflows execution might stay in a 'PENDING' or 'FAILED' state?

Which command-line tool do you primarily use to deploy and manage Workflows?

You need to run a Workflows execution based on a schedule. Which Google Cloud service is designed to manage this triggering?

Your team needs to audit all modifications made to DAG files in the GCS bucket used by Cloud Composer. What is the most efficient way to achieve this?

When configuring a Workflows execution, you want to ensure the workflow can be triggered by an HTTP POST request. Which feature allows this?

When using Cloud Scheduler to trigger a Workflows execution, what is the best practice for authenticating the scheduler to the Workflows API?

Which TWO of the following strategies help reduce Cloud Composer costs?

You need to run a task in Cloud Composer only if the previous task failed. Which Trigger Rule should you use?