Google Professional Data Engineer Question 270
Select 3Google Cloud PlatformYou are designing a data pipeline on Google Cloud for a global retail company. The pipeline processes customer transactions in real-time and must be highly available, even in the event of regional outages. Which strategies should you use to ensure that the pipeline can run jobs across multiple regions or zones without downtime?
- A
Configure your pipeline to use regional endpoints and replicate data across multiple regions.
- B
Set up a multi-region Cloud Storage bucket for input and output data.
- C
Deploy your data processing jobs in a single zone to minimize costs.
- D
Use Pub/Sub with multiple subscriptions in different regions for message delivery.
- E
Implement zonal affinity to ensure all resources stay within a single zone.
Show answer and explanation
Correct answers: A, B, D
Explanation
To ensure high availability in a global data pipeline, you must design for regional redundancy. Using regional endpoints, multi-region Cloud Storage buckets, and Pub/Sub with multiple regional subscriptions helps protect against outages. Deploying jobs or resources in a single zone or relying on zonal affinity increases the risk of downtime and is not recommended for highly available systems.
- A. Correct.
Correct: Configuring regional endpoints and replicating data across multiple regions ensures high availability and resilience to regional outages.
- B. Correct.
Correct: Multi-region Cloud Storage buckets automatically replicate data across multiple regions, providing durability and availability.
- C. Incorrect.
Incorrect: Deploying jobs in a single zone reduces costs but increases the risk of downtime due to a zonal outage.
- D. Correct.
Correct: Pub/Sub supports global message delivery, and using multiple subscriptions in different regions helps ensure message availability even if one region becomes unavailable.
- E. Incorrect.
Incorrect: Zonal affinity limits resources to a single zone, which can lead to downtime in the event of a zonal failure.