Google Professional Data Engineer Question 19
Select 3Google Cloud PlatformYou are designing a data pipeline on Google Cloud for processing financial transactions in real-time. The system needs to handle high availability, ensure data integrity, and be resilient to failures. Which of the following design choices would most effectively ensure reliability and fidelity in the system?
- A
Implementing a multi-region deployment for the pipeline components
- B
Using Cloud Pub/Sub with message ordering and dead-letter topics enabled
- C
Choosing a single-zone deployment to minimize latency
- D
Enabling retries and idempotency in processing logic
- E
Storing your transaction data in a regional Cloud Storage bucket
Show answer and explanation
Correct answers: A, B, D
Explanation
Designing for reliability and fidelity requires ensuring high availability, data integrity, and fault tolerance. Multi-region deployments protect against regional failures, while features like message ordering, retries, and idempotency ensure accurate and reliable data processing. Together, these design choices help build a robust system for financial transactions.
- A. Correct.
Implementing a multi-region deployment ensures high availability and resilience to regional failures, which is crucial for reliability in a financial transaction system.
- B. Correct.
Using Cloud Pub/Sub with message ordering and dead-letter topics ensures reliable delivery, processing order, and handling of failed messages, which is critical for data fidelity.
- C. Incorrect.
A single-zone deployment may reduce latency but compromises availability and resilience, making it unsuitable for reliability requirements.
- D. Correct.
Enabling retries and idempotency in processing logic helps ensure data is processed correctly even in the case of transient errors, contributing to system reliability and fidelity.
- E. Incorrect.
Storing transaction data in a regional Cloud Storage bucket does not provide the same level of availability or fault tolerance as multi-region storage options, making it less ideal for a highly reliable system.