Google Professional Machine Learning Engineer Question 242
Select 2Google Cloud PlatformYou are working on a machine learning project where you need to process data stored in multiple formats, including CSV files, JSON logs, images, and data from a relational database. Which combination of Google Cloud services would you use to efficiently ingest and store this data for further processing?
- A
Cloud Storage for storing CSV files, images, and JSON logs, and Cloud SQL for relational database data
- B
BigQuery for directly loading all data types, including images, JSON, and CSV files
- C
Dataflow for transforming and loading CSV and JSON data into Cloud Storage or BigQuery
- D
Cloud Pub/Sub for streaming ingestion of images and JSON logs
- E
AI Platform for directly ingesting and storing all file types
Show answer and explanation
Correct answers: A, C
Explanation
Effective ingestion of diverse file types in Google Cloud requires using the right tools for each data format. Cloud Storage is a scalable option for unstructured data like CSV files, JSON logs, and images, while relational data can be stored in Cloud SQL. Dataflow is an excellent choice for transforming and moving data between storage and processing systems. This combination ensures a robust and efficient data ingestion pipeline.
- A. Correct.
Correct. Cloud Storage is well-suited for storing unstructured data like CSV files, images, and JSON logs, while Cloud SQL is ideal for handling relational database data. This is a common and effective combination.
- B. Incorrect.
Incorrect. BigQuery is a powerful analytics data warehouse but is not designed for directly storing unstructured data like images. It is better suited for structured or semi-structured data.
- C. Correct.
Correct. Dataflow is a highly versatile tool for transforming and loading data into destinations like Cloud Storage or BigQuery, making it an important part of the ingestion pipeline.
- D. Incorrect.
Incorrect. Cloud Pub/Sub is designed for real-time messaging and streaming data, but it is not ideal for storing large files like images or structured data from relational databases.
- E. Incorrect.
Incorrect. AI Platform is primarily a tool for building, training, and deploying machine learning models, not for data ingestion or storage.