Google Associate Cloud Engineer Question 147
Select 3Google Cloud PlatformYou are a Google Cloud Engineer tasked with loading a large CSV file into BigQuery for analysis. The file is stored in a Google Cloud Storage bucket. Which of the following steps should you take to efficiently load the data into BigQuery while minimizing cost and ensuring data accuracy?
- A
Use the BigQuery web UI to manually upload the file directly from your local machine.
- B
Use the BigQuery Data Transfer Service to automate the import from Cloud Storage.
- C
Set up a Cloud Function to trigger the load process whenever a new file is uploaded to the Cloud Storage bucket.
- D
Use the 'bq load' command in the Cloud Shell to load the data from Cloud Storage into BigQuery.
- E
Enable schema autodetect to simplify the loading process and reduce the chance of schema mismatch.
Show answer and explanation
Correct answers: B, D, E
Explanation
When loading large datasets into BigQuery, it's important to use efficient methods that leverage Google Cloud's services. Using the BigQuery Data Transfer Service or the 'bq load' command from Cloud Storage are both effective strategies. Additionally, enabling schema autodetect can help simplify the process and reduce the chance of errors, ensuring data accuracy.
- A. Incorrect.
Uploading files manually from your local machine is not efficient for large datasets and incurs unnecessary egress costs.
- B. Correct.
BigQuery Data Transfer Service can automate data imports from Cloud Storage, making it a cost-effective and scalable solution.
- C. Incorrect.
Cloud Functions can be used for automation, but it might not be the most efficient method for large file imports compared to direct methods like 'bq load'.
- D. Correct.
Using the 'bq load' command is a direct and efficient method to load data from Google Cloud Storage to BigQuery, especially for large files.
- E. Correct.
Enabling schema autodetect helps streamline the loading process and reduces the likelihood of errors due to schema mismatches.