Google Professional Data Engineer Question 128
Select 4Google Cloud PlatformYour company uses Google BigQuery to store and analyze large datasets. Recently, the team has observed performance issues during query execution. You suspect that inefficient data access patterns might be the cause. Which steps should you take to analyze and optimize data access patterns in BigQuery?
- A
Use the BigQuery INFORMATION_SCHEMA.JOBS view to analyze query execution details and identify costly queries.
- B
Examine the query execution plan in the BigQuery Query Plan tab to identify excessive shuffling or large stages.
- C
Enable BigQuery BI Engine to automatically optimize all queries and avoid analyzing query patterns manually.
- D
Check table partitioning and clustering configurations to ensure they align with query patterns.
- E
Review the BigQuery audit logs in Cloud Logging to identify patterns in query frequency and resource usage.
Show answer and explanation
Correct answers: A, B, D, E
Explanation
To analyze and optimize data access patterns in BigQuery, it is essential to use tools and methods that provide insights into query performance and resource usage. This includes examining query execution details, reviewing table configurations like partitioning and clustering, and leveraging audit logs for usage patterns. BigQuery BI Engine can optimize some queries but does not eliminate the need for a thorough analysis of data access patterns.
- A. Correct.
The BigQuery INFORMATION_SCHEMA.JOBS view provides detailed information about executed queries, including costs and duration, which can help identify inefficient queries.
- B. Correct.
The Query Plan tab in BigQuery helps visualize query execution details, such as data shuffling and stage performance, aiding in identifying bottlenecks.
- C. Incorrect.
While BigQuery BI Engine improves query performance for supported dashboards, it does not replace the need for manual analysis of query patterns.
- D. Correct.
Partitioning and clustering can significantly impact query performance. Ensuring these configurations align with query patterns is crucial for optimizing data access.
- E. Correct.
BigQuery audit logs in Cloud Logging can reveal trends in query usage, helping identify frequent queries and resource-intensive operations.