Google CloudProfessional levelPage 6 of 6

Google Professional Machine Learning Engineer exam dumps: questions 501 to 521 of 521

Page 6 of the free Google Professional Machine Learning Engineer question bank for the Professional Machine Learning Engineer exam. Questions 501 to 521 are listed below, the first 5 in full with answers and explanations. Back to page 1 for the exam overview and FAQ.

Question bank last updated December 2024

Free Google Professional Machine Learning Engineer practice questions

Questions 501 to 505 of 521

Pick an answer before you open the explanation. Each question also has its own page with a permalink.

Google Professional Machine Learning Engineer Question 501

Select 3Google Cloud Platform

You are working on a machine learning pipeline deployed on Google Cloud, and you want to monitor for training-serving skew between your training data and the data used in production. Which strategies should you implement to detect and mitigate this issue effectively?

  1. A

    Use Dataflow to compute statistics on production data and compare them with training data statistics.

  2. B

    Implement Vertex AI Feature Store to track and monitor feature distributions over time.

  3. C

    Create a model evaluation pipeline to compare the accuracy of the training model and the production model predictions.

  4. D

    Log predictions and input features in production, and compare them with the training dataset features using TensorFlow Data Validation (TFDV).

  5. E

    Enable the AI Explanations feature in Vertex AI to analyze prediction differences between training and serving data.

Show answer and explanation

Correct answers: A, B, D

Explanation

Training-serving skew occurs when the data distributions in training and production differ, which can lead to degraded model performance. To monitor for this issue, you can leverage tools like Dataflow to compute statistics on production data, use Vertex AI Feature Store to track feature distributions over time, and log production data to compare with training data using TensorFlow Data Validation (TFDV). These strategies help identify and mitigate skew effectively, ensuring the model performs reliably in production.

  • A. Correct.

    Correct: Dataflow can be used to process and compute statistics on production data in real-time, enabling comparisons with training data statistics to detect skew.

  • B. Correct.

    Correct: Vertex AI Feature Store provides a centralized repository to manage and monitor feature distributions over time, helping identify divergence between training and serving data.

  • C. Incorrect.

    Incorrect: While model evaluation pipelines are useful for monitoring model performance, they do not directly help in detecting training-serving skew, which focuses on data mismatches rather than accuracy differences.

  • D. Correct.

    Correct: Logging predictions and input features from production, and comparing them with training data using tools like TFDV, is a common and effective way to detect training-serving skew.

  • E. Incorrect.

    Incorrect: AI Explanations in Vertex AI is used to interpret model predictions, but it does not directly address the detection of training-serving skew.

Google Professional Machine Learning Engineer Question 502

Select 3Google Cloud Platform

Your team has deployed a machine learning model on Google Cloud that predicts customer churn. You notice that the model's performance has been degrading over the past few weeks. Upon investigation, you suspect feature attribution drift might be the cause. How can you monitor for feature attribution drift using Google Cloud tools?

  1. A

    Use Vertex AI Model Monitoring to track changes in feature attribution distributions over time.

  2. B

    Manually compute SHAP values for historical and recent predictions to identify changes in feature importance.

  3. C

    Enable Vertex AI Explainable AI to automatically monitor feature attribution drift for deployed models.

  4. D

    Use BigQuery to store feature attribution data and write custom SQL queries to compare historical and current explanations.

  5. E

    Deploy a custom model in Vertex AI that specifically predicts feature attribution drift.

Show answer and explanation

Correct answers: A, B, D

Explanation

Monitoring feature attribution drift involves tracking changes in how features influence model predictions over time. Vertex AI Model Monitoring can help with input feature drift, but for attribution drift, you may need to use manual methods such as computing SHAP values or analyzing stored attribution data in BigQuery. Vertex AI Explainable AI provides explanations but does not directly track attribution drift.

  • A. Correct.

    Vertex AI Model Monitoring can track data drift and alert on changes in input features, but you must use custom setups or tools to monitor feature attribution drift specifically.

  • B. Correct.

    Manually computing SHAP values for historical and recent predictions is a valid approach to compare feature importance and identify drift in attribution.

  • C. Incorrect.

    Vertex AI Explainable AI provides explanations for model predictions, but it does not automatically monitor or alert you about feature attribution drift.

  • D. Correct.

    Using BigQuery to store feature attribution data and analyzing it with SQL queries is a feasible way to monitor feature attribution drift manually.

  • E. Incorrect.

    Deploying a custom model to predict feature attribution drift is unnecessary and not a standard practice for handling this issue.

Google Professional Machine Learning Engineer Question 503

Select 3Google Cloud Platform

You are a Machine Learning Engineer responsible for maintaining a deployed ML model on Google Cloud. The model uses tabular data with multiple features, and you have noticed a degradation in the model's performance. You suspect that feature attribution drift might be the cause. Which actions should you take to monitor and address feature attribution drift effectively?

  1. A

    Use Explainable AI to monitor feature attributions over time and identify changes in the importance of features.

  2. B

    Implement Vertex AI Model Monitoring to track feature distribution statistics and set thresholds for drift detection.

  3. C

    Retrain the model periodically on the same dataset used during initial training to ensure consistency.

  4. D

    Compare feature attribution scores for new data against the baseline scores from the training dataset.

  5. E

    Enable AutoML Tables' automatic retraining feature to address potential drift in feature attributions.

Show answer and explanation

Correct answers: A, B, D

Explanation

Monitoring feature attribution drift is crucial for maintaining the performance of a deployed model. By leveraging Explainable AI for feature importance analysis, using Vertex AI Model Monitoring for tracking drift, and comparing new feature attribution scores to baselines, you can effectively identify and address changes in how the model interprets features. Automatic retraining or retraining on the same dataset does not directly solve the problem of feature attribution drift, which is often caused by changes in the input data distribution.

  • A. Correct.

    Correct. Explainable AI tools in Google Cloud can help you inspect and monitor changes in feature importance over time, allowing you to detect attribution drift.

  • B. Correct.

    Correct. Vertex AI Model Monitoring provides robust tools for tracking feature distributions and detecting drift in real-time.

  • C. Incorrect.

    Incorrect. Retraining the model on the same dataset does not address feature attribution drift, as the drift likely arises from changes in the incoming data, not the stability of the original dataset.

  • D. Correct.

    Correct. Comparing new feature attribution scores with baseline scores can identify shifts in how the model interprets features, which is critical in detecting drift.

  • E. Incorrect.

    Incorrect. While AutoML Tables offers automatic retraining, it does not specifically monitor or handle feature attribution drift, which requires more targeted tools and analysis.

Google Professional Machine Learning Engineer Question 504

Select 2Google Cloud Platform

You have deployed a machine learning model to predict customer churn based on input features such as account age, monthly usage, and support ticket interactions. You want to monitor for feature attribution drift to ensure that the importance of individual features as perceived by the model does not change significantly over time. Which of the following steps should you take to effectively monitor feature attribution drift?

  1. A

    Use SHAP values to compute feature importance scores and compare them over time.

  2. B

    Set up a monitoring pipeline to trigger alerts when feature distributions deviate from training data.

  3. C

    Periodically calculate and compare the distribution of model predictions across different time windows.

  4. D

    Integrate Explainable AI tools in Google Cloud to analyze feature importance trends.

  5. E

    Monitor the mean absolute error (MAE) of the model predictions over time.

Show answer and explanation

Correct answers: A, D

Explanation

Feature attribution drift occurs when the importance of features as perceived by the model changes over time. This can result in a misalignment between the model's behavior and the expected feature importance. Using SHAP values or Explainable AI tools in Google Cloud allows you to monitor and track feature importance trends over time, making these the correct approaches for monitoring feature attribution drift.

  • A. Correct.

    Using SHAP values is a standard approach to compute feature importance and analyze how it changes over time. This directly addresses feature attribution drift.

  • B. Incorrect.

    Monitoring feature distributions is important for feature drift but does not directly address feature attribution drift, which focuses on the relationship between features and model predictions.

  • C. Incorrect.

    Comparing distributions of model predictions helps detect prediction drift but does not provide insights into feature attribution drift.

  • D. Correct.

    Google Cloud's Explainable AI tools allow you to analyze feature importance trends, making it a relevant step for monitoring feature attribution drift.

  • E. Incorrect.

    Monitoring metrics like mean absolute error (MAE) can help detect performance degradation but does not directly relate to feature attribution drift.

Google Professional Machine Learning Engineer Question 505

Select 3Google Cloud Platform

You are deploying a machine learning model for predicting customer churn in a subscription service. The model uses features such as user activity, subscription type, and support ticket history. Over time, you notice a drop in model performance during live predictions. You suspect feature attribution drift might be a contributing factor. Which of the following steps should you take to monitor and address feature attribution drift?

  1. A

    Enable Vertex AI Model Monitoring to track feature attribution drift metrics.

  2. B

    Compare the feature importance of the training data with the live inference data using SHAP or similar tools.

  3. C

    Retrain the model immediately with the latest live data to mitigate the effects of drift.

  4. D

    Set up alerts for significant deviations in the distribution of feature attribution scores between training and live data.

  5. E

    Ignore feature attribution drift and focus solely on monitoring data drift in the input features.

Show answer and explanation

Correct answers: A, B, D

Explanation

Feature attribution drift occurs when the importance of features in making predictions changes over time, potentially leading to degraded model performance. Addressing this requires monitoring tools like Vertex AI Model Monitoring, analyzing feature importance using techniques such as SHAP, and setting up alerts for observed deviations. These steps help detect and mitigate drift effectively before retraining the model or implementing other corrective measures.

  • A. Correct.

    Enabling Vertex AI Model Monitoring provides automated tools to track and alert on various types of drift, including feature attribution drift, which makes it a critical step.

  • B. Correct.

    Comparing feature importance (e.g., using SHAP values) between training and live inference data helps to identify shifts in how features contribute to model predictions, which is essential for monitoring feature attribution drift.

  • C. Incorrect.

    Retraining the model immediately is not a recommended first step without proper analysis, as it may lead to overfitting or overlooking the root cause of the drift.

  • D. Correct.

    Setting up alerts for deviations in feature attribution scores helps in proactively identifying and addressing drift issues, making it an important step in the monitoring process.

  • E. Incorrect.

    Ignoring feature attribution drift is not advisable, as it can impact model interpretability and performance. Monitoring data drift in input features alone is not sufficient to address attribution drift.

Timed practice exam

Take a Google Professional Machine Learning Engineer practice test under exam conditions

60 questions in 120 minutes, drawn from this bank, with a score report and a per-question review when you finish.

Start timed exam

Google Professional Machine Learning Engineer practice questions 501 to 521 of 521

Every question has a page with the answer and explanation. Numbers are stable, so you can bookmark or share them. The bank is split into 6 pages of up to 100 questions.

  1. 501.You are working on a machine learning pipeline deployed on Google Cloud, and you want to monitor for...
  2. 502.Your team has deployed a machine learning model on Google Cloud that predicts customer churn. You notice that...
  3. 503.You are a Machine Learning Engineer responsible for maintaining a deployed ML model on Google Cloud. The...
  4. 504.You have deployed a machine learning model to predict customer churn based on input features such as account...
  5. 505.You are deploying a machine learning model for predicting customer churn in a subscription service. The model...
  6. 506.You have deployed a machine learning model in production that uses a set of features for predictions. Over...
  7. 507.You are managing a machine learning model deployed to predict customer churn for a subscription service....
  8. 508.You are deploying a machine learning model for predicting customer churn. To ensure the model remains...
  9. 509.You have deployed a machine learning model to production using Google Cloud AI Platform and are tasked with...
  10. 510.You are deploying a machine learning model to predict customer churn for a subscription-based service. To...
  11. 511.You are working as a machine learning engineer for an e-commerce platform that uses a recommendation model to...
  12. 512.You are tasked with designing a machine learning model on Google Cloud to predict customer churn. The dataset...
  13. 513.You are building a machine learning pipeline on Google Cloud to classify images of animals into multiple...
  14. 514.You are tasked with designing a machine learning pipeline on Google Cloud for a recommendation system. The...
  15. 515.You are designing a machine learning pipeline on Google Cloud to classify customer reviews into positive and...
  16. 516.You are tasked with building a machine learning model for image classification on Google Cloud. The input...
  17. 517.You have deployed a machine learning model using Google Cloud AI Platform Prediction. After deployment, you...
  18. 518.You are a machine learning engineer responsible for deploying a model to production on Google Cloud. After...
  19. 519.You are responsible for maintaining a machine learning model deployed on Google Cloud AI Platform. Users...
  20. 520.You are tasked with deploying a machine learning model to production using Google Cloud AI Platform. After...
  21. 521.You are deploying a machine learning model on Google Cloud that predicts customer churn. After deployment,...