hiexam
google · Professional-Machine-Learning-Engineer · Q428 · multiple_choice · topic_1

You have successfully deployed to production a large and complex TensorFlow model trained on tabular data. You want to…

You have successfully deployed to production a large and complex TensorFlow model trained on tabular data. You want to predict the lifetime value (LTV) field for each subscription stored in the BigQuery table named subscription. subscriptionPurchase in the project named my-fortune500-company-project. You have organized all your training code, from preprocessing data from the BigQuery table up to deploying the validated model to the Vertex AI endpoint, into a TensorFlow Extended (TFX) pipeline. You want to prevent prediction drift, i.e., a situation when a feature data distribution in production changes significantly over time. What should you do?
  • A.Implement continuous retraining of the model daily using Vertex AI Pipelines.
  • B.Add a model monitoring job where 10% of incoming predictions are sampled 24 hours.
  • C.Add a model monitoring job where 90% of incoming predictions are sampled 24 hours.
  • D.Add a model monitoring job where 10% of incoming predictions are sampled every hour.
Explanation
Selected Answer: B Continuous retraining (option A) is not necessarily the best solution for preventing prediction drift, as it can be time-consuming and expensive. Instead, monitoring the performance of the model in production is a better approach. Option B is a good choice because it samples a small percentage of incoming predictions and checks for any significant changes in the feature data distribution over a 24-hour period. This allows you to detect any drift and take appropriate action to address it before it affects the model's performance. Options C and D are less effective because they either sample too many or too few predictions and/or at too frequent intervals.

Reference: examtopics_top_comment

Practice with progress tracking

Sign in to track wrong answers, get spaced-repetition reminders, and run timed exam mode.