You are developing a process for training and running your custom model in production. You need to be able to show lineage for your model and predictions. What should you do?
A.
1. Create a Vertex AI managed dataset. 2. Use a Vertex AI training pipeline to train your model. 3. Generate batch predictions in Vertex AI.
B.
1. Use a Vertex AI Pipelines custom training job component to tram your model. 2. Generate predictions by using a Vertex AI Pipelines model batch predict component.
C.
1. Upload your dataset to BigQuery. 2. Use a Vertex AI custom training job to train your model. 3. Generate predictions by using Vertex Al SDK custom prediction routines.
D.
1. Use Vertex AI Experiments to train your model. 2. Register your model in Vertex AI Model Registry. 3. Generate batch predictions in Vertex AI.
My Answer: D
According with: https://cloud.google.com/vertex-ai/docs/experiments/intro-vertex-ai-experiments
“Vertex AI Experiments is a tool that helps you track and analyze different model architectures, hyperparameters, and training environments, letting you track the steps, inputs, and outputs of an experiment run. Vertex AI Experiments can also evaluate how your model performed in aggregate, against test datasets, and during the training run. You can then use this information to select the best model for your particular use case.”.
Considering that both options A and B could demonstrate some form of lineage, I believe option D is the most suitable. The text explicitly states "show lineage for your model and predictions," which aligns perfectly with the functionality provided by Vertex AI Experiments.
Vertex AI Pipelines are suited to do artifact lineage
https://cloud.google.com/vertex-ai/docs/pipelines/lineage
Experiments can do it also, but their main goal is to "track and analyze different model architectures, hyperparameters, and training environments"
Vertex AI Experiments helps track all your training runs, including:
Dataset version
Hyperparameters
Model metrics
Code version
This enables full lineage and traceability from data → training → model artifact.
Answer is B
D is wrong as there is only one model not models, experiments is used for multiple runs of a model/multiple models, also lineage is tracked using a pipeline
Vertex AI Pipelines will track the Model lineage while the batch prediction component in Vertex AI Pipelines will provide lineage tracking because each prediction is part of the pipeline and is connected to the corresponding training process.
It's a bit ambiguously worded this question. Model lineage involves knowledge of the data it was trained on, so that should be A. That being said, I think the question is implying D from it's wording, experiment tracking. I went for A, but suspect it's wrong.
Option A/B doesn't mention anything about lineage. C is definitely wrong as there is no need to upload the dataset to Bigquery.
Only correct answer is D
B) REF https://cloud.google.com/vertex-ai/docs/pipelines/lineage
Track the lineage of pipeline artifacts
When you run a pipeline using Vertex AI Pipelines, the artifacts and parameters of your pipeline run are stored using Vertex ML Metadata. Vertex ML Metadata makes it easier to analyze the lineage of your pipeline's artifacts, by saving you the difficulty of keeping track of your pipeline's metadata.
An artifact's lineage includes all the factors that contributed to its creation, as well as artifacts and metadata that are derived from this artifact. For example, a model's lineage could include the following:
The training, test, and evaluation data used to create the model.
The hyperparameters used during model training.
Metadata recorded from the training and evaluation process, such as the model's accuracy.
Artifacts that descend from this model, such as the results of batch predictions.
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
guilhermebutzke
Highly Voted 1 year, 2 months agoedoo
Highly Voted 1 year, 1 month agobc3f222
Most Recent 1 month, 2 weeks agoAnkit267
4 months, 1 week agorajshiv
5 months agoAB_C
5 months, 1 week agoFoxy2021
6 months, 3 weeks agobaimus
7 months, 3 weeks agoSahandJ
12 months agopinimichele01
1 year agocruise93
1 year agoShark0
1 year, 1 month agopinimichele01
1 year agoYan_X
1 year, 1 month agosonicclasps
1 year, 2 months agoddogg
1 year, 3 months agob1a8fae
1 year, 3 months agoBlehMaks
1 year, 3 months ago