Skip to main content

Creating and Managing Model Versions

Learn about creating and managing model versions


Developing performant machine learning models includes a lot of iterative work. To get the best performing model, you may need to change hyperparameters, training data, or other parameters.

Keeping a history of the changes over time can help you achieve the objectives you initially envisioned with your machine learning models.

The Clarifai Portal allows you to track and manage different versions of your model. Using the Portal to practice model version control can help you achieve several things, such as:

  • Versioned reproducibility—As you make changes to your model, its behavior also changes. By tracking versions, you can easily reproduce the same behavior at a later time.
  • Better collaboration—When you work with a team to develop a machine learning model, version control helps team members to avoid conflicts, track changes, and collaborate effectively.
  • Improved troubleshooting—After updating or modifying a model, it can be difficult to trace the changes that affect the performance of the model. Tracking model versions allows you to easily compare different versions and pinpoint the changes that resulted in problems or improvements.
  • Regulatory compliance—By tracking model versions, you can demonstrate that a particular model was used for decision making. This transparency can enhance the auditability of your systems and assist in satisfying regulatory requirements.

How to Create and Manage Model Versions

After creating and training a custom model, it will be listed on the Models manager page, where you can see all the models available in your app.

info

Creating and training a model automatically creates its initial version.

You can get to the page by navigating to the individual page of your app and selecting the Models option on the collapsible left sidebar.

models manager page

Next, select the model you want to see its details.

You'll be redirected to a page for viewing the selected model.

model viewer page

If you click the Train Model button at the upper-right corner of the page, you'll initiate a new training process, which will generate another model version.

note

Anytime your model finishes training, you'll get an email message of the training results with links to helpful resources on how to make the most of the model.

You can also click the button that lists the different model versions, and a list of the available model versions will drop down. You can select the version of the model you want to see and copy its ID to the clipboard.

If you click the See versions table link, a table that lists the different versions of your model will appear.

see versions table

The model versions table allows you to complete various management tasks.

Evaluate a Model Version Performance

To evaluate the performance of a model version, under the ROC column, click the Calculate button, which will start the evaluation process.

evaluate the performance of a model version

The evaluation may take up to 30 minutes. Once it is complete, the Calculate button will become a View Results button, which you can click to see the evaluation results.

You can read here to learn how to interpret the evaluation results.

tip

You can compare model performance metrics across different versions. For example, if you want to make an "apples to apples" comparison, we recommend having a fixed concept list for your model, so that you can pick the best model version after the comparisons.

See Model Version Details

Click the See Model Version Details button to see the details of the model version.

see model version details

You'll be redirected to the model version viewer page, where you can see different details of your model versions and track their history.

You can select the model you want to see its details on the version selection pane on the left side of the page. Your selected version will be highlighted. By default, the best performing version is highlighted and appears on top.

model version viewer page

You can see several details, including the following:

  • Dataset details used to train the model version
  • Concepts present in the model version
  • Training template used to train the model version
  • Inference settings, such as batch size, image size, and number of epochs
  • Different advanced options
  • Different output settings

You can also click the Create a new version button to create a new version of your model.

create a new version

You can create a new model version either from:

  • From Version Config—creates a new version from your own model configuration using the settings of the highlighted selected version
  • From Default Config—creates a blank new version from Clarifai's default configuration settings

Delete a Model Version

To delete a model version, click the Delete button on the model versions listing table.

delete a model version