Skip to main content

AI-Assisted Labeling

Generate annotations for your inputs automatically




AI-assisted labeling is an innovative Clarifai feature that leverages artificial intelligence technology to assist and optimize the process of annotating data.

You can request predictions from any model or workflow available to you on a particular input, and then review, correct, or validate them before converting them into annotations.

AI-Assist provides you with several benefits, including:

  • Significantly accelerate the labeling process, reducing the time required to create labeled datasets.
  • Automation can reduce the labor costs associated with manual labeling.
  • AI models can provide consistent labeling, minimizing human errors.
  • It allows for the efficient and scalable handling of large datasets or rapidly changing data.

Let’s demonstrate how you can do it on the Clarifai portal.

1. Navigate to Input-Viewer

Navigate to the Input-Viewer screen and confirm that you're in the Annotate mode, which is the default status.

To add an AI-assisted labeling model, you can either click the "add a model for ai assisted labeling" link, or, alternatively, click the gear icon in the upper-right corner of the page.

navigate to input-viewer screen

The AI Assist sidebar that appears enables you to choose a model or workflow for assisting in labeling your inputs.

2. Choose a Model or Workflow

Use the Select Model or Workflow search box to choose a model or workflow you want to get its predictions.

You can choose your own customized model or workflow, or look for a public one from the Community.

choose a model or workflow

tip

When working with image inputs, you need to choose a model or workflow that outputs concepts or objects (bounding box regions). This ensures the generation and display of annotation suggestions.

In this example, we will illustrate how to generate annotations using a classification model and a detection workflow.

First, let’s choose the Community’s general-image-recognition model, which is a visual classification model that identifies a variety of concepts in images.

 general-image-recognition model

Second, let’s select another input on the Input-Viewer screen. And on the AI Assist sidebar, let’s choose the General-Detection workflow, which identifies a variety of common objects in images.

General-Detection workflow

3. Generate Annotations

After choosing a model or workflow, it could take a few moments to automatically generate the annotations. The generated labels are sorted in descending order based on their concept probability values.

The Classifications section lists the concepts generated by the classification model, alongside their probability values.

generate classification annotations

The Objects / Regions section displays the bounding boxes identified by the detection workflow, alongside their probability values.

generate bounding box annotations

4. Review and Accept Predictions

Finally, you can review and accept the outputted model or workflow prediction suggestions.

Here is how you can review and accept classification predictions:

review and accept classification predictions

Here is how you can review and accept objects or regions predictions:

review and accept objects predictions

You can use the slider control to display prediction results with probability values falling within your selected range.

If you want to accept all the AI-assisted suggestions, just click the “Accept all AI assist predictions” button.

info

When you accept an AI-assisted prediction suggestion, it will be applied automatically as a label to your input and seamlessly integrated into your application.

To manually accept a prediction, simply click on the checkbox next to it. You will notice a color change, and a confirmation message will indicate that the annotation has been successfully added.

If you want to remove the annotation from the input, simply uncheck the same checkbox whose color has changed. The removed annotation will revert to being a suggestion rather than being entirely removed from the list.

If you want to delete an annotation from the list of suggestions, click on the three vertical dots located next to it. A small pop-up will appear, prompting you to confirm the deletion.

5. Edit Suggestions

You can also edit the concept list suggestions.

To edit a classification prediction, hover your mouse cursor next to the suggestion, and a pen icon will appear. Click the icon to reveal an input box that enables you to update the annotation according to your preferences.

To edit a region prediction, simply click on the labeled bounding box and drag it to cover the specific areas you want it to encompass.