AI-Assisted Labeling
Generate annotations for your inputs automatically
AI-assisted labeling is an innovative Clarifai feature that leverages artificial intelligence technology to assist and optimize the process of annotating data.
You can request predictions from any model or workflow available to you on a particular input, and then review, correct, or validate them before converting them into annotations.
AI-Assist provides you with several benefits, including:
- Significantly accelerate the labeling process, reducing the time required to create labeled datasets.
- Automation can reduce the labor costs associated with manual labeling.
- AI models can provide consistent labeling, minimizing human errors.
- It allows for the efficient and scalable handling of large datasets or rapidly changing data.
This AI-assist feature is only available to users on our paid plans.
Let’s demonstrate how you can do it on the Clarifai portal.
1. Navigate to Input-Viewer
Navigate to the Input-Viewer screen and confirm that you're in the Annotate mode, which is the default status.
To add an AI-assisted labeling model, you can either click the "add a model for ai assisted labeling" link, or, alternatively, click the gear icon in the upper-right corner of the page.
The AI Assist sidebar that appears enables you to choose a model or workflow for assisting in labeling your inputs.
2. Choose a Model or Workflow
Use the Select Model or Workflow search box to choose a model or workflow you want to get its predictions.
You can choose your own customized model or workflow, or look for a public one from the Community.
When working with image inputs, you need to choose a model or workflow that outputs concepts or objects (bounding box regions). This ensures the generation and display of annotation suggestions.
In this example, we will illustrate how to generate annotations using a classification model and a detection workflow.
First, let’s choose the Community’s general-image-recognition model, which is a visual classification model that identifies a variety of concepts in images.
Second, let’s select another input on the Input-Viewer screen. And on the AI Assist sidebar, let’s choose the General-Detection workflow, which identifies a variety of common objects in images.
3. Generate Annotations
After choosing a model or workflow, it could take a few moments to automatically generate the annotations. The generated labels are sorted in descending order based on their concept probability values.
The Classifications section lists the concepts generated by the classification model, alongside their probability values.
The Objects / Regions section displays the bounding boxes identified by the detection workflow, alongside their probability values.
4. Review and Accept Predictions
Finally, you can review and accept the outputted model or workflow prediction suggestions.
Here is how you can review and accept classification predictions:
Here is how you can review and accept objects or regions predictions:
You can use the slider control to display prediction results with probability values falling within your selected range.
If you want to accept all the AI-assisted suggestions, just click the “Accept all AI assist predictions” button.
When you accept an AI-assisted prediction suggestion, it will be applied automatically as a label to your input and seamlessly integrated into your application.
To manually accept a prediction, simply click on the checkbox next to it. You will notice a color change, and a confirmation message will indicate that the annotation has been successfully added.
If you want to remove the annotation from the input, simply uncheck the same checkbox whose color has changed. The removed annotation will revert to being a suggestion rather than being entirely removed from the list.
If you want to delete an annotation from the list of suggestions, click on the three vertical dots located next to it. A small pop-up will appear, prompting you to confirm the deletion.
5. Edit Suggestions
You can also edit the concept list suggestions.
To edit a classification prediction, hover your mouse cursor next to the suggestion, and a pen icon will appear. Click the icon to reveal an input box that enables you to update the annotation according to your preferences.
To edit a region prediction, simply click on the labeled bounding box and drag it to cover the specific areas you want it to encompass.