Skip to main content

Release 9.9

Release Date: October 10th, 2023



New FeatureImprovementBug FixEnterprise Only
new-featureimprovementbugenterprise

API

StatusChangeDetails
improvementAdded inference parameters customization
  • You can now configure inference parameters such as temperature, max tokens, and more, depending on the specific model you are using, for both text-to-text and text-to-image generative tasks. This empowers you to customize and fine-tune your model interactions to better suit your individual needs.
bugFixed an issue where the ListWorkflows endpoint fetched workflows from deleted apps
  • Previously, workflows from deleted applications were fetched in the response of the ListWorkflows endpoint. We fixed the issue.

Python SDK

StatusChangeDetails
improvementAdded ability to upload and download text and image data
  • The SDK supports the following text data formats: plain text, CSV, and TSV (in roadmap).
  • It supports the following image data formats: JPEG, PNG, TIFF, BMP, WEBP, and GIF.
  • You have the flexibility to upload data from either URLs or local storage, whether it's within a single folder or spread across multiple sub-folders.
  • You can upload text data enriched with metadata and text classification annotations.
  • You can also upload image data enriched with annotations, geoinformation, and metadata information.
  • You can efficiently create apps designed for text mode and image mode use cases.
  • The SDK ensures transparent progress tracking during each upload and promptly reports any encountered errors.
improvementIntegrated YAML workflow interfaces with proto endpoints
  • In the SDK, the workflow interfaces are now represented in YAML format, but they are seamlessly integrated with proto endpoints for efficient communication and interaction.
improvementEnhanced the SDK's foundational structure
  • The SDK now supports authentication only using Personal Access Tokens (PAT) and UserIDs.
  • We plan to provide helper utilities for rich text formatting and printing to facilitate a user-friendly interaction.
  • We are working to constantly add a robust error-handling system that covers various scenarios.

New Published Models

StatusChangeDetails
new-featurePublished several new, ground-breaking models
  • Wrapped Falcon-40B-Instruct, a causal decoder-only Large Language Model (LLM) built by TII based on Falcon-40B and fine-tuned on a mixture of Baize.
  • Wrapped WizardLM-70B, a model fine-tuned on the Llama2-70B model using Evol+ methods; it delivers outstanding performance.
  • Wrapped CodeLlama-13B-Instruct-GPTQ, CodeLlama-34B-Instruct-GPTQ, and CodeLlama-7B-GPTQ. Code Llama is a family of code-focused LLMs, built upon Llama 2. These models excel at filling in code, handling extensive input contexts, and following programming instructions without prior training for various programming tasks.
  • Wrapped WizardLM-13B, an LLM fine-tuned on the Llama-2-13b model using the Evol+ approach; it delivers outstanding performance.
  • Wrapped WizardCoder-15B, a code-based LLM that has been fine-tuned on Llama 2 using the Evol-Instruct method and has demonstrated superior performance compared to other open-source and closed-source LLMs on prominent code generation benchmarks.
  • Wrapped WizardCoder-Python-34B, a code-based LLM that has been fine-tuned on Llama 2. It excels in Python code generation tasks and has demonstrated superior performance compared to other open-source and closed-source LLMs on prominent code generation benchmarks.
  • Wrapped Phi-1, a high-performing 1.3 billion-parameter text-to-code language model, excelling in Python code generation tasks while prioritizing high-quality training data.
  • Wrapped Phi-1.5, a 1.3 billion parameter LLM that excels at complex reasoning tasks and was trained on a high-quality synthetic dataset.
  • Wrapped OpenAI's GPT-3.5-Turbo-Instruct, an LLM designed to excel in understanding and executing specific instructions efficiently. It excels at completing tasks and providing direct answers to questions.
  • Wrapped Mistral-7B-Instruct, a state-of-the-art 7.3 billion parameter language model, outperforming Llama2-13B in multiple NLP benchmarks, including code-related challenges.

LlamaIndex

StatusChangeDetails
new-featureAdded support for LlamaIndex
    We now support integrating with the LlamaIndex data framework for various use cases, including:

  • Ingesting, structuring, and accessing external data for the LLMs you fine-tune on our platform. This allows you to boost the accuracy of your LLM applications with private or domain-specific data.
  • Storing and indexing your data for various purposes, including integrating with our downstream vector search and database services.
  • Building an embeddings query interface that accepts any input prompt and leverages your data to provide knowledge-augmented responses.

Models

StatusChangeDetails
GA ReleasedAdded ability to fine-tune text-to-text models
  • Advanced model builders can now further customize the behavior and output of the text-to-text models for specific text generation tasks. They can train the models on specific datasets to adapt their behavior for particular tasks or domains.
Enterprise-PreviewFixed an issue with the Leaderboard, which organizes models based on their evaluation results
  • Previously, for visual detection models, the displayed metrics included classification metrics like ROC, instead of the expected metric, which is Mean Average Precision (MAP). The Leaderboard now correctly displays MAP, just like in the model viewer's version table.
bugIntroduced multi-label text classification with Hugging Face text classification pipeline
  • Previously, there was an issue with multi-label text classification using the Hugging Face text classification pipeline. While it worked well for multi-class classification, it did not perform correctly for multi-label classification. We fixed the issue.
bugFixed issues with the model version details page
  • Fixed an issue that prevented the model version details page from displaying any output fields.
  • Fixed an issue that caused the model version details table page to crash unexpectedly.
  • Fixed an issue where the model version details page displayed incorrect parameter values when switching between different model versions.
  • Fixed an issue where the model version details page displayed fields irrelevant to the specific model type. Unnecessary fields unrelated to the selected model type are now not visible.
bugFixed an issue where the Model Viewer page incorrectly rotated images in specific community apps
  • Previously, when images with a portrait orientation (height greater than width) were submitted to some apps, the predicted detection boxes appeared misaligned or incorrect. The Model Viewer page now correctly rotates images with portrait orientation, aligning detection boxes accurately for improved user experience and detection accuracy.
bugFixed an issue where the model ID disappeared after selecting the Base embed_model in the model creation process
  • Previously, users encountered an issue where their previously entered model ID would disappear upon selecting a base embed model when creating a new model. We fixed the issue.

Modules

StatusChangeDetails
improvementRemoved collaborative applications from the apps drop-down list within the Install Module modal when an org user is selected
  • Since organization users do not have collaborative apps or engage in collaborations, we have optimized the interface by removing collaborated apps in the Install Module modal specifically for this user group. This also fixed the app failure bug.
improvementEnhanced the default app selection in the Install Module modal
  • The Install Module modal now automatically selects your current app as the default destination to install your chosen module.
improvementImproved the search functionality for modules
  • This refinement in the search feature offers a more streamlined and productive experience when looking for specific modules or related content.
improvementIntroduced a handy addition to the module's viewer page—an easy-to-use copy icon
  • You can now click the copy icon located in the Latest Version ID section to swiftly obtain the complete latest version URL for a module. This URL allows you to expedite the module installation process for your application.

Input-Manager

StatusChangeDetails
new-featureAdded support for video inputs in Input-Manager
  • You can now view and manage video inputs directly within the Input-Manager. This new feature provides you with greater flexibility and control over your video assets, enhancing your overall experience with our platform.
new-featureAdded ability to filter inputs by annotation user and annotation status in Input Manager
    We introduced two new filter options in the Input-Manager:

  • Labeler filter —Allows you to filter inputs that were annotated by the selected user.
  • Status filter —Allows you to filter inputs that have annotations that match the selected status.
bugFixed checkbox behavior in the input gallery screen
  • Previously, when you switched from Object Mode to Input Mode, the checkbox for selecting all items would remain checked, causing confusion. We fixed the issue.
bugFixed clear button functionality for input type filtersIn the Input-Manager, you can filter inputs by their types, and the clear button is designed to unselect all filtering options.

  • Previously, the clear button was not functioning correctly after applying filters based on input types. You can now utilize it to reset and remove all applied filters.
bugEnabled rank search to be compatible with other filters
  • Previously, there was an issue that prevented other filters from being applied when conducting a rank search. You can now apply rank search in conjunction with other filters, enhancing the effectiveness of your search experience.
bugFixed query timeout issue with metadata searches
  • Previously, including the "country_code":"US" metadata in your search query led to timeouts. However, when executing the same query without the "country_code":"US" metadata, it completed successfully in approximately 4 seconds. You can now perform your query, even with the "country_code":"US" metadata included, and achieve successful results without experiencing timeouts.
bugEliminated duplicate requests in the Input-Manager's screen
  • Previously, an issue caused duplicate or even triple requests. It occurred when loading the page with or without a searchId in the URL, which resulted in unnecessary and excessive requests. Extra requests are no longer generated.
bugFixed an issue with automatic refresh of the input gallery in Input-Manager after performing bulk edit actionsPreviously, there was an issue that hindered the automatic refresh of the input gallery after performing bulk deleting or labeling actions. These improvements ensure that filters accurately reflect the changes made.

  • Previously, bulk deleting of inputs didn't show live updates in the input gallery. We fixed this issue.
  • Previously, bulk labeling of the last remaining unlabeled inputs didn't yield the expected results. We fixed this issue, ensuring that these inputs are correctly labeled after your bulk labeling action.

Input-Viewer

StatusChangeDetails
new-featureAdded ability to view and tag text inputs within the Input-Viewer
  • We have designed a comprehensive UI that allows you to interactively create and manage annotations for text inputs.
bugImproved keyboard shortcut functionality in Input-ViewerIn the Input-Viewer, you can use keyboard shortcuts (hotkeys), such as H, V, P, and B, to switch between annotation tools.

  • Previously, when opening the model selector or any other element with a popover while in the Input-Viewer, typing any of the hotkeys would unintentionally change tools in the background. We fixed the issue, and the hotkeys do not now trigger events that affect tools in the background.
bugEnabled error-free transition to annotation mode in Input-Viewer
  • Previously, there was an error immediately after switching to annotation mode in the Input-Viewer. We fixed the issue.
bugFixed issue preventing collaborators from creating annotations in Input-Viewer
  • Collaborators can now actively participate in the annotation process, contributing to a more collaborative and efficient workflow.
bugImproved the Input-Viewer's URL handling to ensure a more seamless navigation experience
  • Previously, there was an issue where the input ID part of the route parameters was not utilized effectively for rendering, leading to undesired redirects. We fixed the issue.

Invitations

StatusChangeDetails
new-featureYou can now seamlessly review and accept pending organization invitations directly within the Portal, eliminating the need to rely solely on email for this purpose
  • These invitations could be for various actions, such as app collaboration, organization enrolment, or task participation. This is valuable for both our SaaS offering and our on-premise deployments, as it caters to scenarios where email support may be limited or unavailable.

Organization Settings and Management

StatusChangeDetails
bugFixed an issue with displaying incorrect menu items in the mobile view
  • Previously, when you switched from your personal user account to an organization account by clicking your profile icon at the top-right corner of the navigation menu bar, the drop-down list displayed your personal details instead of the organization’s information. We fixed the issue.
bugFixed an issue where an organization contributor could not access public workflows
  • Organization contributors (organization members) can now fetch a complete list of all public workflows without any hindrances.
bugEnabled organization contributors to view available destination apps in Install Module Modal
  • We fixed an issue that previously hindered organization contributors from viewing the list of available destination apps within the Install Module modal when attempting to install a module.
bugFixed an issue with searching for organization members
  • Previously, when you used multiple parameters, such as both first name and last name together, to search for members whose first name or last name matched the query text, it could result in an error within the response. We fixed the issue.
bugFixed an issue where collaborators with the organization contributor role failed to list model evaluations
  • Previously, collaborators trying to list model evaluations encountered an error message stating "Insufficient scopes", despite the expectation that the role would grant them access to view evaluations. We fixed the issue.

Apps

StatusChangeDetails
improvementEnhanced App Settings page to display details of collaborators
  • Now, you can easily access and view the details of your collaborators, including their ID, first and last name, email, job role, and the date they were added to the app.
bugFixed an issue where the app thumbnails were not cached properly
  • Previously, there was an issue where the images of uploaded app thumbnails on the App Overview page and on the drop-down sidebar list, which provides quick access to your available apps, occasionally appeared as blank or missing. We fixed the issue.

Login/Logout and Signup Flow

StatusChangeDetails
improvementIntroduced modal pop-ups for login and signup, and for various scenarios where redirects were previously employed
  • We have retained dedicated login and signup pages while introducing modal windows for these actions. You can now access login and signup functions directly from your active page, providing quick and easy access to these essential features.
  • For operations like "Use Model," "Use Workflow," "Install Modules," and more, we have replaced the redirection process with modal pop-ups. This eliminates the extra step and ensures a smoother user journey.
bugFixed an issue with the reCAPTCHA system
  • We improved the reCAPTCHA system to offer users a notably smoother and more user-friendly experience.

Workflows

StatusChangeDetails
bugFixed an issue with processing videos using the Universal workflow
  • You can now confidently process videos with the Universal workflow without encountering any hindrances or issues.
bugFixed an issue with editing a workflow
  • Previously, while editing any workflow, the model version displayed "No results found," which was inconsistent with the initial workflow creation experience. The model version behavior now matches what is displayed when initially creating a workflow.
bugRemoved the default/base workflow from "Use Model" modalTo use a model in a workflow, go to the model’s viewer page, click the “Use Model” button at the upper-right corner of the page, select the “Use in a Workflow” tab, and select a destination app and its base workflow. You’ll be redirected to the workflow editor page.

  • Previously, if you tried to update the workflow in the editor page, you could encounter an error. The issue arises because the app's default/base workflow cannot be edited, but this limitation is communicated to the user late only after they've made changes to the workflow. We fixed the issue by graying out or excluding the base workflow option when users attempt to use a model in an existing base workflow.
StatusChangeDetails
new-featureAdded ability to perform text-based searches within the markdown notes of apps, models, workflows, modules, and datasets
  • For instance, when you visit https://clarifai.com/explore/models and input "detecting the presence" in the search field, the results will include any relevant resource where the phrase "detecting the presence" is found within the markdown notes. This feature enhances search functionality and allows for more precise and context-aware discovery of resources based on the content within their markdown notes.

Cover Image

StatusChangeDetails
new-featureAdded cover image support for various types of resources, including apps, datasets, models, workflows, and modules
  • This feature adds a visually engaging element to your resources, making them more appealing and informative. You can also delete the image if you want to.