Fil Bezerianos

The Rise of Task-Specific Models

Choosing the right model for your specific needs

Nov 26, 2024 - 3 minute read

Prefer listening over reading? 🎧 Listen (AI-Generated Audio Version)

Image Text

LLMs have revolutionised text-based AI solutions, significantly impacting various industries. While AI text-generation solutions offer multiple benefits across multiple workflows and can be applied to different solution types, they are not always the optimal choice.

The popularity of General-Purpose Models

Several organisations are increasingly adopting AI solutions to improve efficiency and drive innovation, spanning areas like customer service, content creation, and data analysis. Often, organisations begin by exploring available technologies, like general-purpose LLMs for text generation, and then seek relevant use cases within their industry and organisation to apply these technologies.

However, this approach poses several risks. Organisation may overlook valuable use cases that could benefit more from other types of models. The current landscape is heavily influenced by announcements surrounding these LLMs and their applications. While these models are powerful and versatile, they are not always the best fit for every task.

Task-Specific Models

Many tasks benefit more from specialised, often smaller, models, tailored for specific functions, like image-processing or task-specific questioning-answering. These models are optimised for particular types of data and tasks, enabling more accurate, efficient, and relevant outcomes in certain applications.

Moreover, the output of the general-purpose text-generation models may not always be in a format conducive to easy post-processing. Although techniques like prompt engineering can help format outputs to specific structures, this is not guaranteed due to the probabilistic nature of these models. In contrast, the output format of specialised models is often more suitable for further processing, allow for more precise results.

Maintaining familiar workflows for the user

As discussed in a previous article, user experience is crucial when integrating AI into a product or workflow. Maintaining a familiar workflow while augmenting it with AI can be highly beneficial. For instance, leveraging a general-purpose text-generation approach, like adding a chatbot, relies on the user to prompt the model in specific ways to get the most accurate results.

In many cases, it is important to ensure standardised output across different solution workflows, independent from user input. Task-specific models can facilitate this standardisation, providing consistent and reliable outputs that integrating into existing workflows.

Image-processing and questioning-answering

Consider a reference solution designed to assist individuals searching for new properties. The solution maintains a familiar workflow for the users when they search for a new property. While a chatbot could be used, allowing users to describe their ideal home, a “visual questioning-answering” model was deployed instead. This choice enables the creation of a standardised model and allows for further analysis of the AI results, keeping them independent from user input.

In addition, leveraging a “visual questioning-answering” model allows for quicker fine-tuning to meet specific requirements and structuring the output format to further processing. This approach compensates for any inaccuracies of the model, ensuring more accurate results for the end-user.

Conclusion

While multimodal, general-purpose models are undeniably powerful, organisations must analyse their specific use cases to determine whether this is the best model type for their solutions. Often, leveraging smaller, task-specific models requires less management effort and leads to better results.