Welcome Guest! You are here: Home » Science & Technology

'Phi-3-mini': Microsoft releases its smallest AI language model

Tech giant Microsoft Tuesday announced the launch of the Phi-3 family of open models, introducing Phi-3-mini, which is billed as the company's smallest AI language model.

Thursday April 25, 2024 5:57 PM, ummid.com News Network

San Francisco: Tech giant Microsoft Tuesday announced the launch of the Phi-3 family of open models, introducing Phi-3-mini, which is billed as the company's smallest AI language model.

Phi-3-mini

While Phi-3-mini is available for users after the launch, Phi-3-small and Phi-3-medium will be launched in the coming days.

“Phi-3 models outperform models of the same size and next size up across a variety of benchmarks that evaluate language, coding and math capabilities, thanks to training innovations developed by Microsoft researchers”, the company said in a blog post.

“Microsoft is now making the first in that family of more powerful small language models publicly available: Phi-3-mini, measuring 3.8 billion parameters, which performs better than models twice its size”, it added.

Phi-3-mini will be available in the Microsoft Azure AI Model Catalog and on Hugging Face, a platform for machine learning models, as well as Ollama, a lightweight framework for running models on a local machine from Tuesday.

“Phi-3-mini will also be available as an NVIDIA NIM microservice with a standard API interface that can be deployed anywhere”, Microsoft said.

Phi-3-small, Phi-3-medium launch date

Microsoft further said that the additional models to the Phi-3 family will be launched soon. They will offer more choice across quality and cost.

“Phi-3-small (7 billion parameters) and Phi-3-medium (14 billion parameters) will be available in the Azure AI Model Catalog and other model gardens shortly”, Microsoft said.

Large vs Small Language Models

Large language models are more suited for applications that need orchestration of complex tasks involving advanced reasoning, data analysis and understanding of context.

Small language models also offer potential solutions for regulated industries and sectors that encounter situations where they need high quality results but want to keep data on their own premises, Sonali Yadav, Principal Product Manager for Generative AI at Microsoft, said.

Choosing the right language model depends on an organization’s specific needs, the complexity of the task and available resources. Small language models are well suited for organizations looking to build applications that can run locally on a device (as opposed to the cloud) and where a task doesn’t require extensive reasoning or a quick response is needed, according to Microsoft.

Small AI models are often less expensive to run and perform more better on personal devices like phones and laptops as juxtaposed to their larger counterparts.

Phi-3-mini is as capable as large language models, LLMs, like GPT-3.5 “just in a smaller form factor,” Eric Boyd, corporate vice president of Microsoft Azure AI Platfom.

Select Language To Read in Urdu, Hindi, Marathi or Arabic.

 

..