India, April 25 -- Microsoft Phi-3, a family of open AI models that are highly capable and cost-effective small language models (SLMs) has recently been introduced. The Phi-3 mini is a 3.8B language model and is the first model in its class to support a context window of up to 128K tokens with little impact on quality. It is an instruction-tuned model trained to follow different instructions reflecting how people normally communicate.

The model is available on Azure AI to take advantage of the deploy-eval-finetune toolchain and on Ollama for developers to run locally on their laptops. It has been optimized for ONNX Runtime with support for Windows DirectML along with cross-platform support across graphics processing unit (GPU), CPU, and ...