'Tiny but mighty' is how Microsoft describes Phi-3, its new family of small language models
Microsoft released Phi-3-mini, a 3.8 billion parameter model small enough that it can be run in contexts with constrained hardware and network resources. Its strong performance is the result of carefully curated dataset-construction and training processes.