Otto Williams
Apr 25, 2024
Unlocking the potential of AI with Microsoft's Phi-3 while driving innovation at Spectro Agency. Learn how our expertise in digital marketing, AI solutions, and app creation can elevate your business
Microsoft's Phi-3 is making waves in the realm of tiny open-source models, showcasing its dominance over Meta's Llama 3. In a recent development, Harkirat Behl, one of the creators behind this groundbreaking model, unveiled Phi-3, the latest offering from Microsoft. "One of the things that makes Phi-3 better than Meta’s Llama 3 and other models is that its 3.8 billion parameter size is very well suited for fitting on a phone," Behl explained.
Phi-3-Mini, a 3.8 billion parameter language model, has been trained on an extensive dataset of 3.3 trillion tokens. Despite its compact size, Phi-3-Mini demonstrates performance levels that surpass recent benchmarks, including Meta's Llama 3 8B, on MMLU benchmarks. Remarkably, Phi-3-Mini can operate locally on a cell phone, occupying approximately 1.8GB of memory when quantised to 4 bits. Microsoft's rigorous testing involved deploying Phi-3-Mini on an iPhone 14 with an A16 Bionic chip, achieving impressive speeds of more than 12 tokens per second while running natively on the device and fully offline.
Expanding their lineup, Microsoft has introduced Phi-3-Small and Phi-3-Medium models, both significantly more capable than Phi-3-Mini. The Phi-3-Small 7 billion parameter model notably outperforms Meta’s recently launched Llama 3 8B Instruct on MMLU benchmarks.
However, it's essential to approach these advancements with a critical eye. While Phi-3-Mini demonstrates prowess in English, it currently lacks support for other languages, posing limitations for developers outside this linguistic sphere. Nonetheless, the innovation behind Phi-3-Mini lies in its meticulously curated training dataset and optimization for robustness, safety, and chat format.
In light of these developments, it's plausible that forthcoming models could outshine even OpenAI's GPT-4. Meta's endeavors, with a model boasting around 400 billion parameters, also promise a formidable competitor in the future landscape.
At spectroagency.com, we specialize in high-end digital marketing, app creation, AI-powered solutions, chatbots, software creation, and website development. Leveraging cutting-edge technologies, we empower businesses to thrive in the digital age.