New Delhi: On Monday, June 23, 2025, Microsoft announced the unveiling of its on-device small language model, Mu, which will enable users to change settings through natural language queries. The company said that Windows Insiders in the Dev channel with Copilot+PCs can access Mu.
This AI agent for Windows 11 settings was included in the existing search box for a seamless user experience, the company said. Mu is fully offloaded onto the Neural Processing Unit and responds at over 100 tokens per second, meeting the demanding UX requirements of the agent in the Settings scenario, as noted by Vivek Pradeep, VP and Distinguished Engineer at Windows Applied Sciences, in a company blog.
Trained across multiple phases using Nvidia’s A100 GPUs on Azure Machine Learning, Mu followed a similar technique to Microsoft’s previous small language model, Phi.
It was pre-trained on hundreds of billions of the highest quality educational tokens to learn language syntax, grammar, semantics, and some world knowledge. Mu was then distilled from the Phi models to enhance accuracy.
