Apple’s big AI week ends with Mac + Muse AI supercomputers

Welcome to the week Apple became even more serious about artificial intelligence on Macs, with the company continuing to make moves to deliver the tech in the most cost effective, responsible way. While it’s true that today isiPhone Duo pre-order day, that’s arguably not really the big news. It is not the big news because Apple this week made huge steps in AI. Not only has it come up with a nifty tool to turn Macs into distributed inferencing data centers; not only does it now have a plan for Apple Intelligence in China; but it has also worked with Meta to make it possible to run on-premises instances of Muse Spark Open on a couple of Mac Studios. While working on that, its machine learning team also introduced a new version of MLX that enables AI researchers and developers to run large language models (LLMs) locally on Mac Studio with Apple silicon. What’s new to MLX from Apple?In case you’d missed it, MLX leverages the unified memory architecture of Apple silicon, which is invaluable if you want to build new inference and fine-tuning methods. Over the past year, the ML team has worked on “several key innovations” to make it easier and more efficient to “run state-of-the-art LLMs…

≈