An edge package installs MLX and the Neural Engine on M1 and M2 Macs
Joshua Warren, of the M team, said one edge-channel package now installs MLX and the Neural Engine driver on an M1 or M2 Mac, in this note.
The command he gave is pacman -S omarchy-mac-ml. Warren said a 9B model generates text 35 percent faster on Linux, and that the stable channel is next.
He said M3 support is pretty close, that much of the newer hardware still exists only in pull requests, and that he expects more of Apple Silicon on Omarchy in the next few weeks, in a reply.
Asked about the gap with macOS, Warren said it is driver maturity, mostly the Mesa Honeykrisp driver, which he is optimizing, and that he expects performance parity, in another reply.
He pointed at omarchy-mlx as a starting point for the source, in a third reply.