Muse Spark Open is reported on old Omarchy laptops
Joshua Warren said he ran all 816B parameters of Muse Spark Open, at 2-bit, on three old M1 and M2 laptops running Omarchy and a 2022 Mac Studio on macOS, in this post. He linked an omarchy-cluster receipt.
Warren wrote that Meta and Apple showed Muse Spark Open on new M5 Mac Studios, and that no $40K cluster was needed for his run. He wrote that omarchy-cluster runs big models on whatever you own.
Asked what token rate the cluster was getting, Warren said only 2 tokens per second so far, with no performance optimizations yet. He said he should be able to greatly boost that time.