Nightly Omarchy QA is still to come, and the site is private
ThePrimeagen said Omarchy QA will start running against nightly every day, with huge hurdles still to figure out. He said the site is private for now. David Heinemeier Hansson said that work can replace the manual release testing of the first year.
ThePrimeagen wrote that Omarchy QA is going slower than he hoped, and that this is his second fully running agent test harness, where the agents decide what is good. He described a dashboard with cancellable states, and jobs, suites, and servers with the states and transitions he would expect from build servers. He wrote that he can follow a live job and cancel it.
He wrote that he has not had time to get the custom harness running fast. He wrote that, starting that day, he is going to hook up nightly builds and run this against production. He wrote that he will think about a public site, and that for now it is private.
David Heinemeier Hansson wrote that he spent hours manually testing and verifying Omarchy releases during the first year, and that with Prime leading the QA effort they can replace that toil with agents.