"Ben Horowitz on why open source has always been the safer path: "If you look at the history of the industry, the open source version of everything has been much safer. The internet and Linux were far safer than Windows, by a lot. And why is that? Because the whole community could work on the..." Reddit
...safety problems, as opposed to just a company, and particularly a monopoly company." "Even if Windows has a million security bugs, there's nothing we can do about it, because it was a monopoly at the time. That's a very difficult position for the world to be in." "The argument against AI being open source is, oh, nobody understands how the weights work, so people can't inspect it. But why is it better to not see the weights?" "The toughest safety problem currently is reward hacking. Anthropic has not solved it, OpenAI has not solved it, because we just had these incidents. Shouldn't the whole world be able to look at, how are the weights moving, why is it that guardrails don't prevent the reward hack? Maybe somebody who doesn't work for one of the proprietary labs can come up with an answer. What if the whole community could work on it?" @bhorowitz — MTS