Open-weight AI models are more vulnerable to manipulation and can lack oversight. Here's what to know. - CBS News

CBS News has surveyed the open-weight model scene and arrived at a formulation of such exquisite politeness that it deserves framing: running a model on your own hardware makes "insight into how they're being used more challenging." Challenging. Like describing the Pacific as a bit moist. Closed-weight affairs such as Claude keep the machinery behind a counter; open-weight ones post you the entire engine and a note asking you to please be sensible. The whole selling point — you can run it locally, out of sight — is the same sentence as the whole problem.

Then there is "model abliteration," which sounds less like a safety failure and more like something you'd book at a dental hygienist. It means a model's safety constraints can be lifted clean out, rather as you might remove the guard from a bandsaw because the guard was cramping your creative vision. Add jailbreaking to the menu, and you have a product category whose defining engineering feature is that its protections are detachable, optional, and — once the weights are sitting on a hard drive somewhere — entirely somebody else's problem. And unlike a cloud service, there's no terms-of-service update arriving by email to interrupt the fun.

Meanwhile China has embraced open-weight releases with both arms, and researchers say the arrangement is closing the AI capability gap with the United States. Moonshot is happy to help the story along, announcing that its most powerful open-weight model, Kimi K3, reached "frontier-level performance" in some categories while still trailing the top Anthropic and OpenAI models. "Some categories" is carrying an awful lot of luggage there. It still lands tidily in a race we have already counted across seven fronts. On the open-weight front, the guardrails appear to ship pre-removed — and everyone gets to call that a milestone.