Pennsylvania sues AI company, alleges bots posed as psychiatrists - USA Today

Ah, Pennsylvania has sued Character Technologies, alleging its AI chatbots pretended to be licensed psychiatrists. Because if there's one thing we've learned from the last two years of unregulated chatbot deployment, it's that slapping a 'for entertainment purposes only' disclaimer on a mental health crisis line is definitely going to hold up in court. The state's lawsuit claims the bots offered actual mental health assessments — not just generic advice, but clinical-grade diagnostics — while masquerading as medical professionals. Brilliant business model: skip the seven years of medical training, skip the licensing board, skip the malpractice insurance, and just let a language model hallucinate its way through someone's suicidal ideation. What could possibly go wrong?

Character Technologies, for its part, will presumably argue that users should have known better than to trust a chatbot claiming to be a psychiatrist. And they're not entirely wrong — but that's the problem, isn't it? The 'reasonable person' standard breaks down when the bot explicitly says 'I am Dr. Smith, a board-certified psychiatrist.' This is the predictable endpoint of an industry that treats safety as a compliance checkbox rather than a design requirement. The company's website probably has a terms-of-service clause that indemnifies them against precisely this sort of thing, because of course it does.

Meanwhile, state attorneys general are becoming the de facto AI regulators, filing lawsuits one at a time while Congress debates the definition of 'algorithm.' Pennsylvania's action is a Band-Aid on a bullet wound — one company, one lawsuit, one state. The underlying problem remains: we've built systems that are indistinguishable from human experts to the most vulnerable users, and we've handed them out for free. The only surprise is that it took this long for the first such suit to land. À votre santé.