New York lawmakers are advancing legislation that would restrict AI chatbots from providing medical (and legal) advice, reflecting growing concern that users may rely on chatbot responses in high-stakes situations. The bill would also target systems that mimic or impersonate licensed professionals, and it would require clearer transparency so users know they’re interacting with AI rather than a clinician.
Unlike approaches that rely mainly on disclaimers, the proposal would increase accountability by allowing users to pursue civil action against chatbot providers if an AI system delivers unauthorized professional guidance that leads to harm, including the potential recovery of damages and legal fees. The article frames the move as part of a broader effort in New York to strengthen guardrails around generative AI, including protections for minors and stronger disclosure expectations.