AI-Prescribed Psychiatric Medications: A Double-Edged Sword in Utah

Utah has taken a bold step by allowing an AI system to prescribe psychiatric drugs without human oversight. This marks only the second time in the country’s history that such clinical authority has been delegated to artificial intelligence. While proponents argue that this could bring costs down and ease care shortages, critics warn of the risks involved in automating routine aspects of psychiatric care.

The one-year pilot program, announced last week, will enable Legion Health’s AI chatbot to renew certain prescriptions for psychiatric medications. The San Francisco-based startup claims its platform can provide “fast, simple refills” through a $19-a-month subscription. However, the scope of this program is deliberately narrow, limited by the types of medications and conditions that qualify.

According to the agreement with Utah’s Office of Artificial Intelligence Policy, the chatbot can only renew prescriptions for 15 lower-risk maintenance medications that have already been prescribed by a clinician. This includes commonly used treatments for anxiety and depression, such as Prozac, Zoloft, Wellbutrin, mirtazapine, and hydroxyzine. Patients must also meet specific criteria to qualify, including being considered stable and having no recent changes in their medication or treatment.

The system cannot issue new prescriptions or handle medications that require closer clinical oversight, including controlled substances. This leaves many more complex psychiatric cases outside the pilot’s scope, raising concerns about the potential for over-treatment and under-management of patient care.

Patients must opt-in to use the system, verify their identity, and provide proof of a valid prescription. They will then be asked questions about their symptoms, side effects, and efficacy of the medication. The chatbot will also log red flags related to suicidal thoughts, self-harm, severe reactions, and pregnancy. If any answers fall outside the pilot’s low-risk criteria, the case will be escalated to a clinician before any refill is issued.

State officials tout the benefits of this program, including faster and more affordable care, as well as freeing up healthcare providers to focus on more complex cases. However, psychiatrists are less convinced. Dr. Brent Kious, a professor at the University of Utah School of Medicine, believes that the advantages of an AI-based refill system may be overstated and that it will not increase access for those who are most in need of care.

Dr. John Torous, director of digital psychiatry at Beth Israel Deaconess Medical Center and professor of psychiatry at Harvard Medical School, raises concerns about the potential for over-treatment and under-management of patient care. He notes that some patients may benefit from staying on psychiatric medications long-term, while others may benefit from reducing or stopping them. “They require more active management, changes, and careful consideration,” he said.

Ultimately, the success of this program will depend on its ability to strike a balance between efficiency and effectiveness in delivering mental health care. While AI has the potential to revolutionize healthcare, it is crucial that we proceed with caution and transparency, ensuring that patients receive high-quality care that is tailored to their unique needs.

Analysis based on: https://www.theverge.com/ai-artificial-intelligence/906525/ai-chatbot-prescribe-refill-psychiatric-drugs