AI in Healthcare: Weighing the Benefits and Risks

By Copic’s Patient Safety and Risk Management Department

The incredible speed at which artificial intelligence (AI) has been adopted in medicine has outpaced the regulatory environment that would typically provide guidance and rules regarding its use. As of the writing of this article, no federal regulation exists to clearly answer common questions.

Given all the uncertainty, the bedrock of a safe strategy for the use of AI is the guidance that providers should always review the output of AI before it reaches the patient or becomes part of the medical record. Failure to review notes or communication drafted by AI presents substantial medico-legal risk.

Virtual Scribing and Consent

Artificial intelligence has already been widely adopted for use as a virtual scribe during patient encounters with the promise of providing a substantial increase in provider efficiency and satisfaction. Use of this technology involves some form of recording of the patient encounter. As such, patient consent for this recording may be required in some circumstances to comply with state and local laws. Even if not explicitly required, we recommend that verbal consent from the patient be obtained prior to utilization of an AI virtual scribe for the encounter. This consent may provide some protection for the provider from allegations of negligent consent (a lack of informed consent) and helps promote continued trust in the provider-patient relationship.

The rules regarding documentation of this consent are unclear, but some form of contemporaneous documentation in the chart is best practice. We recommend against any automatic blanket statement added to charts indicating that AI technology was used and that errors may be present in the chart as a result. It remains the provider’s sole responsibility to ensure that the documentation is accurate, and disclaimer statements may provide a false sense of security that errors are somehow not the provider’s responsibility or an impression to the patient or third parties that a provider is detached from what is in the chart notes and has not fully reviewed the chart.

Other Considerations

Many of the major electronic health record (EHR) vendors are in the process of rolling out generative AI solutions to aid in direct communication with patients. These fall along a spectrum, from tools that act simply as a glorified spelling and grammar check, to tools that allow a response to be translated to a different reading level, all the way to de novo generation of a response to a patient question. Regulations regarding consent and notification for use of this application of AI are even more opaque than for virtual scribing.

In response to understanding the preceding information, it remains imperative that all responses that have been generated or edited by AI are fully reviewed by a medical professional prior to being sent to a patient. Several studies have already demonstrated that AI solutions may generate advice that, if followed, can directly lead to patient harm. Providers need to keep sight of the fact they need to remain vigilant to catch potential errors in these responses. As a best-practices approach, AI-generated responses may be viewed as a “first/rough draft” and not sent to a patient without review and correction by a qualified provider, as the legal liability continues to rest with the medical entity sending the communication.

The use of generative AI in medicine offers the potential for significant relief from some of the more mundane and frustrating tasks associated with the practice of medicine, but it also brings with it a new set of potential risks, both to patient safety and to provider liability. Using these new tools safely requires all providers to be aware of the importance of reviewing any output generated by AI before it becomes ready for incorporation into the medical record or visible to patients.

The information provided herein does not, and is not intended to constitute legal, medical, or other professional advice; instead, this information is for general informational purposes only.