USA Trends and Developments Contributed by: Nadia de la Houssaye, Andy Lee, Jason Loring and Graham Ryan, Jones Walker LLP
nerabilities that organisations must address through robust security frameworks. Healthcare organisa - tions face substantial challenges integrating AI tools into existing clinical workflows and electronic health record systems. Technical interoperability issues, user training requirements and change management pro - cesses require significant investment and co-ordina - tion across multiple departments and stakeholders. The Consolidated Appropriations Act of 2023’s requirement for cybersecurity information in pre-mar - ket submissions for “cyber devices” represents an important step towards addressing these concerns, but the rapid pace of AI innovation often outstrips the development of adequate security measures. Medical device manufacturers must now include cybersecurity information in pre-market submissions for AI-enabled devices that connect to networks or process elec - tronic data. Healthcare organisations must implement compre - hensive cybersecurity programmes that address not only technical vulnerabilities but also the human factors that frequently contribute to data breaches. Strong technical safeguards must be implemented when using de-identified data for AI training, includ - ing access controls, encryption, audit logging and secure computing environments, and should address both intentional and accidental re-identification risks throughout the AI development process. A significant concern is the lack of a private right of action for individuals affected by healthcare data breaches, leaving many patients with limited recourse when their sensitive information is compromised. While many states have enacted laws more stringent than federal legislation, enforcement resources may be stretched thin. Human Oversight and Professional Standards In most federal and state regulatory schemes, ultimate responsibility for healthcare AI systems is assigned to the people and organisations that implement it rather than to the AI itself. Healthcare providers must main - tain ultimate authority for clinical decisions even when using AI-powered decision support tools. Health - care AI applications must require meaningful human
involvement in decision-making processes rather than defaulting to fully automated systems. AI systems must provide healthcare providers with clear, easily accessible mechanisms to override algo - rithmic recommendations when clinical judgment sug - gests alternative approaches. Healthcare providers using AI systems must be provided with the tools to achieve system competency through ongoing training and education programmes. At the organisation level, hospitals and health systems must implement robust quality assurance programmes that monitor AI system performance and healthcare provider usage patterns. Medical schools and residency programmes are beginning to incorporate AI literacy into their curricula, while professional societies are developing guidelines for the responsible use of these tools in clinical prac - tice. For digital health developers, these shifts under - score the importance of designing AI systems that complement clinical workflows and support physician decision-making rather than attempting to automate complex clinical judgments. The rapid advancement of AI in healthcare is reshap - ing certain medical specialties, particularly those that rely heavily on image interpretation and pattern rec - ognition, such as radiology, pathology and dermatol - ogy. As AI systems demonstrate increasing accuracy in reading X-rays, magnetic resonance images (MRIs) and other diagnostic images, some medical students and physicians are reconsidering their specialisation choices. This trend reflects broader concerns about the potential for AI to displace certain aspects of phy - sician work, though most experts emphasise that AI tools should augment rather than replace clinical judg - ment. Conclusion: Balancing Innovation and Responsibility The healthcare AI landscape in the United States reflects the broader challenges of regulating rapidly evolving technologies while promoting innovation and protecting patient welfare. Despite regulatory uncer - tainties and implementation challenges, the funda - mental value proposition of AI in healthcare remains compelling, offering the potential to improve diagnos -
147 CHAMBERS.COM
Powered by FlippingBook