Deploying Generative AI in Healthcare with Dr Dan Elton of the National Institutes of Health Emerj Artificial Intelligence Research

Considerations for the Responsible Use of Generative AI in Healthcare

In the retrieval stage, when receiving a user query, the retriever searches for the most relevant information from the vector database. In the generation stage, both the user’s query and the retrieved information are used to prompt the model to generate content. Recently, deep learning technology has shown promise in improving the diagnostic pathway for brain tumors. With a CNN, users can evaluate and extract features from images to enhance image classification. The ‘deeper’ the DNN, the more data translation and analysis tasks can be performed to refine the model’s output. This type of ML algorithm is given labeled data inputs, which it can use to take various actions, such as making a prediction, to generate an output.

• We might not have to make the exact same sequences of 81 clicks and keystrokes all day every day for each and every patient.
• AI-powered tools can streamline the coding process, reducing administrative burden and ensuring that claims are accurately submitted.
• Additionally, AB 3030 is not applicable to communications pertaining to administrative and business matters, such as appointment scheduling, check-up reminders, and billing.

As GenAI adoption accelerates in the healthcare sector, firms are seeing substantial returns on their investments by focusing on innovation and customer service. But the cautious approach to GenAI in areas like fraud prevention and cybersecurity reflects a prudent strategy, balancing innovation with operational security. For healthcare firms, the challenge will be to keep scaling their AI capabilities strategically, making GenAI a valuable long-term asset that supports both technological and patient-centered objectives. These firms see GenAI as a high-stakes investment where deeper financial commitment equates to better outcomes, from enhanced diagnostics to streamlined patient interactions. This insight underscores the need for healthcare firms to scale GenAI strategically, recognizing that meaningful returns may require higher upfront investments, particularly in areas with high potential for patient impact and operational efficiency. On September 28, 2024, Governor Gavin Newsom signed into law California Assembly Bill 3030 (“AB 3030”), known as theArtificial Intelligence in Health Care Services Bill.

ChatGPT can be used as helpful tool to help kick off the intervention planning process and help generate some ideas. Explore the impact of generative AI on the educational experience of OT students in terms of engagement, learning efficiency, and satisfaction. Generative AI in healthcare offers promise for tasks such as clinical documentation, but clear regulations and standards are needed to maximize benefits and minimize risks. In a November interview with HealthITAnalytics, leaders from Sentara Healthcare and UC San Diego Health discussed whether clinicians will come to rely too heavily on these technologies and how health systems interested in pursuing AI deployment can navigate those concerns. Further, 40 percent of physicians reported being ready to use these technologies by the end of 2024, specifically to bolster interactions with patients at the point of care. And both patients and physicians have embraced telehealth as a supplement to, rather than replacement for, in-person visits.

By prioritizing data quality, governance and high-value use cases, health systems can more effectively navigate the ever-shifting digital health landscape. He pointed out that while EHRs have digitized patient records, the tools haven’t necessarily made providers’ lives easier. AI could improve the functionality and usability of EHRs by enabling more integrated, cloud-based systems that offer predictive insights and bolster patient care. Dunbrack further noted that IDC’s August 2024 “Industry Tech Path” survey found that 26.1% of healthcare respondents have a proof-of-concept project for GenAI-enabled clinical decision support systems, and 40.6% report that this use case is in production.

Patient Journey Prediction

The significant improvement in students’ understanding of ethical and safety considerations mirrors concerns raised in the literature about responsible AI’s integration into healthcare (17). Divided opinions on evidence-based research aligning with AI-generated suggestions reflect ongoing discussions about balancing AI innovation with professional standards (9). Navigating the challenges of creative intervention planning can pose a significant challenge for occupational therapy (OT) students during their full-time clinical placements, otherwise known as Level II Fieldwork. Many OT students have expressed a sense of lacking concrete interventional knowledge, resulting in feelings of incompetence and uncertainty regarding their ability to deliver effective interventions, and a desire for more examples to draw from in clinical practice (1, 2). Developing intervention planning skills in Level II fieldwork prepares students for independent practice and a successful transition into the OT role (2). The generative AI journey is just getting started, with more than 60% of hospital administrators reporting that their organizations aren’t ready to successfully incorporate generative AI at scale.

“There is a risk that we’re going to create all kinds of innovative solutions that are really only available for sophisticated health systems,” he explained. But he added that GenAI has seen uptake in healthcare that other tools — like blockchain — haven’t, with health systems and vendors working quickly to integrate AI into their product offerings and workflows, making the technology more accessible than many other innovations. Cribbs emphasized that hurdles like AI bias, data drift and monitoring are already constraining the deployment of these technologies across the industry. Similarly, Dunbrack highlighted that data access and quality have been, and will continue to be, pain points, with many healthcare organizations reporting that data bias, trustworthiness and risk management are some of their top concerns when implementing GenAI. The other top feature of generative AI in 2025 will be its role in providing personalized medicine.

Author & Researcher services

Precision medicine aims to maximize medical effectiveness and patient benefits by tailoring treatment strategies according to a patient’s genetic profile, environmental influences, lifestyle, and other individual factors40. Although current generative AI models have demonstrated potential to assist in clinical decision-making35,41, they still face challenges in precision medicine42, as they struggle to utilize highly individualized patient data to provide precise treatment recommendations. GANs can generate synthetic medical images to train diagnostic and predictive analytics-based tools.

Generative AI solutions such as AWS HealthScribe are equipped with speech recognition to automatically create robust transcripts, extract key details (e.g., medical terms and medications) and create summaries from doctor-patient discussions. GenAI’s learning and performance potential makes it easy to augment an array of tasks, lifting pressure off clinicians. By the sheer virtue of its immense computational power, GenAI can read, interpret and action vast amounts of specialized information within a few seconds. A GenAI-based system can understand and synthesize the most important details from a vast amount of information, potentially saving a clinician about 20% of their time to spend on the things that matter. Automating these repetitive administrative tasks that traditionally require manual labor and massive time commitments helps improve healthcare professionals’ work-life balance as they deliver high-quality care.

The application should effortlessly pull data from various healthcare sources, such as EHRs and imaging databases, for model training and generation tasks. Establish clear guidelines and standards for the use of Generative AI in your healthcare business. This implementation of Generative AI necessitates incorporating robust data privacy measures and ensuring stringent adherence to existing regulations. Additionally, fostering a deep understanding of Generative AI and healthcare within your team will help in aligning these advanced technologies with patient safety and confidentiality standards.

Around 76% of physicians and 78% of consumers view it as a complement to in-person care, whereas just 13% and 12%, respectively, view it as a substitute. In fact, consumers are significantly more comfortable with generative AI supporting their doctor than they are interacting with it themselves. Today, only around 48% of US consumers say that they are comfortable with at least one generative AI application in healthcare.

3 Key Principles to Ensuring Ethical AI Use in Healthcare – HIT Consultant

3 Key Principles to Ensuring Ethical AI Use in Healthcare.

Posted: Wed, 22 Jan 2025 17:21:27 GMT [source]

Using the NeMo and NIM platforms for AI model customization will offer diverse possibilities, while TensorRT will enhance computational efficiency and real-world model applications, fostering the development of AI technologies in smart healthcare. Studies in China show how large language models can improve primary healthcare systems, but equitably scaling this technology will require attention to rural, low-resource settings and the companion policies that support its implementation. I anticipate a future where predictive analytics can forecast public health crises before they occur, where treatment plans are tailored to an individual’s unique genetic makeup and where AI-powered telemedicine bridges gaps in healthcare access.

Clinical Decision Support Systems

We’re all too familiar with data leaks and hacks, and the number and severity of attacks today are only increasing. GenAI can shorten the patient’s wait times and allow life-saving treatments to be delivered sooner. If you think about the number of patients one doctor sees in a day, which was between 11 and 20 in 2018, this takes a heavy load off. In the same year in the U.S., roughly every 300 doctors served 100,000 patients, making GenAI’s support in this arena significant.

Professor Ortiz Catalán, Head of Neural Prosthetic Research at the Bionics Institute in Australia, led research which resulted in the creation of the “highly integrated bionic hand that can be used independently and reliably in daily life”. NLU is concerned with computer reading comprehension, focusing heavily on determining the meaning of a piece of text. Deep learning (DL) is a subset of machine learning used to analyze data to mimic how humans process information. DL algorithms rely on artificial neural networks (ANNs) to imitate the brain’s neural pathways. Further, AI models can be classified as either ‘explainable’ — meaning that users have some insight into the “how” and “why” of an AI’s decision-making — or ‘black box,’ a phenomenon in which the tool’s decision-making process is hidden from users. But to effectively harness AI, healthcare stakeholders need to successfully navigate an ever-changing landscape with rapidly evolving terminology and best practices.

Discrepancies or uncertainties were addressed through dialog and consensus, fostering a rigorous and transparent analytical process. Despite these efforts to ensure inter-rater reliability, the coding process remains inherently subjective. Researchers’ interpretations may still influence the categorization of responses, which could affect the consistency of the findings. The research team engaged in a qualitative analysis process to code narrative responses to questions and identify themes. The initial phase involved the primary researcher reviewing the narrative responses to the three questions individually, identifying initial themes or patterns, and coding the data accordingly.

Third, although RAG systems can enhance transparency by providing evidence, determining which parts of a response are derived from which pieces of retrieved knowledge is difficult without human inspection. Meanwhile, possible knowledge conflicts between retrieved documents or with the model’s internal knowledge highlight the importance of source validation, though effective implementation remains challenging45. Fourth, RAG systems face certain privacy risks, as sensitive information stored in retrieval databases can be extracted through designed prompts. Implementing appropriate privacy protection mechanisms is crucial to mitigate the risk of information leakage in generated content, especially when handling sensitive medical information46. Therefore, we suggest a multidisciplinary collaboration among clinicians, researchers, stakeholders, and regulators to explore how RAG can be used more equitably, reliably, and effectively to improve existing practices in health care.

Building a generative AI-ready healthcare workforce

But when we’re talking about deploying these tools, it’s important to focus on how healthcare organizations are preparing their workforce to deal with the technology influx. AI should serve as a tool that supports, not defines, the goals of healthcare organizations. While AI can enhance decision-making and optimize processes, its true value lies in complementing human expertise and aligning with the broader objectives of the healthcare system, such as improving patient outcomes, enhancing the quality of care, and driving cost efficiency.

Generative AI Use Cases in Healthcare – Netguru

Generative AI Use Cases in Healthcare.

Posted: Fri, 22 Nov 2024 08:00:00 GMT [source]

The NLR does not wish, nor does it intend, to solicit the business of anyone or to refer anyone to an attorney or other professional. NLR does not answer legal questions nor will we refer you to an attorney or other professional if you request such information from us. The committee also emphasized that the agency must keep in mind the impact of these devices on health equity.

However, generative AI offers the potential for clinicians to articulate their reasoning in natural language that AI translates into CQL code. Who wouldn’t love an amazing meal surrounded by your people with a bona fide opportunity to reflect, recharge, and reconnect? It also sounds like the perfect solution for an aching healthcare system that could use a little reflection, recharging, and reconnection. The practice of medicine hinges on overstretched doctors and nurses whose primary focus should be managing human life and making real connection – but are instead fighting off the distraction of administrative redundancy and constant faceless downward pressure.

In this way, algorithms developed using reinforcement techniques generate data, interact with their environment, and learn a series of actions to achieve a desired result. Unsupervised learning uses unlabeled data to train algorithms to discover and flag unknown patterns and relationships among data points. In addition, they said the FDA should consider establishing new frameworks for understanding the impact of generative AI-enabled devices on society once they are on the market. Join over 20,000 AI-focused business leaders and receive our latest AI research and trends delivered weekly.

Generative AI in particular will help with data extraction, particularly from unstructured data, and in communication. The role of generative AI across the healthcare industry is poised to deepen in the year 2025. This is not just a tool but a transformative technique to reshape the drug discovery landscape.