Before visiting a hospital for a surgical procedure, patients have many questions about what to expect and can be very nervous.
To minimize pre-surgery anxiety, NVIDIA and Deloitte use NVIDIA AI to develop an AI agent that provides patients with the next generation of digital front-line teammates before they even set foot in the hospital. I’m doing it.
These virtual teammates can have natural, human-like conversations with patients, answer a variety of questions, and provide supportive guidance prior to a pre-admission appointment at the hospital.
This demo shows one virtual representative actually answering a patient’s questions.
Deloitte collaborated with NVIDIA to develop Frontline AI Teammate for use in environments such as hospitals. There, digital avatars can have practical conversations in any language, providing end users, such as hospitalized patients, with instant answers to pressing questions.
Powered by the NVIDIA AI Enterprise software platform, Frontline AI Teammate includes avatars, generative AI, and large-scale language models.
“Avatar-based conversational AI agents present an exciting opportunity to alleviate the productivity paradoxes faced by health systems due to digitization,” said Niraj Dalmia, Partner at Deloitte Canada. “Perhaps it could be a complementary innovation that reduces administrative burden, complements and frees up medical talent, and helps solve patient experience challenges.”
Next-generation technology to empower digital humans
Digital humans can provide life-like interactions that improve the doctor-patient experience.
Developers can create digital humans for healthcare industry applications using NVIDIA NIM microservices, which streamline the development of AI-powered applications and the migration of AI models into production. NIM includes an easily adaptable NIM agent blueprint that developers can use to create interactive AI-driven avatars perfect for telemedicine. Additionally, NVIDIA NeMo Retriever is an industry-leading embedding, retrieval, and reranking model that enables fast response times. About the latest medical data.
Customizable digital humans, like James in the interactive demo developed by NVIDIA, can handle tasks such as scheduling appointments, filling out health forms, and answering questions about upcoming medical services. This makes health services more efficient and more accessible to patients.
In addition to NIM microservices, James uses NVIDIA ACE and ElevenLabs digital human technology to provide natural, low-latency responses.
NVIDIA ACE is a suite of AI, graphics, and simulation technologies to bring digital humans to life. Every aspect of the digital human can be integrated into healthcare applications, from speech and translation capabilities that understand diverse accents and languages to realistic animation of facial and body movements.
Deloitte’s Frontline AI Teammate is powered by the NVIDIA AI Enterprise platform, built on Deloitte’s conversational AI framework, and designed to deliver human-machine experiences in healthcare settings. Deloitte’s lifelike avatars, developed within the NVIDIA Omniverse platform, can answer complex, domain-specific questions critical to healthcare delivery.
Avatars use NVIDIA Riva to enable fluid multilingual communication, ensuring no patient is left behind due to language barriers. It is also equipped with a NeMo Megatron-Turing 530B large language model to accurately understand and process patient data. These advanced features reduce the anxiety of clinical visits, especially for patients who are anxious about medical environments.
Personalized experience for hospitalized patients
Patients can be overwhelmed by the amount of information available before surgery. Prehospital appointments are typically only made once, many weeks before surgery, which can leave you with questions and heightened concerns. The stress of a serious diagnosis may prevent you from asking all the necessary questions during these brief interactions.
As a result, patients arrive at pre-hospital appointments unprepared and lack knowledge about the appointment’s purpose, duration, location and required documentation, which can lead to delays and rescheduling of surgeries. .
To enhance patient preparation and reduce pre-surgery anxiety, Ottawa Hospital uses AI agents powered by NVIDIA and Deloitte technology to gain more consistent, accurate and continuous access to information That’s what I’m trying to do.
With Digital Teammate, patients can experience the following benefits:
Access your digital teammates 24/7 using your smartphone, tablet, or home computer. Pre-approved, authoritative answers to detailed questions, including information about anesthesia and the surgery itself. Post-operative consultation to answer any questions you may have regarding the recovery process. This may improve treatment adherence and health outcomes.
In user acceptance testing for Digital Teammates conducted this summer, the majority of testers noted that the responses provided were clear, relevant, and met the needs of their specific interactions.
“Frontline AI Teammate provides a fresh and innovative solution to address the health workforce crisis, reducing administrative burden and providing healthcare with the quality of care that the public deserves and expects from The Ottawa Hospital.” It potentially gives providers time back,” said Matthew LeBreton, digital experience lead at The Ottawa Hospital. “The opportunity to explore these technologies is very well timed given the plans for the new campus development, a new hospital project in Ottawa. It is essential to ensure that the information is carried out transparently.
Deloitte is working with other hospitals and healthcare organizations to implement digital agents. A patient pilot with The Ottawa Hospital is expected to begin by the end of the year.
Developers can access the Digital Human NIM Agent Blueprint to get started.
