Sunday, 19 October 2025
30 C
Singapore
28.9 C
Thailand
21.8 C
Indonesia
27.7 C
Philippines

An AI-powered health chatbot struggles with accuracy

Explore the challenges and developments of WHO's new AI health assistant, SARAH, which provides health information but may not always be accurate.

The World Health Organisation (WHO) has embarked on an innovative project using artificial intelligence to disseminate basic health information via a human-like avatar. This venture introduces SARAH, a virtual health assistant designed to offer 24/7 support in eight languages on topics such as mental health and nutrition. However, the WHO cautions on its website that this early prototype, launched on April 2, might not always deliver precise answers.

Challenges with current AI technology

SARAH, or Smart AI Resource Assistant for Health, cannot diagnose, similar to platforms like WebMD or Google. Instead, it directs users to WHO resources or advises consulting with healthcare providers. Despite its empathetic design, SARAH’s responses can sometimes be misleading due to its outdated training data and the inherent limitations of its AI model, which include generating incorrect or “hallucinated” answers.

Ramin Javan, a radiologist and researcher at George Washington University, remarked, “It lacks depth, but I think it’s because they just don’t want to overstep their boundaries, and this is just the first step.” WHO asserts that SARAH is meant to complement the work of human health professionals rather than replace them.

AI’s potential and pitfalls

Image credit: AI Business

Trained on OpenAI’s ChatGPT 3.5 with data up to September 2021, SARAH does not have information on more recent medical developments or advisories. For example, it incorrectly stated that the Alzheimer’s drug Lecanemab was still in clinical trials, although it was approved in January 2023 for early disease treatment. Even WHO’s latest statistics can confound SARAH, requiring multiple prompts to fetch the correct information.

In its efforts to simulate empathy, SARAH analyses users’ facial expressions for 30 seconds before deleting this data, ensuring anonymity. WHO’s communications director, Jaimie Guerra, highlights the privacy measures in place to secure these interactions, stating that all sessions are unlinked from any identifiable data to prevent cybersecurity risks.

Future directions and ethical considerations

The development of SARAH builds on WHO’s previous virtual health worker, Florence, and involves the same New Zealand-based company, Soul Machines, for the creation of the avatars. While the current avatar appears white, there is potential for users to select from a variety of avatars in future iterations to enhance personalisation.

WHO recently issued ethical guidelines for the use of AI in health care, emphasising data transparency and user safety. As AI continues to evolve, the integration of these technologies in public health remains a delicate balance between innovation and accuracy.

Hot this week

Check Point named among Fast Company’s Next Big Things in Tech 2025 for blockchain security

Check Point is named on Fast Company’s Next Big Things in Tech 2025 list for pioneering real-time blockchain security.

Exabeam named a leader in 2025 Gartner Magic Quadrant for SIEM for sixth time

Exabeam has been named a Leader in the 2025 Gartner Magic Quadrant for SIEM for the sixth time, highlighting its AI-driven security innovation.

Sol launches menopause app to help employers tackle US$150 billion productivity gap

Sol launches Asia’s first medically reviewed menopause app, supporting women and helping employers tackle US$150 billion in productivity losses.

XPENG AEROHT completes first public manned flight in Dubai and rebrands as ARIDGE

XPENG AEROHT, now rebranded as ARIDGE, completes its first public manned flight in Dubai and secures record Middle East orders.

NetApp introduces built-in data breach detection for enterprise storage

NetApp debuts built-in data breach detection in enterprise storage, enhancing cyber resilience with AI-powered security and recovery tools.

Samsung partners with Nvidia to develop custom CPUs and XPUs for AI dominance

Nvidia partners with Samsung to develop custom CPUs and XPUs, expanding its NVLink Fusion ecosystem to strengthen its AI hardware dominance.

NVIDIA unveils first US-made Blackwell wafer as domestic chip production expands

NVIDIA unveils its first US-made Blackwell wafer at TSMC’s Arizona facility, marking a major milestone in domestic AI chip production.

8BitDo unveils NES40 collection to mark 40 years of the Nintendo Entertainment System

8BitDo marks 40 years of the NES with a limited NES40 collection featuring redesigned controllers, a premium keyboard, and a modernised speaker.

Facebook’s new AI feature scans users’ camera rolls for unpublished photos

Facebook’s new AI tool scans users’ camera rolls to suggest edits and collages, raising questions about data use and privacy.

Related Articles