Saturday, 30 August 2025
29.1 C
Singapore
28.4 C
Thailand
18.2 C
Indonesia
28 C
Philippines

An AI-powered health chatbot struggles with accuracy

Explore the challenges and developments of WHO's new AI health assistant, SARAH, which provides health information but may not always be accurate.

The World Health Organisation (WHO) has embarked on an innovative project using artificial intelligence to disseminate basic health information via a human-like avatar. This venture introduces SARAH, a virtual health assistant designed to offer 24/7 support in eight languages on topics such as mental health and nutrition. However, the WHO cautions on its website that this early prototype, launched on April 2, might not always deliver precise answers.

Challenges with current AI technology

SARAH, or Smart AI Resource Assistant for Health, cannot diagnose, similar to platforms like WebMD or Google. Instead, it directs users to WHO resources or advises consulting with healthcare providers. Despite its empathetic design, SARAH’s responses can sometimes be misleading due to its outdated training data and the inherent limitations of its AI model, which include generating incorrect or “hallucinated” answers.

Ramin Javan, a radiologist and researcher at George Washington University, remarked, “It lacks depth, but I think it’s because they just don’t want to overstep their boundaries, and this is just the first step.” WHO asserts that SARAH is meant to complement the work of human health professionals rather than replace them.

AI’s potential and pitfalls

Image credit: AI Business

Trained on OpenAI’s ChatGPT 3.5 with data up to September 2021, SARAH does not have information on more recent medical developments or advisories. For example, it incorrectly stated that the Alzheimer’s drug Lecanemab was still in clinical trials, although it was approved in January 2023 for early disease treatment. Even WHO’s latest statistics can confound SARAH, requiring multiple prompts to fetch the correct information.

In its efforts to simulate empathy, SARAH analyses users’ facial expressions for 30 seconds before deleting this data, ensuring anonymity. WHO’s communications director, Jaimie Guerra, highlights the privacy measures in place to secure these interactions, stating that all sessions are unlinked from any identifiable data to prevent cybersecurity risks.

Future directions and ethical considerations

The development of SARAH builds on WHO’s previous virtual health worker, Florence, and involves the same New Zealand-based company, Soul Machines, for the creation of the avatars. While the current avatar appears white, there is potential for users to select from a variety of avatars in future iterations to enhance personalisation.

WHO recently issued ethical guidelines for the use of AI in health care, emphasising data transparency and user safety. As AI continues to evolve, the integration of these technologies in public health remains a delicate balance between innovation and accuracy.

Hot this week

Malaysia to host road and traffic technology events in November

Malaysia will host My-ARTTE 2025 and MRMC in November, highlighting innovation in road safety, maintenance, and traffic technology.

HPE introduces agentic AI innovations for self-driving network operations

HPE enhances its Juniper Mist platform with new agentic AI features, bringing self-driving capabilities to network operations.

Thinking Machines partners with OpenAI to accelerate AI adoption in Asia Pacific

Thinking Machines partners with OpenAI to expand enterprise AI adoption across Asia Pacific with training, app design, and leadership programmes.

Chipolo unveils rechargeable Loop and Card Bluetooth trackers

Chipolo launches its first rechargeable Bluetooth trackers, the Loop and Card, offering six-month battery life and IP67 durability.

ChatGPT referral traffic to websites drops by 52% in one month

ChatGPT referral traffic to websites has dropped 52% in a month, as Reddit and Wikipedia rise under OpenAI’s new citation weighting.

Snapchat introduces new app promotion tools to improve advertiser performance

Snapchat launches new app promotion tools, including Sponsored Snaps, tCPA bidding, App End Cards, and playable ads, to enhance user engagement.

ChatGPT could be influencing the way people speak

A study suggests ChatGPT and similar AI tools are influencing spoken language, with AI buzzwords increasingly appearing in daily conversations.

Thinking Machines partners with OpenAI to accelerate AI adoption in Asia Pacific

Thinking Machines partners with OpenAI to expand enterprise AI adoption across Asia Pacific with training, app design, and leadership programmes.

100 women in tech power Singapore’s digital future as nation marks 60 years

Singapore honours 100 women leaders and 25 young achievers in the SG100WIT 2025 list, marking growing female impact in tech.

Related Articles

Popular Categories