Tuesday, 18 March 2025
26.7 C
Singapore
30.5 C
Thailand
26.6 C
Indonesia
26.8 C
Philippines

Signal president warns AI agents pose serious privacy and security risks

Signal President Meredith Whittaker warns at SXSW that AI agents pose serious risks to privacy and security by requiring deep system access.

On March 8, Signal President Meredith Whittaker raised concerns about the risks AI agents pose to user privacy and security. Speaking at the SXSW conference in Austin, Texas, she warned that this new form of computing could significantly undermine online safety.

Whittaker compared AI agents to โ€œputting your brain in a jar,โ€ highlighting how they are being promoted as a way to simplify daily tasks. These agents are designed to handle activities such as searching for events, booking tickets, updating your calendar, and messaging friends. However, she stressed that AI agents need deep access to personal data to perform these actions, raising major security concerns.

AI agents require deep system access

During her talk, Whittaker explained how AI agents function and the level of control they require over user data. To carry out everyday tasks, they would need access to your web browser, credit card details, calendar, and messaging apps. This would mean giving them near-unrestricted control over your system.

โ€œIt would need to drive that process across your entire system with something that looks like root permission, accessing every single one of those databasesโ€”probably in the clear because thereโ€™s no model to do that encrypted,โ€ she cautioned.

She pointed out that such an AI system wouldnโ€™t run on your device alone. Instead, it relies on cloud servers, where your private data is processed externally before being sent back to your device. She argued that this presents a โ€œprofound issueโ€ for security and privacy.

AI could compromise messaging privacy

Whittaker also warned that if secure messaging apps like Signal integrated AI agents, it would threaten message privacy. AI-powered assistants would need to read messages to compose responses, making them a potential weak point in data security.

She tied these concerns back to her broader criticism of the AI industry, which she said has been built on mass data collection and surveillance. The industry operates on the principle that bigger datasets lead to better AI, but she argued that this approach has significant privacy risks.

Her remarks suggested that AI agents, despite being marketed as helpful tools, could erode privacy in ways users might not fully understand. โ€œWeโ€™re doing all this in the name of a magic genie bot thatโ€™s going to take care of the exigencies of life,โ€ she concluded.

Hot this week

OpenAI calls DeepSeek โ€˜state-controlledโ€™ and urges bans on Chinese AI models

OpenAI calls DeepSeek โ€œstate-controlledโ€ and urges bans on PRC-backed AI models, citing security concerns and risks of data sharing under Chinese law.

Some Chromecasts are showing โ€˜Untrusted deviceโ€™ errors

Some Chromecast devices are displaying an โ€˜Untrusted deviceโ€™ error, preventing users from casting. Google is investigating the issue.

Meta introduces new fact-checking system for Facebook, Instagram, and Threads

Meta is launching Community Notes on Facebook, Instagram, and Threads in the US on March 18, aiming to improve fact-checking with a crowdsourced system.

ASUS showcases future-ready AI infrastructure solutions at CloudFest 2025

ASUS showcases its AI infrastructure solutions at CloudFest 2025, highlighting servers powered by Intel Xeon 6 and Intel Gaudi 3 for scalable AI innovation.

ChopNow expands BNPL services with new retail partnerships in Singapore

ChopNow expands its BNPL services in Singapore with new retail partners, offering more flexible payment options for furniture, home dรฉcor, workspaces, and e-bikes.

Nominations open for 4th edition of Singapore 100 Women in Tech Awards

Nominations for the 4th Singapore 100 Women in Tech Awards are open, celebrating women in tech. Submit nominations by 30 April 2025.

IT leaders accelerate AI PC adoption despite security and infrastructure concerns

A new AMD and IDC survey reveals that 82% of IT leaders plan to adopt AI PCs by year-end, despite security and infrastructure concerns.

Samsung to launch Galaxy A56 5G and Galaxy A36 5G in Singapore on 28 March

Samsung will launch the Galaxy A56 5G and A36 5G in Singapore on 28 March 2025, featuring AI tools, upgraded cameras, and exclusive launch promotions.

Airwallex partners with Discover Global Network to expand payment options

Airwallex partners with Discover Global Network, allowing merchants to accept Discover and Diners Club International cards, reaching 345 million cardholders.

Related Articles