Tuesday, 29 April 2025
29.2 C
Singapore
30.3 C
Thailand
26.5 C
Indonesia
28.9 C
Philippines

Signal president warns AI agents pose serious privacy and security risks

Signal President Meredith Whittaker warns at SXSW that AI agents pose serious risks to privacy and security by requiring deep system access.

On March 8, Signal President Meredith Whittaker raised concerns about the risks AI agents pose to user privacy and security. Speaking at the SXSW conference in Austin, Texas, she warned that this new form of computing could significantly undermine online safety.

Whittaker compared AI agents to “putting your brain in a jar,” highlighting how they are being promoted as a way to simplify daily tasks. These agents are designed to handle activities such as searching for events, booking tickets, updating your calendar, and messaging friends. However, she stressed that AI agents need deep access to personal data to perform these actions, raising major security concerns.

AI agents require deep system access

During her talk, Whittaker explained how AI agents function and the level of control they require over user data. To carry out everyday tasks, they would need access to your web browser, credit card details, calendar, and messaging apps. This would mean giving them near-unrestricted control over your system.

“It would need to drive that process across your entire system with something that looks like root permission, accessing every single one of those databases—probably in the clear because there’s no model to do that encrypted,” she cautioned.

She pointed out that such an AI system wouldn’t run on your device alone. Instead, it relies on cloud servers, where your private data is processed externally before being sent back to your device. She argued that this presents a “profound issue” for security and privacy.

AI could compromise messaging privacy

Whittaker also warned that if secure messaging apps like Signal integrated AI agents, it would threaten message privacy. AI-powered assistants would need to read messages to compose responses, making them a potential weak point in data security.

She tied these concerns back to her broader criticism of the AI industry, which she said has been built on mass data collection and surveillance. The industry operates on the principle that bigger datasets lead to better AI, but she argued that this approach has significant privacy risks.

Her remarks suggested that AI agents, despite being marketed as helpful tools, could erode privacy in ways users might not fully understand. “We’re doing all this in the name of a magic genie bot that’s going to take care of the exigencies of life,” she concluded.

Hot this week

GameMax unveils Blade Concept ATX case with bold design and powerful features

GameMax launches the Blade Concept ATX case, which features a striking blade design, RGB lighting, and support for high-end liquid-cooled PC builds.

Lenovo introduces new ThinkPad mobile workstations and business laptops for the AI-ready workforce

Lenovo refreshes its ThinkPad lineup with new AI-ready mobile workstations and business laptops, enhancing mobility, performance, and security.

Tenable uncovers critical privilege escalation flaw in Google Cloud Composer

Tenable exposes a GCP vulnerability in Cloud Composer that allows privilege escalation through interdependent cloud services.

DeepMind team in London seeks to unionise over AI concerns

DeepMind employees in London seek to unionise with the Communication Workers Union over concerns about Google’s AI policies and military contracts.

Meta’s Oversight Board asks for clarity on new hate speech rules

Meta’s Oversight Board is urging more transparency on hate speech policy changes and urging the company to protect vulnerable users.

India could manufacture all US-bound iPhones by the end of 2026

Apple plans to manufacture all iPhones for the US market in India by the end of 2026 to avoid China tariffs and secure its supply chain.

Razer Launches Pro Click V2 and V2 Vertical Mice: Blending Gaming and Productivity

Razer's new Pro Click V2 and V2 Vertical mice offer gaming precision and ergonomic comfort, with AI prompt access and long battery life, available now!

Nintendo Pop-Up Store and Mario Kart Fun Return to Jewel Changi Airport

Experience the magic of Nintendo at Jewel Changi Airport with the return of the Pop-Up Store and the exciting Mario Kart Jewel Circuit Challenge!

Lian Li’s new Lancool 207 Digital case brings a 6-inch LCD screen to your PC

Lian Li's Lancool 207 Digital PC case brings a bright 6-inch LCD screen to your setup, offering style, function, and full customisation.

Related Articles

Popular Categories