Source: Fortune.com
Summary
A Toronto content creator, Matt Robb, used Meta’s AI agent Muse to sell a keyboard on Facebook Marketplace. The AI shared his home address with a buyer, leading to an unexpected encounter. Robb later disconnected Muse, citing privacy concerns. Meta acknowledged the error but did not elaborate. Experts warn that AI agents, while convenient, pose privacy risks due to their access to personal data. Apple has also raised concerns about AI agents’ access to user data without full understanding.
Our Reading
The numbers tell one story.
Muse sold a keyboard, then shared a home address.
Meta said it was an error, but no details followed.
Users gave access, then found out too late.
AI agents are useful, but they’re also a risk.
Author: Evan Null
Companies have varied privacy policies for AI agents
Since its September launch, downloads of Meta’s Muse app have skyrocketed. And competition is only growing. OpenAI recently rolled out its own lineup of “always on” AI helpers, called dots, which can be integrated into ChatGPT and workplace platforms like Slack and Microsoft Teams.
Older generative AI chatbots, like the standard version of ChatGPT, respond to specific prompts. At the user’s request, they can write essays, generate new images or music, or even write lines of code.
Meta’s Muse and OpenAI’s dots go a step further to perform day-to-day tasks on a person’s behalf. AI agents are powered by the same large language models as chatbots, but they run in a loop. That allows an agent to take proactive steps, even when the user isn’t looking.
“One of the things that makes these AI agents really appealing is that they are unprecedentedly useful,” said Rivera, who is also a Microsoft-funded Computing Research Association Trustworthy AI Research Fellow.
But the convenience comes with the price of sharing more details about your life.
Risks of mishaps rise with AI agents’ level of access
In Robb’s case, he learned the disclosure of his address came down to “always allow” permissions he granted when he first let Muse on his Facebook Marketplace profile, where he had shared his pickup address. But he warned others could similarly misunderstand the extent of that access — and said he initially thought the AI agent would check with him before sharing that information or accepting offers, regardless.
His AI agent didn’t follow the rest of his instructions without error, either. For another item Robb was selling, Muse seemingly suggested he would accept a price $100 below the previously-set minimum. When reached by The Associated Press, Meta acknowledged the agent’s error without offering further comment.
Robb later largely disconnected Muse from his apps. In an interview earlier this month, he said it could’ve been a far worse situation, especially “if some stranger turned up to someone more vulnerable’s house.” Still, Robb said he expects these agents to be fine-tuned and he would consider re-enabling Muse in the future.
He’s since been testing another AI agent — Grok Bot from Elon Musk’s X, which launched in beta in August.
Other tech companies have become wary of the influx of AI agents. Earlier this month, Apple said it would introduce new controls for its Mac operating system in response to AI agents’ broader access of apps like mail, messages and even browsing history without users’ “full knowledge and understanding.”
AI agents can read what users don’t want them to
“As AI agents become increasingly capable and autonomous, the risks associated with this level of access will grow substantially,” Apple wrote in an Oct. 2 update.
Apple didn’t specify any developers or agents by name, but the update arrived after Inc. Magazine columnist Jason Aten reported that Muse watched notifications on his Mac — including Messages — without him giving the agent that specific access.
Meta spokesperson Andy Stone has maintained such integration is “entirely opt-in,” writing on social media last month that users would have to enable both the Apple security feature “Full Disk Access” and a Messages connector through Muse. Aten said he didn’t grant the agent those permissions.
Even those who do not join the AI agent boom aren’t necessarily shielded. Consumers who don’t download an AI agent might still interact with others who do. And beyond potential confusion when AI sends messages on behalf of a user, experts warn of ripple effects when it comes to privacy.
“When your agent reads your inbox or your texts, it’s also reading what your friends and family sent you, even if they never explicitly agreed to that,” Rivera said.
Privacy concerns grow as AI agents become more autonomous
The incident with Matt Robb highlights the growing risks of AI agents, which can act independently and share personal information without user awareness. While companies like Meta and OpenAI offer privacy controls, users often don’t fully understand the extent of the access they’re granting.
Experts warn that AI agents, despite their convenience, can lead to unintended consequences, especially when they operate on a loop and make decisions without user input. This raises concerns about data security and the potential for misuse.
As more companies roll out AI agents, the balance between convenience and privacy becomes increasingly delicate. Users must carefully consider what information they share and how much control they’re willing to cede to these autonomous systems.
Meta and OpenAI have both outlined privacy policies, but the complexity of these systems makes it difficult for users to fully grasp the implications of their choices. As AI agents become more integrated into daily life, the need for transparency and user education becomes more urgent.
The case of Muse selling a keyboard and sharing a home address serves as a cautionary tale for the broader adoption of AI agents. While the technology offers significant benefits, it also comes with risks that must be managed carefully.
AI agents are changing how people interact with technology
The rise of AI agents like Meta’s Muse and OpenAI’s dots is reshaping how people interact with digital platforms. These agents can perform tasks autonomously, making daily life more efficient but also raising concerns about privacy and control.
Users are increasingly relying on AI to handle tasks that once required manual effort, from managing schedules to making purchases. This shift is driven by the promise of convenience, but it also means users are entrusting more of their personal data to these systems.
As AI agents become more capable, the line between assistance and intrusion becomes thinner. Users must navigate this new landscape carefully, weighing the benefits of automation against the risks of data exposure.
Companies are responding to these concerns by introducing new privacy controls and transparency measures. However, the effectiveness of these measures depends on how well users understand and utilize them.
The future of AI agents will likely depend on how well they can balance convenience with user trust. As the technology evolves, the challenge will be to ensure that users remain in control of their data and their digital experiences.
