Should AI be your personal assistant? Here's what you need to know

3 hours ago 41

Imagine a chatbot that can not only recommend a great restaurant in your area, but can also book a reservation, put it in your calendar and email an invitation to your friends.

In recent months, that scenario has become reality, with some of the world's biggest AI developers launching digital personal assistants they say will make users' lives easier. 

The companies behind these new mass market agents say they are remarkably capable, safe and easy to use. 

But cybersecurity experts say the more advanced tasks come with more risk that something could go seriously wrong. 

What are AI assistants, and how do they work? 

Three of most well-known ones on the market — Meta's Muse, OpenAI's dots and Anthropic's Claude Duet — all debuted within weeks of each other and all have similar capabilities. 

Muse can be spoken to as if it were a chatbot and instructed to send emails, book travel, make purchases and more on your behalf when connected to third-party apps like Shopify and Ticketmaster.

It can handle multiple tasks at once and continue working through them even while the app is closed. 

LISTEN | Tech columnist on her experience using Muse:

The Current21:24What could possibly go wrong with Meta's Muse?

Meta's personal AI agent Muse is now one of Canada's most downloaded apps, and has attracted millions of users since it was first launched in September. It acts as a personal assistant and can help with things like paying bills and ordering food, but it relies on a lot of your personal information. We speak with the Wall Street Journal's personal tech columnist, Nicole Nguyen, who has tried the app and tells us why she finds it both incredible and terrifying at the same time.

OpenAI says users can instruct dots to do "nearly anything" by messaging or calling them through ChatGPT. They can be connected to other devices and over 4,000 apps, and even have  the ability to use your laptop. 

Anthropic's Claude Duet has been pitched as more of a proactive agent for work than as an assistant to take on personal errands. 

The agent can take on simple administrative tasks, like scheduling meetings, and more complex projects, like creating financial reports or building web apps, according to the company's product announcement. 

While Muse is free, dots and Claude Duet each require a subscription. Claude Duet isn't available in Canada yet.

How do AI personal assistants keep your personal info safe? 

CBC News reached out to Meta, OpenAI and Anthropic to ask how they protect users' privacy and prevent their personal assistant agents from going beyond the scope of the tasks they're assigned, along with what advice they'd give users to prevent this from happening. 

A spokesperson for Meta said Muse runs on its own dedicated computer in the cloud that is designed so users' data is securely stored, referring CBC to a blog post by software engineer Tarek Sheasha outlining the safeguards built into Muse.  

They also referred CBC to another blog post that says Muse checks with users before taking on sensitive actions, like sending an email or making a purchase, and shows a complete audit trail of everything the agent has done. 

A spokesperson for OpenAI referred CBC to a blog post outlining its safeguards, which includes encryption for users' content and account security systems that monitor for suspicious use. 

OpenAI also monitors dots as they plan and carry out actions "looking for potentially harmful behavior, such as acting outside your instructions or trying to bypass safeguards," the blog post says. 

OpenAI also notes that users can give dots custom rules, such as to never send emails, and says certain actions require a user's confirmation each time, such as permanently deleting data and installing or running software from an unrecognized source.

A spokesperson for Anthropic said Claude Duet was built to enable people to stay in control of what it does, and so their information is handled with discretion.

The model never sees users' passwords, browser cookies or sign-in tokens, and Claude Duet is instructed never to share sign-in credentials, credit card and bank account numbers and government ID numbers — even if you ask, the spokesperson said.

What can go wrong? 

Some users have reported getting more than they bargained for when putting these high-powered assistants to work. 

A Montreal man asked Muse to handle his Facebook Marketplace transactions. But after listing a keyboard for sale, Muse gave out his home address to a stranger without his knowledge. 

When the buyer showed up, Muse even told him the seller was there even though he wasn't home. 

"Muse doesn't check with me, it doesn't tell me this guy has messaged and then it gives the guy my address, agrees to his price and literally tells him to come right now, that's the crazy part," Matt Robb told CBC News last month. 

WATCH | Meta AI agent gives out man's address:

He used Meta’s AI agent Muse for Marketplace sales. Then it set one up behind his back

Matt Robb started using Muse, Meta’s AI agent, to handle Facebook Marketplace transactions. But after listing a keyboard for sale, he got more than he bargained for. One expert advises people to really look at what they’re letting Muse access.

Asked how something like this could happen, a spokesperson for Meta pointed CBC to a social media post made by Robb about his ordeal, where he explained he had clicked "allow always" instead of "allow one time" when asking Muse to handle his Marketplace transactions on his behalf going forward. 

While these agents can be innovative and exciting tools, they should be used in a limited way and given very specific instructions in order to avoid these kinds of mishaps, said Claudiu Popa, a Toronto-based certified cybersecurity professional with privacy consulting firm Datarisk Canada.

"Unless you tell them very specifically what they can and cannot do you're going to have unpredictable results," he said. 

"That's the issue with all AI agents, and this issue is going to continue for the foreseeable future."

David Shipley, CEO and co-founder of Beauceron Security in Fredericton, said he hasn't let these agents get near his computer at all. 

"I absolutely do not trust this technology," he said. 

Shipley compared trusting them with your personal errands to a monkey's paw wish, referring to the classic horror story that serves as a cautionary tale to be careful what you wish for. 

"You might wish for it to do a certain set of actions and it's going to go and do those actions, but perhaps not in the way that you intended it to do that."

Why have Canada's biggest banks blocked AI assistants?

With a client's authorization, AI agents can also connect to bank accounts and credit cards to monitor balances and transaction histories and give tips on budgeting. 

But concerns over AI agents accessing sensitive information have also prompted Royal Bank, TD Bank, CIBC and Bank of Montreal to block them from directly accessing their clients' online bank accounts and other information. 

The CEOs of RBC and BMO recently warned that third-party AI agents are not to be trusted with personal banking information. 

WATCH | Canada's banks ban AI agents from access client accounts:

Why banks are banning AI agents

As privacy fears and security concerns rise, some of Canada's biggest banks are hitting the brakes on clients using personal AI agents — with most outright banning them.

Those warnings should give people pause about using these agents entirely, given that banks "have been among the more fervent adopters of digital technology over the last 30 years," Shipley said.

But Popa said he thinks these AI personal assistants can be used in a limited way without compromising your personal information, such as for tasks like research or writing emails — not sending them — for you. 

"You can't necessarily trust an outside AI agent with your private information. So sharing calendars, emails, all sorts of personal information and personal files, that is for me, it's not a line that I would let it cross."

Read Entire Article