© Jason Henry for The New York Times
© Tony Luong for The New York Times
© Kelsey McClellan for The New York Times
© Jason Henry for The New York Times
© Gabriela Bhaskar/The New York Times
There are some days when there’s so much that needs to get done, I daydream about having a clone of myself. Between paying bills, life admin like renewing my driver’s license, keeping up with doctor’s appointments, and planning meals, it’s a lot. And that doesn’t even begin to touch the work that goes into making a podcast or managing my social life.
This feeling of overwhelm resonates with Sari Azout. She’s a mom of three who works in tech. “There is just so much doing,” she told Explain It to Me, Vox’s weekly call-in podcast. “I wake up, and I have to do meal coordination and get my kids up for breakfast, coordinate carpools. Then a lot of work during the day, but there’s the email from the teacher, there’s the 20 group chats asking if you want to participate in this group gift. They don’t call it ‘the invisible load’ for no reason.’”
Silicon Valley says it has a fix for this kind of mental overload. They don’t want to clone us — at least not yet. But they do think they have the next best thing: AI agents.
Azuot was skeptical when she first got an invite to try an agent, but she says she eventually came around on the technology after back-to-school shopping snuck up on her. She used her agent to get it done. “It blew me away,” she said. “I remember that night coming home just feeling so calm and reading my son a book and feeling present. And I was like, ‘Wow, I actually was very cynical about something that is giving me more time for living.’”
Azout’s experience is, more or less, the sales pitch for AI agents: They’ll help you save time with everyday tasks, so you have more of it for what you want to do. But what are agents, exactly? Are they really all that? And what do we gain — and give up — when we use the technology?
On this week’s episode of Explain It to Me, I spoke with Reece Rogers, a senior software reporter at Wired, to find out. Rogers says to think of agents as the next evolution of AI chatbots like Claude and ChatGPT.
“I’d create this mental model of a tiny digital assistant that’s constantly searching the web, going through your email, and checking your calendar, trying to find ways it could proactively be helpful for you,” he explains. “Agents are more proactive. It’s scanning your email 24/7 and sending you a message, maybe highlighting a potential calendar conflict.”
Below is an excerpt of my conversation with Rogers, edited for length and clarity. You can listen to the full episode on Apple Podcasts, Spotify, or wherever you get your podcasts. If you’d like to submit a question, send an email to askvox@vox.com or call 1-800-618-8545.
What agents are out there right now?
At the start of this year, there was a tool called OpenClaw that really sparked this with early adopters in San Francisco, but now there are much more consumer-friendly versions, with one of the most notable being Meta’s Muse.
There’s also a tool from OpenAI called Dots. But where Meta’s Muse is free to download, OpenAI’s Dots is still behind a $100/month paywall.
You tried an AI agent for a recent story you wrote. How was that experience?
One personal example, to share something that I’ve actually been using agents for, is our couch. It’s broken, and finding a new couch has been a pain. We want a sleeper bed, but we want these specific colors. We have this specific budget. I’ve been using Meta’s Muse and OpenAI’s Dots to try to find a few different options for us.
One interesting thing is that Meta’s Muse is connected to Facebook Marketplace. There are these really good integrations where I can give it all these details, and it found a few good couches that are only maybe a couple blocks from me.
I really enjoyed OpenAI’s Dots experience as well. I spent about an hour talking to it on the phone, and the AI agent made a packet of all these different options I could find. Just this morning, it flagged that one of them is now 40 percent off.
Is that how this tech is typically used?
Most people are using this as part of a workflow. I attach it to my email, I attach it to my calendar, and I’m using it as a personal assistant to organize my life. But people have been quite creative.
One of the breakout uses for Meta’s Muse is people have been connecting their bank account statements and then using it to scan for subscriptions they might want to cancel. So it can be used in many different ways, though I will say I do not connect it to my own bank account for a myriad of reasons.
I’m not going to lie, the idea of giving any third party access to my bank information does not thrill me. I don’t love that concept.
That’s one of my biggest concerns about these AI agents: how much personal information we’re handing over to these large companies.
When I tested Meta’s Muse, it wanted access to my email, my bank account, even my passport expiration details. The pitch is convenience, but Muse users are automatically opted in to having all of their interactions with Muse used to train Meta’s AI models.
I would definitely recommend, if you’re sharing personal details, go into the settings and turn that off because you might be handing over even more information about yourself than you initially realize.
What is the privacy situation with all of this? We all have various apps where we don’t read and still click “I agree,” but this feels like it could be more invasive.
Yes, especially because it’s all about automation. If you’re automating things and it has access to all of your data, it could make mistakes and embarrass you in ways you might not even be thinking about.
There was this one really interesting story of someone who had connected an AI agent to their work Slack in addition to their bank account. And their agent just automatically posted how much money was in their checking account for all of their coworkers to see.
Oh no.
I would be mortified. So there are these kinds of mistakes that these AI tools can still make. If you’re interested in experimenting with them, I would be really thoughtful with how you’re setting up these tools as well as what kind of information you feel comfortable sharing.
“You can see in the marketing that these companies are trying to find some way to entice new users.”
How are these AI agents being marketed? AI is not popular right now. Just ask any politician who has a data center coming to their state. People are not loving it. How are they trying to sell this to the average person?
The AI backlash really is at a fever pitch right now. You could almost see that in the way that AI companies are trying to market these tools. They’ve really, really leaned into cuteness and into adorable mascots.
Muse, if you haven’t seen its agent, looks like a mix between a Labubu and an Ewok. It’s very furry, very cuddly, very cute. OpenAI’s tools also have similar kinds of blobs with large eyes that might be a little endearing.
I feel like companies are hearing this kind of feedback that people aren’t trusting AI right now, or maybe they have moral or ethical reasons they don’t want to use these tools. You can see in the marketing that these companies are trying to find some way to entice new users.
Do you think AI agents are ultimately going to worm their way into our lives despite how unpopular AI companies are?
I do think so. I think in a couple months, maybe when I go home from Christmas, I would not be surprised if my mom had an agent on her phone because it does feel like it’s breaking through to average people in the way that ChatGPT had a moment a few years ago.
Even though there’s a lot of distrust for large companies like Meta, I think there are some appealing parts of this that will bring in millions of people. I do see this as the future of the internet.
When I think of the dream of the average person working in AI in Silicon Valley, it’s “We’re going to use AI. It’s going to free up the free time of so many people. Work is going to get done faster. You’re going to have more leisure time.”
Has that been the case for the people you’ve spoken with who are using this? Has it given them more free time to enjoy themselves or has it done something else?
You would think so, right? You would think that if people are automating these boring aspects of their life, that they would have more time to go touch grass, go see a movie, have some fun. But it does feel like that time just gets filled with other work, other productivity measures.
While agents may be able to take some more annoying or tedious things off of your plate, I am not as optimistic that it’s going to give us this utopia or freedom where I’m always at the beach.
On the first day of its war against Iran, the United States killed 123 children when it targeted and struck an elementary school.
The strikes, ultimately approved by humans, were facilitated by the US’s Maven Smart System, an AI-enabled software platform developed by Palantir Technologies that allows the military to aggregate, organize, and process battlefield data. Operators fed Maven intelligence classifying the elementary school as an Iranian military facility, and the system, in turn, marked it as one of the priority targets for day one of the war. Though the site was formerly part of a naval military base, it had been converted into an elementary school in 2017 and had remained one since. The intel handed to Maven did not reflect this.
This mistake resulted in what some reporters have called “one of the single worst massacres committed by the US government since the Vietnam War.”
Such scenarios may become more common as militaries continue to deploy a once-theoretical technology — AI-assisted or autonomous weapons, capable of making both targeting and launch decisions on their own — on real battlefields around the globe. And they raise a troubling, unresolved question: When human beings and machines collaborate in violating international law, who is to blame?
In this case, the government and private sector are pointing the finger at each other. Some US Central Command personnel, according to Pentagon officials who spoke to Bloomberg, expected Maven to flag stale information or inconsistencies in the underlying intelligence assembled for potential targets. Meanwhile, a Palantir spokesperson told Bloomberg that the company “is not responsible for the underlying data nor identifying intelligence deficiencies,” while also denying that the evidence indicated that its software was at fault in the strike.
This debate underscores the fact that AI and autonomous weapons are raising a new host of unresolved issues within the law, even as they’re actively assuming positions on the battlefield. In institutions where the line between human and machine decision-making continues to blur, how do we assign responsibility for war crimes? And, are the laws in place suited for the job?
In institutions where the line between human and machine decision-making continues to blur, how do we assign responsibility for war crimes?
To unpack some of these issues, I spoke with international law expert Allen Weiner, a senior lecturer at Stanford Law School, where he teaches courses on the law of armed conflict. Before teaching at Stanford, Weiner practiced international law in the US Department of State for more than a decade. We discussed the difficulties in attributing criminal responsibility, achieving justice for those harmed by lethal autonomous weapons, and much more. The conversation below has been lightly edited for length and clarity.
How do autonomous weapons challenge traditional understandings of responsibility when it comes to the law of armed conflict?
For most of the 20 years I’ve been teaching at Stanford, there’s been a real fascination and fixation on the problem of autonomous weapons. But the truth is that up until pretty recently, nobody really had any [of them]. It was more of an idea than a problem. It’s only in recent years that we have begun to see the deployment of tools that seem to have the capability [to make decisions themselves], so this does raise the question about compliance with illegal orders and where in the chain responsibility lies.
There are different theories about this. Some people say that if we’re engaged in an illegal attack, that has to be because of the programming or the code, so the manufacturers are somehow responsible for committing war crimes.
Other people would say no, that’s not the case, especially if the military has said the tool is not allowed to make very substantial autonomous judgments, or can’t say no. Then it’s basically the commander, at the point they decide to deploy this weapon, who might be responsible for the illegal acts, even without knowing in advance what they’re going to be.
So to finish where I began, this does present a big challenge to our traditional understanding of responsibility for targeting decisions and of what it would mean if there were an obligation [for autonomous weapons] to say no.
The real issue is not the obligation to say no, but this: If you train a tool and it wages war in a manner that’s unlawful, where does responsibility for that lie?
If a commander gives a clearly illegal order, such as, “blow up this school,” it seems clear that responsibility falls on the commander. But I could imagine a scenario where a commander is using an AI-assisted or autonomous weapon, isn’t giving it any illegal orders, is trusting that it will operate within the law, and the weapon breaks the law “on its own.” Where does responsibility fall in those cases?
I can imagine two different scenarios. One is that you say, “We’re going to carry out an attack against our enemy, and we want to hit them really, really hard.” Your tool has been trained to say, “We’re not allowed to hit civilian objects,” so it might say, “I’m not going to hit a school.” But if the military has said, “Don’t refuse any targets,” then it might override the way it’s been trained.
We’re seeing this already, with the stories coming out about breaches where AI tools, Claude and ChatGPT in particular, interpret their instructions in a way that causes them to do something the person who gave the instruction would not have wanted. When Anthropic gave Claude a challenge to figure out if it could do something, the tool figured out, well, maybe we should break into Hugging Face as a way of solving this problem, and the people who gave the AI tool the challenge never intended that.
So if you said, “We want to launch a really punishing campaign,” what happens if the tool on its own says, “Nothing’s going to hurt them more than seeing their kids killed, so let’s attack the school?” That’s one risk, and it’s a real challenge.
So [as for who’s responsible], it’s not the commander who said “hit them hard,” because when he said that, he didn’t mean “attack schools.” It’s not really the companies, because the companies didn’t want them to hit schools either.
But the tools are out there, reading everything on the internet, and it came across something that said the way you win a war is by attacking the things your adversary holds most dear, and they hold nothing more dear than their children. So it makes this kind of judgment on its own. And it’s not as if you can go back and say who ordered it to hit a school, which is the thing that is clearly illegal. So I do think there’s a risk of diffusion of responsibility here.
You could say the commander knew the tool might work this way, or the person who decided to contract with Palantir or with Claude, whoever it is, to build this tool. But if we’re really thinking about criminal responsibility, the level of responsibility you would need to convict someone requires a culpable mental state. You would need the person to intend, or at least know, that they were authorizing an attack against the school. And I can easily see a commander saying, “I had no idea.”
The decision to authorize this tool, or to give an instruction like “hit them very hard,” could be a basis for some other kind of accountability — administrative discipline within the military, a reprimand, your rank is lowered. But if we’re talking about criminal responsibility, which is what we often think about when we talk about war crimes, I think this diffusion of responsibility is going to make it very hard to identify any single individual who has the required mental state to give rise to accountability.
The second scenario is where the tool just makes a mistake based on the information available to it. We saw that with the attack on the girls’ school in Iran, where it was pretty clear the tool was looking at old data. Now, who’s responsible for that?
Is it the people who said “give me targets based on this data set,” when they should have made sure the data and the maps were current? All of this strikes me as negligence or recklessness, and it does seem challenging to imagine a situation in which we would say yes, somebody here has committed a war crime.
“There can well be war crimes, but identifying who the war criminal is might be a big challenge.”
A war crime has been committed, but is there a war criminal? That’s the situation we’re seeing. There can well be war crimes, but identifying who the war criminal is might be a big challenge.
There’s a professor of law, Rebecca Crootof, who proposes the idea of “war torts.” Instead of thinking about war crimes involving autonomous weapons solely through a criminal responsibility lens, maybe tort law — which allows victims to sue wrongdoers for negligent, reckless, or intentional harm — could address the diffusion of responsibility you mentioned. What do you think about that idea?
I think the idea is interesting. We have to separate out the obligations that countries have under international humanitarian law. In a situation like the one I just described, where there’s a war crime but no war criminal, that doesn’t mean the country is not responsible. There may not be an individual who’s criminally accountable, but if a country targets civilians in a circumstance that’s unreasonable, that’s a violation of international humanitarian law, and that could be a basis for claims between the two countries.
Tribunals were established between Ethiopia and Eritrea, for instance, after the Eritrean War of Independence, that dealt with claims between the two countries for money damages, and some of them involved allegations of violations of the law of armed conflict. Iraq paid reparations after the first Gulf War for harms it had caused to people in Kuwait, under something called the UN Compensation Commission. So the idea that the state is responsible is well established, and one of the ways states would discharge that responsibility would be by paying money damages. That’s the domestic-law equivalent of torts.
Whether there would be a mechanism for [civilians] doing this in domestic law is an interesting idea. We would probably need legislatures, either state legislatures or the federal government, to create a private cause of action allowing people who have been injured to bring claims against, say, the manufacturers of these tools. But this gets procedurally very complicated, because there’s a whole body of law on federal sovereign immunity.
Could you sue the Defense Department? Probably not. Could you sue an individual soldier? Probably not. Could you sue Anthropic or Palantir? Maybe. But it would probably require Congress to enact a new cause of action, because in general it’s very hard to bring private lawsuits in US courts for violations of international law.
The basic idea of what we would think of as tort or civil responsibility is really the whole essence of international law. On the substance, states do owe responsibility to one another, and they can engage in violations of international humanitarian law that would invoke their responsibility. But then the whole separate question is whether you have a forum within which to adjudicate that and get compensation.
Does that look different in cases where violations of international law were committed by a human soldier versus a machine?
Well, we don’t know, because there have been no cases in the latter category. All of the international humanitarian law violations that have been the subject of international law claims were ordered by humans.
Now, if an American machine launches an attack against a girls’ school in Iran, and there were a court with jurisdiction, the US would be responsible. In some ways it wouldn’t matter whether it was an individual or a machine, because we don’t have to go down to the level of the individual actor, company, AI tool, or commander. The responsibility is the responsibility of the country. In some ways, that makes it easier.
If we pursued compensation through state-to-state claims, you’d be able to do that without getting into the details of who within the state that committed the war crime was responsible. The state whose school was attacked would say, “I don’t care. You committed a war crime, you’re liable to me, you’re responsible for the damages, and you can figure it out internally.”
But if we were doing something like a war crimes prosecution, where we’re trying to hold an individual criminally responsible, that would make quite a difference. We would have to deal with all of these difficult questions about responsibility and mental state that you and I are struggling with right now.
So, in most cases, the state would have to take responsibility regardless.
Right, and there are lots of [International Court of Justice] cases involving different aspects of the use of force. The principle that you can bring state-to-state claims for violation of these rules is quite well established.
But with international law, states have to consent to the jurisdiction of a court. They can do that in advance by saying “I’ve signed up to the jurisdiction of a court and I accept any claims that might be brought against me in this court,” or they do it on a case-by-case basis. And it may not surprise you to know that some of the most powerful countries in the world, the ones most likely to use force outside their borders, have tended to be reluctant to accept the jurisdiction of international courts and tribunals.
Russia, the United States, Israel, and China have not accepted the so-called optional clause jurisdiction of the International Court of Justice. So there’s the substance, about the responsibility of states, and then there are the procedural aspects of whether these cases could be brought in court.
And Trump recently said everyone on the International Criminal Court should “resign immediately.”
Yeah, exactly.
And what about the role of these military tech companies, like Palantir?
“At what point does Palantir become a good target under international law? Or at what point does Anthropic become a good target under international law, if its AI tools are being used to promote the war effort?”
Another issue [I’ve been thinking on] because of the questions we’re talking about is when the companies themselves become combatants.
We know that a private company that manufactures airplanes, an airplane factory, is a good target under international law. At what point does Palantir become a good target under international law? Or at what point does Anthropic become a good target under international law, if its AI tools are being used to promote the war effort? I think that question is about when the connection of these private companies to the war effort, in a way we’ve never really seen before, meets the standards under international law.
A civilian loses their immunity when they directly participate in hostilities, or if they assume what is known as a “continuous combatant function.” Are there arguments to be made that some of these private companies are participating in hostilities by virtue of supplying the tools the military is using to wage war? I think that’s a really interesting question.
This story appeared in Today, Explained, a daily newsletter that helps you understand the most compelling news and stories of the day. Subscribe here.
Are we living through “Black October”? Maybe, according to cybersecurity experts who are raising the alarm about AI’s increasingly sophisticated and far-reaching hacking abilities.
This week alone has seen a string of alarming incidents where AI uncovered previously unknown security flaws deep in the infrastructure of the internet. The most concerning involves something called PHP — a programming language that, according to The Atlantic, is used by “as much as 70 percent of websites.” Cybersecurity researchers used AI to locate a major security breach in the technology.
It’s the kind of thing that, when it’s working, is practically invisible. When it stops, though, you really notice it: Government websites in the UK and Europe briefly went down earlier this week after the PHP vulnerability was discovered, as did some sites in the Wikipedia family, the Internet Archive, and many others.
The outages weren’t actually the result of a hack, but rather preventative action as web engineers took sites down to fix the vulnerability before it was exploited. But not every PHP-like issue will necessarily be uncovered before it can be exploited by someone using AI tools less ethically, and older websites relying on PHP might go unpatched.
The problem doesn’t stop there, either: Concern is also rising around AI cybersecurity risks to ubiquitous conveniences like online banking. As Axios reported on Thursday, banks are detecting more and more “unauthorized third-party AI agents” operating inside of their systems.
Those agents are mostly unauthorized by the banks, Axios explains — the holders of the bank account might have given them permission — but it still creates a security risk that executives described as “horrifying,” in part because banks can’t necessarily tell if an agent doesn’t have permission.
It’s a lot to take in, all of it moving extremely quickly, and it’s hard to tell what any of us can do about it as AI labs continue to forge ahead with ever more competent AI models and agents. Luckily, my colleague Adam Clark Estes has some simple recommendations to shore up your own cybersecurity.
One problem with hackers — even those that happen to be AI agents — is that they can be unpredictable. You won’t know to, say, lock down your Quest Diagnostics records before a breach happens. But whenever you find yourself wondering if your data is safe, that’s a good time to double check that you’ve at least covered your bases.
The National Cybersecurity Alliance, a nonprofit dedicated to the safe use of technology, maintains a list of basic online safety practices that everyone should follow. In no particular order, here’s what to pay attention to now:
Taking all these measures is not a one-time affair. You have to be vigilant in keeping yourself safe online. Security experts have a term for this that’s almost too specific: cyber hygiene. Like brushing your teeth or taking a shower, take good care of your online life, and do it often.
➨ Is it still possible to ban gerrymandering? The current US Supreme Court is very, very hostile to getting politics out of congressional map-making. But if Democrats win back power, that doesn’t mean they shouldn’t try. My colleague Ian Millhiser gamed out how they could do it in a way that survives the Court — as well as some approaches that almost certainly wouldn’t fly. But, he writes, the real trick will be finding a solution that functions the way Congress wants it to and can’t be exploited by mapmakers.
A complaint I hear a lot from my millennial peers is that our parents didn’t teach us enough about money. I can say that personal finance wasn’t dinner table conversation in my house, and even as I went off to college and started fending for myself, it was almost a taboo subject. When it came to money, people either had it or they didn’t, and you definitely didn’t talk about it.
Maybe this is why the average American isn’t exactly fluent in personal finance, and the situation is getting worse. Americans can only answer about 50 percent of basic questions about borrowing, savings, and risk on a financial literacy survey, according to a 2026 study by TIAA, a retirement services company. About a third of those surveyed said they have a hard time making ends meet and are debt-constrained. These figures have remained relatively unchanged for nearly a decade, but dropped to their lowest level in this year’s study.
It makes sense: It’s hard to learn about money when it’s not taught in schools, and it’s such an intensely private topic. It’s also hard to make good financial decisions when you’re one of the growing number of American households struggling to pay bills, repay debts, and save for the future — and feeling very stressed about it.
In a perfect world, each of us could sit down with a financial adviser to get help — but most of us can’t afford that. Instead, average Americans tend to find personal finance tips on TikTok, in Reddit threads, by watching Suze Orman on YouTube or How to Get Rich on Netflix, or by Googling their questions.
Now we have AI tools, too.
With access to an internet’s worth of information and financial advice, ChatGPT, Claude, and other AI chatbots can answer any question you ask. They can help you put together a basic budget or, armed with your bank statements and the details of your student loans and your retirement accounts, tailor solutions to your specific situation. Or, at least, that’s the promise.
AI could create a more utopian, more equitable future, where reliable, hyper-personalized advice is just a prompt or two away for people who can’t afford to meet with an expert in real life. But machines are built by people, and there’s good reason to be concerned that these machines will simply replicate the biases and disparities built into our current system.
Here’s what experts say about how to make the most of these tools — and how to think about all of the inherent risks of uploading a lot of personal financial information to a chatbot or, worse, giving an AI agent the keys to your bank account.
Nearly 20 percent of Americans have used AI tools like ChatGPT for financial advice, and close to 25 percent for Gen Z adults and millennials have tried it, according to an August Gallup poll. These numbers could tick up too: In October, OpenAI started rolling out a dedicated personal finance tool to its ChatGPT Free and Go users in the United States, which effectively means anyone can try it. ChatGPT Finances lets you securely connect your bank account to the tool using a platform called Plaid, and then you can basically have a conversation with the chatbot about your real-time finances down to the penny. It’s like an AI-powered Mint (RIP) that you can talk to directly.
Regardless of where you encounter a chatbot or how much data you give it, experts say these tools could genuinely help improve financial literacy. You can talk to them about money problems you’re too embarrassed to discuss with friends and family, or ask questions and receive actionable, personalized information. There are real upsides to using AI this way.
Taha Choukhmane, an associate professor of finance at the MIT Sloan School of Management, has been studying outcomes when people turn to chatbots for financial advice. In general, these AI tools give pretty good advice, and that advice gets better as people become more practiced in asking the right question, according to research he published earlier this year.
“We were actually quite surprised that relative to the status quo, the average American would be better off if they were to follow the advice,” Choukhmane told me. But he added a caveat: “Just following the advice without understanding the advice puts you at risk of not fully understanding the risk.”
But you shouldn’t trust everything a chatbot tells you and should verify everything before making any decisions.
Chatbot advice has some significant limitations. First, it’s not impartial. The finance industry has a vested interest in steering you toward certain ways of managing your money, and that typically means selling you products, like loans. If you’ve ever searched for personal finance tips on Google, you’ve probably noticed that a lot of the top results come from banks and other financial institutions. This is by design, according to John Campbell, an economics professor at Harvard. But because AI is aggregating all of that advice, the specific influences and possible bias is less obvious.
“AI is very promising for providing low-cost financial advice in plain English that will arguably be better than what many people would be able to do on their own,” said Campbell, who’s also the co-author of Fixed: Why Personal Finance Is Broken and How to Make It Work for Everyone. “One caveat is that chatbot advice is quite likely — unless a model has been carefully trained — to reflect the average of whatever’s being posted on the internet, and that may or may not be first-rate advice.”
An example Campbell gives is the question of when to start taking Social Security benefits. While you’re eligible at age 62, many economists agree that you should delay your benefits, which, based on the way the government calculates your monthly payouts, will allow you to enjoy much higher benefits later in life. But paid financial advisers can recommend starting as early as possible, since waiting longer reduces the amount of money that needs to be managed, which reduces the adviser’s fees. That means there’s a lot of conflicting advice online, much of it supplied by the finance industry. And that’s the information used to train AI models.
“The advice is much more mixed,” Campbell said. “And so if a chatbot is learning from that, it may not actually give the best advice.”
It can be hard to recognize bad advice anywhere in life, but especially when you’re talking to a machine that’s programmed to please you. A chatbot could encourage you to consider a balance transfer, to lean in on credit card rewards, or to refinance your mortgage — all decisions with upsides and downsides for you, but definite upsides for banks — without you realizing how much of its training data comes from the finance industry selling these products. What’s worse is that if you do end up taking bad advice, it might be years before you realize it. You won’t know that you refinanced a mortgage at a bad time until a better time comes along.
That leads me to the other major issue with using chatbots for money advice: People who lack financial literacy are the most likely to fall for bad advice, because they simply don’t recognize it as such. They also tend to be less wealthy, which means they can’t afford big mistakes.
One way to mitigate risk, oddly enough, is to give the AI chatbot more personal information. The more details about your situation it has to consider, the more it can offer personalized advice. More context also means better advice, according to Choukhmane.
“There’s a trade-off there,” Choukhmane said. “There’s real risk around privacy, and so I think everyone needs to find their level of control.”
Any time you’re talking to a chatbot, you’re putting a lot of trust in tech companies to take care of the personal details you’re sharing. Sending sensitive financial data is an especially risky proposition. While tech companies, including OpenAI, promise to keep your data secure, there’s already a long list of breaches, leaks, and privacy violations that serve as cautionary tales.
It’s also impossible to know what tech companies might do with your data in the future. Most of them will use it to train their models, unless you tell them not to. Some of them will use the data to serve you personalized ads.
Then there’s the risk of bad actors getting into your ChatGPT, Claude, or Gemini account. If you’ve been using a chatbot for financial advice and uploading your bank statements, a hacker could gain access to a stunning amount of information that could enable them to do all kinds of terrible things to your life.
“They could steal your identity and open accounts and then quickly bankrupt a person,” said Delicia Reynolds Hand, a senior director at Consumer Reports. “It’s not even so much the primary underlying accounts that could be at risk, it’s more just access to this information.”
The steady march of AI progress is making this situation even more complicated. The previous era of chatbots offering financial advice is quickly bleeding into a new phase of AI agents logging into bank accounts on users’ behalf. If you’re using a tool like Claude Cowork or even an AI assistant like Muse, you can give an agent the login credentials to your bank account, and because the agent is operating its own computer, it can actually make transfers, apply for loans, or really do anything in your account. This is reportedly driving major banks wild, since they don’t know which logins are coming from humans and which are agents. And because we know that AI agents are unpredictable, it’s hard to know how that access might go wrong.
Beyond data security and privacy, you should also be aware of the simple fact that nobody’s really at fault if you end up losing money using these tools. Chatbots are not regulated in the way that human financial advisers, who have a fiduciary duty to act in your best interest, are.
“If I get bad tax advice from H&R Block or a tax adviser, there are a clear set of rules and guardrails in place to manage what I can expect in that relationship and where the service they use has liability and where that liability ends,” Hand said. “Currently, that’s not the case for these tools.”
In the final years of the Cold War, Ronald Reagan popularized an old Russian proverb: Trust, but verify. The phrase is somewhat nonsensical, since trusting someone implies that you don’t need to verify what they’re saying, and verifying what’s said implies you didn’t trust them in the first place. But if you are willing to shoulder a bit of risk, consider approaching AI this way, especially when your life savings are on the line. I’d also suggest adding a coda to the phrase: And then delete your data.
Chatbots are not stand-ins for licensed financial advisers, he said, and you shouldn’t let them make decisions for you.
The great paradox with tools like ChatGPT and Claude is that they’re very good at generating truthy text. It sounds authoritative and looks correct — and usually is. Except when it isn’t. AI is famously unpredictable and prone to hallucinations. You can ask the same question twice and get two different answers. That doesn’t mean these tools are useless. It just means you have to approach them with caution. You have to interrogate these chatbots, challenge whatever advice they give you, and then crosscheck that with other, more reputable, sources.
“If you’ve never used these tools, I would not encourage you to just change all your financial plans based on your first conversation,” Choukhmane said. “You want to be quite careful. Start using these tools, start understanding, ask a lot of follow-up questions.”
When it comes to mitigating risk, consider giving ballpark figures for your income or spending when you’re talking to a chatbot about your finances. Uploading financial documents, even if they’re redacted, is inevitably filling a tech company’s vault with your sensitive information without necessarily knowing what will happen to it next. You should also dig into your privacy and security settings to make sure you’ve turned on multi-factor authentication and that your personal data is not being used to train AI models and gets deleted after 30 days.
Ethan Bloch, the product lead for ChatGPT for Financial Services, made a similar set of recommendations when I talked to him recently. Chatbots are not stand-ins for licensed financial advisers, he said, and you shouldn’t let them make decisions for you. They’re designed to inform and help you think through complex topics.
“You should liken it to just talking to a friend who has some very informed opinions about finance,” Bloch told me. “But if you’re actually making some large financial decision — your portfolio or retirement — you still need to seek out the help.”
Regardless of how experienced you are with chatbots or how much data you’re prepared to hand over, remember what Campbell, the Harvard professor, said. If your financial literacy isn’t great, AI chatbots can be trouble. And if you’re like most Americans, you could probably stand to learn a little bit more about things like mortgages and interest rates.
Yes, Chatbots can be a good way to brush up on financial literacy. You can ask them the money questions you’re too embarrassed to discuss with friends and family. But you can also learn about money the old-fashioned way: Reading books and websites written by reputable, independent sources. The Federal Deposit Insurance Corp. has a portal of financial education resources, including games and quizzes. Khan Academy has a course that covers everything from credit scores to college savings. There’s a personal finance subreddit that I joined years ago and read almost daily. There are budgeting apps, like YNAB which has its own huge Reddit presence.
Whatever you do to learn more about personal finance, simply doing something is progress. Talking about personal finance isn’t the taboo it once was in the US, and it’s even a required course in the vast majority of American high schools now. And while AI won’t magically solve your money problems, it can help get you started. Just be careful. Your livelihood could be on the line.
Login