If there’s one thing that Americans can unite behind, it’s anxieties over artificial intelligence.

According to a recent NBC News/Decision Desk poll, 70 percent of adults say they are personally more worried than excited about the technology; it’s basically underwater in every area of society with one notable exception: its use in scientific research and medicine.

According to Dr. Dhruv Khullar, a physician at Weill Cornell Medicine and writer at the New Yorker, that optimism is well-founded.

Khullar uses AI tools in his own practice as a physician and writes about their advancements in the medical field. He says that “right now, at least, there’s a generally optimistic view of how AI will change healthcare going forward.”

AI in medicine is nothing new. In 2024, the Nobel Prize in Chemistry was given to researchers who developed an AI model that enabled breakthroughs in predicting protein’s complex structures. As it becomes more ubiquitous, it’s also emerging as a resource for doctors to get second opinions and as a tool to take notes on patient-doctor interactions.

On top of that, Khullar says, it might help unlock new medicines to treat diseases. 

Khullar joined Today, Explained co-host Sean Rameswaram to discuss the ways that AI is transforming drug discovery and research, as well as what it still can’t do. They also discuss how to think about AI’s potential in healthcare at the same time as top AI researchers are increasingly warning about the technology’s risk.

Below is an excerpt of the conversation, edited for length and clarity. There’s much more in the full podcast, so listen to Today, Explained wherever you get podcasts, including Apple Podcasts, Pandora, and Spotify.

You’ve been thinking about lifesaving AI innovation. Has AI already started saving lives?

I think it has. This is the fastest I’ve ever seen healthcare take up a new technology. Part of that might be that the healthcare system is so messed up that there’s an appetite for some type of change. It’s unaffordable, it’s inaccessible, it’s inconvenient, the quality is uneven. 

There’s at least a hope that AI is going to help with all of these things, and I think it’s already starting to make its way into the healthcare system. Now it’s our responsibility to figure out how to make the most of it without also promulgating some of the downsides.

For those who are unaware, tell us how it’s working its way into the system.

It’s helpful to categorize it into a few buckets, at least for healthcare. 

The most rapid uptake, and I think the place that it’s already starting to make a difference, is on the administrative side. Many people who have gone to a doctor recently might have noticed that there’s an AI scribe that’s taking notes now. And people seem to really like it, at least so far. Doctors are able to look their patients in the eye in the way that they weren’t able to when they were poring over their computers and just typing what the patient was telling them. 

The second big area is patient navigation. When is your next scan? When’s your next appointment? Do I need to take this medication on an empty stomach or not? There’s a huge opportunity for people, let’s say, who are diagnosed with a serious illness like cancer or heart failure to navigate the system more seamlessly. 

The third big area that I’m really excited about is drug discovery. AI is making a huge dent in the early parts of drug discovery. 

The last thing that I’m excited about and that I use every day when I’m in the hospital is [AI] as a second opinion. Now instead of having to get a consult or turn to a textbook, AI can be a very, very helpful clinical decision support. It’s not to say that I never consult someone, of course, but that first pass — I’m not sure what’s going on. What are some recent trials that might influence my decision here? Is there something I’m missing? Is there a test that I should be ordering that I’m not ordering? — all those types of things, they start to help with.

The biggest chunk of this positive view of AI and medicine is drug discovery. Tell me more about how that’s going so far and how it might be going in a year, or five, or 10.

I don’t want to leave this conversation and say that we’ve solved the cure for cancer because of AI, but I do want people to know that at least for the early stages of drug discovery — figuring out the very basic steps of is this an interesting molecule? Does it have potential biological applications? — AI is already very helpful for that. 

They’re trying to take, basically, what is an infinite number of drug-like molecules that are theoretically possible to be drugs and they’re trying to match that to some disease that’s going on inside a human. And human biology is incredibly complex as well. There’s tens of thousands of genes, hundreds of thousands of proteins, trillions of cells, and you have to match a potential molecule to a potential target within a human. 

In the past, a researcher might take years to study a disease or a biological pathway and figure out, okay, this protein seems to be involved. And actually, it might not be involved, it might be involved, it might be disrupted, but not be the causative agent. There’s a lot of uncertainty there, so now AI can take enormous amounts of data, and it can rank various potential targets that seem to be the most likely to be causing a particular disease and give you that short short list of potential targets that may have taken months or years in the past.

So now you know what to attack, but you have to figure out what to attack it with. So you need a molecule, you need to generate a molecule that’s going to fit into that target or disrupt that target in some way. 

Now again, AI can scour vast chemical spaces and give you a list of the things that seem to be most likely to be able to disrupt that target. And then it can actually help you generate that molecule in some cases. 

So now we have the target. Now we have something that we’re going to attack the target with. And then you have to do something called lead optimization, and that’s the third thing. Lead optimization means you have this lead and you have to optimize it.

“I would make the counterargument that healthcare is ripe for disruption and you don’t even need the frontier frontier models to make it a lot better with AI.”

Now we have to figure out, of all the molecules that seem to be good at potentially affecting this target, which ones are able to be absorbed in the body, which ones are going to get to the right tissue. AI models can predict the most likely molecule to give you that Goldilocks set of properties that’s needed for a safe and effective drug.

As we all know from anyone who’s asked AI to write an email for them or Googled a question, these tools have a certain degree of certitude, even though these tools can just be flat out wrong about stuff. Are you guys worried about that in the field?

Absolutely. And so this is why I think the narrative around AI just replacing scientists or doctors or other workers is incorrect. Because you still need a lot of judgment. 

You need to be able to adjudicate the output of these models to figure out what is most promising and what is potentially dangerous. That is going to require wet labs and scientists and reasoning based on prior experience and understanding the context. There’s all sorts of issues around, can you manufacture some of the drugs that are being proposed by these models? So just because it’s set, it dreams something up doesn’t mean you can actually make that thing in the real world.

Some of the drugs that it proposes might actually be toxic in certain ways that it didn’t predict. And of course, then you have to take this thing into clinical trials. You have to recruit l people who are willing to put this medication in their bodies. You have to find out who might benefit, you have to put it through the regulatory process. 

That’s why I said that the first part of drug discovery, where you’re trying to figure out how do we get the right drug candidates, what seems most exciting to test further, that’s going to be really accelerated. That whole second half where we actually have to figure out if it works in human biology, that is still going to be in some respects an analog process.

It doesn’t sound like you’re terribly scared that we are like ceding control of our hospitals, of our research facilities, to AI. This is very much in the sort of assistant bucket?

For now it is. And I think one of the challenges is to maintain our agency as these models become more and more sophisticated. As you lean more on these machines, if you’re a doctor, inevitably some of the skills, the critical thinking, the reasoning that we put into coming up with the diagnosis that we honed over the course of years, that can start to atrophy. 

These are the types of things that we still need to sort through as we’re implementing more and more AI into the healthcare system.

For the people who just say, shut it all down, this is too dangerous, the risk is far too great, we don’t actually need this, this isn’t doing anything for society, would you make a counterargument?

I would make the counterargument that healthcare is ripe for disruption and you don’t even need the frontier frontier models to make it a lot better with AI.

Even if we wanted to “slow the pace of the frontier,” fine. But there are models from a year or two years ago that could be very helpful in the healthcare setting. When we’re talking about slowing the pace of the frontier and the most sophisticated and potentially dangerous models, fine. 

But if we’re talking about shutting down AI and not using it in biotechnology or not using it in scientific research or not using it in clinical care delivery, that’s where I would push back pretty hard.

Since President Donald Trump returned to office, he has moved aggressively to leave his mark. Many of his most visible legacy projects are not pieces of legislation, though. They’re part of a campaign to reshape Washington, DC, itself. 

Last year, Trump knocked down the East Wing of the White House to make way for his massive new ballroom. He tried renovating the Reflecting Pool, which did not turn out well. He regilded four large statues near the National Mall, paved the White House Rose Garden, and drenched the Oval Office in gold and golden appliqués.

Other Trump plans are still in the works: He’s proposed building a 250-foot triumphal arch in a traffic circle between the Lincoln Memorial and Arlington National Cemetery, just across the Potomac River. He now says the arch would double as a “military complex,” housing drones, snipers, and ammunition.

And, of course, there’s the ongoing fight over the Kennedy Center, which Trump has threatened could be “ripped down” if he doesn’t get his name on the building in some capacity (he already tried once, and was ordered by a court to remove it).

It’s all a lot to keep track of. Luckily, Today, Explained co-host Sean Rameswaram spoke with New York magazine’s Ben Terris, who recently spent time with Trump touring the ballroom construction site. Terris explains what ties all the disparate projects together and what they reveal about the Trump’s effort to reshape the nation’s capital — and his own legacy.

Below is an excerpt of the conversation, edited for length and clarity. There’s much more in the full podcast, so listen to Today, Explained wherever you get podcasts, including Apple Podcasts, Pandora, and Spotify. 

What is up with Trump’s obsession with physical landmarks? 

Before I even talked to him, I did a lot of reporting about why he seems to be so obsessed with all this stuff. And it’s really like a legacy for him. He’s trying to build something that will last beyond his time here, both his time here in the White House and probably his time here on Earth. He wants to actually have physical monuments to himself. 

Somebody who’s close to him told me that the president doesn’t care that much about legislation. He doesn’t care that much about the kind of nuts and bolts of being a president. He cares a lot about buildings and prizes. If he has buildings and prizes, then he feels like his legacy will go on forever. That’s why he wants the Nobel Prize. That’s why he’s building an arch for himself in Washington. It’s really about a legacy that will withstand the test of time in his mind.

Which is to say, he doesn’t really realize that the right legislation could get him more prizes.

Most presidents try to be very successful presidents and have other people build monuments for you. He’s trying to honor himself, basically. It’s something I asked him about actually when I sat down with him in the Oval Office. There was a viral moment a few months ago from Senator Jon Ossoff, the senator from Georgia who may run for president. And he said at a rally that the president is building monuments to himself because he knows that nobody will do it when he’s gone.

I asked the president this because I thought maybe he’d take a shot at Jon Ossoff or deny it, but I was very surprised. He just said, “Yeah, that’s true. Nobody will do it when I’m gone. When I’m gone, nobody will do it.” 

It feels kind of self-aware, surprisingly, of Donald Trump to not take a shot at Jon Ossoff, but to just agree with him and say, “Yeah, that’s exactly my motivation.”

Part of me though — okay, here’s a guy who recognizes that when he’s gone, history may not necessarily look fondly upon him. But also there was a part of me that thought that that’s not actually what he was saying. 

What he was maybe saying is, “I’m the only person in the world capable of building something as beautiful and important as these monuments. I alone can fix it. I alone can build it.” Nobody else has the ability to do this the way that he has. So on the one hand, possibly self-aware that he won’t be recognized the way he wants to be. On the other hand, maybe it’s just a kind of egomaniac talking about how he’s incredible at things and nobody else can do it. I think it’s all kind of tied up in that he’s not the most introspective person I’ve ever talked to, let’s put it that way. 

But even the least introspective person in the world, when he gets to be 80 years old, might start thinking about what’s left of him after he’s gone.

Tell me about the tour President Trump gave you. 

I thought I was going to get 20 minutes with him in the Oval Office. I ended up getting 45 minutes in the Oval Office and then almost a 45-minute tour of the White House grounds. 

He showed me the Rose Garden, where they put statues and they turned it into a kind of paved-over terrace that looks like Mar-a-Lago. He showed me the Presidential Walk of Fame, where they have all the pictures of the presidents and then the autopen for Joe Biden, and a room called the Palm Room where he put down a new marble floor that he was very proud of. 

The helipad was still being constructed. He walked me over there and introduced me to the construction workers as they were building this helipad. And then he took me to the ballroom itself and showed me this behemoth building. 

“Legislation can be rolled back, executive orders can be reversed. This is something that he feels like can last forever.”

There’s steel rising 70 feet in the air. It’s the size of one-and-a-half football fields. He was bragging about how there’s more steel there than in the Washington Commander stadium that’s being built. It’s this enormous thing that you can’t really see anywhere in Washington unless you go up the Washington Monument and look at it from afar. And I was just in the middle of this thing and I couldn’t really believe how huge it was. 

He wanted to show me this is where the entrance is going to be, [where] the chandeliers will be. He told me he could picture it all already because this is, quote, “What I do.” 

He’ll gaze out the window in the morning first thing in the morning from the residence to see the work. He’ll look out the window at night to see the work. He is monitoring this very closely.

One thing that the ballroom especially shares with the Kennedy Center is that it feels like this administration is doing its darnedest to outmaneuver the courts, to get around any legal questions concerning the work. Did that come up at all while he was giving you this tour?

When I was getting the tour, the Supreme Court had not yet ruled that they could keep going. There was a kind of pause on their ruling where they were allowed to keep doing construction while the Supreme Court figured out how they were going to rule on it. And so clearly they were racing against the Supreme Court to get as much done as possible. They really wanted to become like a fait accompli. They wanted it to look like the whole thing was done. It was beyond going back. 

I was asking the president, “Are you worried that the Supreme Court is going to rule that you can’t keep doing construction unless you get permission from Congress?” Congress does have the right to decide what happens to federal buildings, so it would make sense that they would be able to make a decision on this. And he said he wasn’t worried about it at all. He said, “the Supreme Court’s going to make the right decision. The people want this.”

He’s like, “If I needed to get Congress’s approval, I could do it, but it’s not going to happen.” And he ended up being right. He doesn’t need Congress’s approval. The Supreme Court’s letting him do it.

But Congress may get shaken up in about a month and a half. Is that on his radar?

Yes, and certainly Democrats are aware. I talked to a bunch of Democrats for this story mostly about what happens next. Are they going to start investigating the ballroom? Are they going to start looking at subpoenaing donors and looking at the contracts and figuring out if there’s a pay-to-play scheme, if there was illegal construction happening? And Democrats are champing at the bit for that. 

They’re calling it a target-rich environment. They’re ready to get subpoena power. And they’re also talking about in 2028, what do we do if we get the White House ourselves? Will we tear this down? 

[Rep. Alexandria Ocasio-Cortez] says she wants to turn it into a soup kitchen. There are all sorts of ideas for it. I asked the president about that too. I said, “Are you worried that Democrats will get the White House in 2028 and they come and they tear down this ballroom right after you built it?” And he basically said, “I’d like to see them try.” 

He said, “We’re building this ballroom with nuclear concrete.” That’s what he called it, nuclear concrete, concrete that can withstand a nuclear blast. He’s like, “If it can withstand a nuclear blast, I’d like to see Democrats try to take it down.” 

He told me somebody could go to the ballroom with a jackhammer and spend two days straight jackhammering one column and it wouldn’t even leave a mark. And so he’s basically daring them to try to tear it down because he’s building something that he feels like can withstand a nuclear blast so it can withstand Democrats.

At the end of the day, all of this is just about his legacy. That’s what you learned by hanging out with him and talking to him about it. Do you think by spreading his efforts across DC, he’s ensuring that at least something stands and that his legacy is ultimately secured? 

He definitely thinks that these buildings can withstand more than anything else. Legislation can be rolled back, executive orders can be reversed. This is something that he feels like can last forever. 

I do think there’s a world in which Democrats tear down some of the stuff. The arch is a good example. I mean, the ballroom is hard to tear down, right? First of all, it’s super expensive. It’s huge. It also has to be replaced with something. You can’t just tear it down and then leave a hole in the ground. You have to then build another ballroom, which would be kind of a crazy thing to do and take all this time and then become another story about how Democrats are spending all their time building a ballroom. 

Is it possible? Sure. It just seems a little bit harder to imagine, but the arch, you could see that thing getting dynamited on some Fourth of July and then just leaving it as a traffic circle. So I could see a world in which maybe some of these things get destroyed in a kind of, I don’t know, epic fashion. Why not?

It feels like he might be onto something, which is that it would be very controversial to just tear something down for the sake of it out of spite.

Absolutely.

There’s also two years left in his term. Do you get the sense that this is slowing down or ramping up?

It’s hard to say. I have a hard time believing it’s going to end, especially if he becomes a lame-duck president and there’s even fewer things he can do legislatively.

Why not just keep building things and putting your name on things because there’s nothing else to do with your time? 

He said that in the first term, the reason he didn’t do a lot of this stuff is because he was too under siege, that it was a difficult time to build a ballroom because of the Russian investigations or the impeachment trials and stuff like that.

Maybe he gets tied up in all that same kind of stuff if Democrats take charge, but I also feel like he’ll have an easier time just trying to ignore subpoenas. It’s going to be a really messy time. And so maybe he’ll just hole himself off into a room somewhere designing more buildings, because what else is he going to do?

For decades, research into Alzheimer’s disease has made painfully little progress. More than 7 million Americans are living with the disease, which is the most common cause of dementia. It’s incurable, and treatments have been hampered by groupthink, as well as by systemic fraud from some of the field’s most famous researchers.

But there are finally signs that the field is turning a corner, including two new drugs, rolled out in the last few years, that can treat Alzheimer’s directly.

“If somebody walks into a clinic right now and is diagnosed with Alzheimer’s disease,” Vox senior correspondent Dylan Scott tells Today, Explained co-host Sean Rameswaram, the drugs “will hopefully have some effect in slowing down their cognitive decline.” 

As Scott says, “The drug development pipeline is also starting to look much more robust” — even “revolutionary,” to quote one doctor he spoke with.

The two talk about why researchers are more optimistic than they have been in years, whether GLP-1 drugs might help prevent Alzheimer’s, and an experimental surgery pioneered by doctors in China that has produced striking — but if unproven — reports of improvement in people with the disease.

Below is an excerpt of their conversation, edited for length and clarity. There’s much more in the full podcast, so listen to Today, Explained wherever you get podcasts, including Apple Podcasts, Pandora, and Spotify.

You mentioned two treatments. Tell us what they are, Dylan?

We have two drugs right now that have been approved by the FDA: lecanemab and donanemab. And these are drugs that target the amyloid plaque in the brain that scientists have long thought might be associated with the development of Alzheimer’s disease.

The amyloid hypothesis [the belief that Alzheimer’s is caused by the buildup of deleterious amyloid proteins in the brain] has been very controversial for a while, in part because there were these years and years where we weren’t seeing any progress despite this being the dominant hypothesis about the disease. But we do have these two drugs that in clinical trials have been shown to both clear out the amyloid plaque in somebody’s brain and they do seem to lead to slower cognitive decline for those patients.

And the hope is that this is the ground floor. These are the worst drugs, hopefully, that we’re ever going to have and continued scientific discovery and progress with developing drugs will lead to even better treatments in the future.

“The hope is that five, 10 years from now, we’ve got a much more robust suite of treatments that can help somebody who’s been diagnosed with Alzheimer’s.”

Tell us more about the scientific discovery. You mentioned that there’s promising research beyond amyloid plaques?

It’s not like the amyloid hypothesis has been invalidated, but I think our understanding of the disease has become more complex. 

We’re realizing that there’s probably also a role for a different kind of protein called tau. There may also be a role with chronic inflammation, your vascular health, your body’s ability to just pump blood through your body may also be playing a role in the development of Alzheimer’s disease. And so now we’re starting to see treatments that target these other things. 

The way I’ve been thinking about it is if we used to be putting all of our bets on amyloid, we’re still putting some bets on amyloid, but we’re also putting bets on these other things. And so now there are treatments in the works targeting, for example, these tau proteins.

They’re still in the early stages of clinical trials — really at the stage where they’re just checking the safety of these drugs and making sure that somebody can take them without getting really sick, or God forbid, dying or something like that. But even when they’re doing those safety checks, they do start to collect qualitative data about, well, are we starting to see any effects? 

Some of the preliminary results from some of these tau targeting treatments that are in the works have looked pretty promising. And so that’s encouraging, obviously. It’s possible that we’re moving towards a future where not unlike cancer treatment, there’s not just one drug for Alzheimer’s disease, but maybe you take a combination of different things that work on different mechanisms for the disease and the collective cumulative effect is that it stops the progression or even reverses it. 

The hope is that five, 10 years from now, we’ve got a much more robust suite of treatments that can help somebody who’s been diagnosed with Alzheimer’s.

Five, 10 years from now sounds nice, but is there anything else that’s in the cocktail now that people are discovering could be promising for Alzheimer’s?

There are also, yes, drugs that millions of people are taking right now for other reasons that might also be able to help with Alzheimer’s disease. And GLP-1s in particular are the big ones.

No way!

Yeah, I know. These drugs — it seems like every day you see some new headline about this miraculous thing that they can do.

Weight loss, smoking, my poker addiction, and…?

And it might prevent dementia down the road. 

If you step back and think about it, the theory does make some sense. Like I said before, scientists increasingly think there’s an association between your vascular health and your cognitive health, especially as you age. And what do these GLP-1 drugs do? They help people lose weight. 

Losing weight helps to lower your blood pressure, lowers your risk of vascular problems, whether it’s heart disease or pulmonary disease or stroke or something like that. So if more and more people take these, they take them earlier in life, they lose weight, they keep it off, they don’t develop these heart or vascular problems, it does make some sense that that may also reduce their risk of developing Alzheimer’s disease. 

It’s still sort of theoretical, but the Alzheimer’s Association is putting $100 million behind some research projects to investigate this possible link. We may learn five, 10 years from now, as millions of people are now on these GLP-1 drugs — maybe we start to see Alzheimer’s less often. And that would be another reason to be optimistic that the future for this disease is looking brighter.

How about reversing it? Is that still a pie in the sky?

It’s out of reach for now. Certainly some of the scientists that I’ve talked to have said, “In theory, it should be possible. Your brain is really resilient. It’s really good at rebuilding itself if you give it the chance.” It seems like it should be possible to stop the progression of the disease eventually, and maybe ultimately reverse it. 

Now, there has been some really intriguing, but also mysterious developments around reversing Alzheimer’s, not from scientists based out of the United States, but from scientists in China. People may or may not have seen that there have been videos of these patients who underwent an experimental surgery and the before and after of these videos is incredible.

In the before, you’ve got somebody who clearly has Alzheimer’s disease, doesn’t recognize their loved ones, has trouble with their train of thought. In the after videos, it’s like they’re a completely different person. They recognize their loved ones, they’re talking articulately. And so that has, as you can imagine, generated a lot of excitement, also a fair bit of skepticism.

Are these videos real? Do we know?

We don’t know for sure if they’re real or not. What’s intriguing about this surgery is that the theory of it, at least to me as a lay person, makes some sense. 

The gist of this surgery is the surgeons create a drain in the patient’s brain and the drain is supposed to help the brain get rid of these amyloid and tau proteins that we think are associated with Alzheimer’s disease. On a hypothetical level, it makes some sense. And scientists in the United States and Europe and elsewhere have been intrigued enough about these videos and the findings that have been reported in academic journals to set up their own studies to try to replicate these findings. 

Now, it’s a crazy story because this scientist in China who pioneered this idea has actually been arrested by the Chinese government. And as I understand it, he’s currently in detention.

For what?!

The reporting I saw was these seem to be kind of flimsy charges of insurance fraud. The Chinese government has also tried to ban the surgery, at least outside of clinical trial settings. So that’s obviously complicated the story a little bit.

But nevertheless, you do have scientists in the US and outside of China who are like, “Well, we at least want to try this for ourselves and see if it works.”

It does feel like it’s something that could get people’s hopes up who have been waiting for this for decades.

Exactly. I mean, I think this is like the holy grail. Can we find a way, whether through surgery or through pharmaceuticals, to actually reverse these symptoms and restore the person to who they were before Alzheimer’s took over?

Because that’s the thing that I think everybody recognizes but is worth emphasizing, is, as one doctor put it to me, and I’ve never forgotten it, Alzheimer’s is a disease unlike any other because it robs you of your identity. 

To be able to restore people’s identity through whatever means, that is the goal that all of these scientists are chasing.

Is AI going to kill us all? 

In Silicon Valley, it’s not such a novel question. But after Anthropic employee Jacob Coxon quit his job last week and posted on X that AI “could kill us all by the end of the decade,” a lot more people are asking. 

“This is not a marketing stunt,” Coxon wrote. “If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately. No other human activity poses this level of danger.”

Coxon is far from alone in his assessment — some current Anthropic employees agree — but his post struck a particular chord. The AI industry quickly weighed in, with Anthropic CEO Dario Amodei calling for an industry-wide slowdown on frontier AI research. Other AI leaders, including Sam Altman and Elon Musk, have done the same.

To break down whether we really need to worry about a robot apocalypse, Today, Explained co-host Sean Rameswaram spoke to Wired senior writer Maxwell Zeff. According to Zeff, “there are a lot of people in Silicon Valley right now who are warning that that’s a real possibility.” But not everyone agrees, and they certainly don’t agree on what to do about it. 

Below is an excerpt of Sean’s conversation with Zeff, edited for length and clarity. There’s much more in the full podcast, so listen to Today, Explained wherever you get podcasts, including Apple Podcasts, Pandora, and Spotify.

Are we all going to die at the hands of AI?

There are a lot of people in Silicon Valley right now who are warning that that’s a real possibility. 

The thing that people have to understand is that Silicon Valley has been calling for added attention on AI safety for years. So when this Anthropic researcher said last week that he was worried that AI could kill humanity in the next few years, that was shocking to many people. My parents, my family called me, and they were worried, understandably. They asked me the same question: “Are we going to die?” 

And I had to tell them, these people have been worried about AI killing all of us for years, and now it seems to be breaking through.

What was it about this statement from Jacob Coxon that broke through?

I interviewed Jacob, and the thing he said to me is that he thinks this is just the right time. Anthropic is about to go public in what could be the biggest IPO ever. The Trump administration is focused on AI in a way that no other presidency has ever been before. And of course, yes, the Hugging Face incident everyone just heard about, you talked about it on your show a few weeks ago. 

People are starting to become aware that these AI systems are getting really good, and the companies that are building them don’t seem to understand how to control them. His tweet got more than 150 million views on X. It was heard around the world. And it also was a big wake-up call to lawmakers and leaders in Silicon Valley and saying, “This is a moment for action.”

Are there people who are pushing back?

One of the most interesting pushbacks that this got was from David Sacks, who is an adviser to the Trump administration on AI. He has called out a lot of this as “doomerism” and said that these calls for AI to slow down are the AI industry warning about the technology that they’re building and advocating for regulatory capture. 

There’s a lot of skeptics in Silicon Valley who think that this is just another person in the AI safety community that is blowing the whistle. The view of a lot of venture capitalists and investors and startup founders in Silicon Valley is that we don’t need some big regulation to protect us from AI risks. We just need to uplift more players in the space.

The skeptics don’t win the day. In fact, it’s the doomers and the fatalists who do, right? Because Jacob’s call only leads to more calls right up to the top of Anthropic.

What this all leads to is [Anthropic CEO] Dario Amodei [posting] a blog saying that we need to “pace the frontier.” This is a call for the entire AI industry, not just Anthropic, not just OpenAI, but also Google, Meta, Microsoft, Amazon, all the big tech companies in America, to get together and slow down their AI development. 

This doesn’t mean they’re going to stop building AI altogether. They’re still going to put their products out into the world. They’re still going to try to improve them, but they just want to make it a little slower than it would be if it was completely uncontained.

Amodei really asks for three specific things: 

• The first thing is, AI companies should have these independent evaluators inside of them. This is a common thing in other industries like the banking industry or the airline industry. People come in to make sure that these companies are doing safe things. 

• The second thing is this collaborative effort from American AI companies [on safety], and that actually will need to involve the US government to allow this to happen. The US government, he says, may need to issue some sort of waiver, some sort of law that says they can go ahead and coordinate on safety. 

• The third thing is this international slowdown, this international agreement between China and the US and Europe to say, “Hey, we recognize that this is akin to a nuclear arms race and it’s too dangerous for all of us to be competing with each other.”

All these guys are responsible for the rapid acceleration of AI models in our lives, collaborations with the Defense Department, God knows what else. And they’re all coming out over the weekend at the exact same time after this whistleblower and saying, “Yeah, dude, slow this thing down. This thing’s crazy.” Should we be skeptical?

It is very fair to be skeptical of this claim. One thing that these AI companies have realized in the last year is that AI is extremely unpopular. Recent polling suggests that a majority of Americans think AI is developing too fast. They’re worried about it. They think it’s going to take their jobs. They are not big fans. Maybe you’ve heard — data centers are not very popular. 

By calling to pace the frontier and saying, “We’re going to slow our own development down,” they notched this up as a public perception win. This is them getting out in front of this and saying, “Hey, we want to be safe. We want to be responsible.”

They’ve seen what’s happened with Meta and what’s happened with social media companies in the last two decades, and they are really cognizant of trying to get out in front of that.

Is there any truth to this major first collective freakout we seem to be having right now?

There’s a fairly large camp of people inside of AI companies who genuinely worry about the safety of these AI models. 

To go back to the Hugging Face incident, this was a case where OpenAI was training thousands of AI systems internally, and the systems escaped the sandbox that OpenAI thought was isolated from the internet and hacked into another company’s production infrastructure. The agents were colluding together on something. They were trying to deceive the humans that were testing them. And this was all happening without OpenAI knowing what was going on. 

It’s hard to understand how much of a wake-up call this is to Silicon Valley, that they don’t have their AI models under control. People worry that while in this case there was not a ton of economic damage [or] damage to real humans’ everyday lives, it’s not unreasonable to think that more capable AI systems could hack into financial infrastructure, modern-day utilities, and more critical services that are based online. 

Dario Amodei says as much in his post, that he thinks that in six to 12 months, an AI system could take down the whole internet. It’s not just that they’re trying to protect their bottom line here. But it’s possible that these calls for safety are beneficial to the companies in more ways than one.