Anthropic's CEO just warned everyone that the next big AI risk to humanity is 'actually AI companies themselves'

Claude on phone with Anthropic logo in the background
(Image credit: Shutterstock)

As AI grows exponentially smarter, and chatbots become integrated into our daily lives, public excitement has increasingly given way to something else: unease.

For years, pop culture has warned us what could happen if powerful machines go unchecked. Films like "The Terminator, 2001: A Space Odyssey," "Blade Runner" and "The Matrix" all explore variations of the same fear — AI that turns on its creators, manipulates human behavior or becomes so deeply embedded in daily life that society can no longer function without it.

In a newly published 38-page essay shared on his website, Anthropic CEO Dario Amodei lays out a sobering list of risks advanced AI could pose if left unchecked. His warning isn’t just about rogue machines or science-fiction scenarios. One of the most pressing dangers, he argues, may come from the very companies racing to build and deploy AI systems in the first place.

Dario Amodei points to the companies behind AI that stick out as an imminent threat

Dario Amodei, Anthropic CEO

(Image credit: Getty Images)

One of the most striking warnings Amodei raises isn’t about AI going rogue — it’s about the growing power of the companies building it.

“It is somewhat awkward to say this as the CEO of an AI company,” Amodei writes, “but I think the next tier of risk is actually AI companies themselves.”

He points to the sheer scale of influence these firms now hold. AI companies control massive data centers, train the most advanced models, and possess unmatched expertise in how those systems are used. More concerning, some of them interact daily with tens — or even hundreds — of millions of users.

That kind of reach comes with real risk. Amodei warns that AI companies could theoretically use their products to manipulate or “brainwash” users at scale, arguing that the governance of AI companies deserves far more public scrutiny than it currently receives.

Those concerns feel increasingly urgent as government oversight struggles to keep pace. The idea that powerful AI firms could shape public behavior through chatbots and consumer tools no longer feels far-fetched — and the lack of clear regulation only heightens that anxiety.

The physical footprint of AI is already making its presence felt. Data centers have rapidly expanded across the U.S., bringing unintended consequences for nearby communities. These facilities consume enormous amounts of electricity and water, place heavy strain on local power grids, and in some areas have been linked to environmental conditions that residents say make the air harder to breathe.

As a result, protests against new AI data centers are becoming more common — a reminder that the impact of AI isn’t just digital. It’s physical, environmental and increasingly hard to ignore.

Recent protests have sprung up in North Carolina, Pennsylvania and Virginia, plus a community in Wisconsin is looking to expel its mayor after he approved of a data center being built there.

He also alluded to the other threats that AI could spring up in the future

Moonvalley AI image

(Image credit: Moonvalley)

Throughout the rest of Amodei’s caution-filled essay, he brought up a slew of other dangers that AI could present in the future. Among those are the rise of terrorists using AI to carry out their attacks, a colossal increase in the rate of job losses, and government leaders being deterred from speaking on those problems due to the power and money that come with supporting AI.

On that last point, Amodei had this to say: "There is so much money to be made with AI — literally trillions of dollars per year. This is the trap: AI is so powerful, such a glittering prize, that it is very difficult for human civilization to impose any restraints on it at all."

Amodei presented a solution that could keep AI’s rapid growth in check

ai models

(Image credit: Freepik)

Amodei didn’t just present the potential issues that may arise with the swift development of AI in the future, but he also spoke up about one of the solutions that could prevent them from happening. He pointed to the element of millionaires and billionaires, who could use their power and influence to do good instead of adopting a nonchalant attitude.

"Wealthy individuals have an obligation to help solve this problem," Amodei noted. "It is sad to me that many wealthy individuals (especially in the tech industry) have recently adopted a cynical and nihilistic attitude that philanthropy is inevitably fraudulent or useless."

Bottom line

While AI has resulted in some positive changes to society (aiding healthcare workers, personalizing education, and making daily living easier with the rise of smart assistants), there are plenty of negative ones that have sprung up in droves. It’s reassuring to see a CEO from one of the leading AI companies do his part to make everyone aware of the grim future we face if AI is left unregulated.

Amodei’s standout comment from his essay is a call to action for us all: The bottom line: "Humanity needs to wake up, and this essay is an attempt — a possibly futile one, but it's worth trying — to jolt people awake. The years in front of us will be impossibly hard, asking more of us than we think we can give."


Click to follow Tom's Guide on Google News

Follow Tom's Guide on Google News and add us as a preferred source to get our up-to-date news, analysis, and reviews in your feeds.


More from Tom’s Guide

Category
Arrow
Arrow
Back to Gaming Headsets
Colour
Arrow
Condition
Arrow
Minimum Price
Arrow
Any Minimum Price
Maximum Price
Arrow
Any Maximum Price
Elton Jones
AI Writer

Elton Jones is a longtime tech writer with a penchant for producing pieces about video games, mobile devices, headsets and now AI. Since 2011, he has applied his knowledge of those topics to compose in-depth articles for the likes of The Christian Post, Complex, TechRadar, Heavy, ONE37pm and more. Alongside his skillset as a writer and editor, Elton has also lent his talents to the world of podcasting and on-camera interviews.

Elton's curiosities take him to every corner of the web to see what's trending and what's soon to be across the ever evolving technology landscape. With a newfound appreciation for all things AI, Elton hopes to make the most complicated subjects in that area easily understandable for the uninformed and those in the know.

You must confirm your public display name before commenting

Please logout and then login again, you will then be prompted to enter your display name.