Today: As is tradition, AWS released all the news that won't make the re:Invent keynote ahead of time, the Allen Institute for AI introduces a powerful and truly open-source AI model, and the quote of the week.
This era of enterprise software is either the dawn of a new era of corporate productivity or the most hyped money pit since the metaverse. ServiceNow's Amit Zavery talks about the impact of generative AI, how SaaS companies should think about AI models, and his decision to leave Google Cloud.
The nuclear option: Why the data centers of the future could run on the power source of the past
The AI boom is pushing the limits of clean-energy sources, forcing utilities to push back on new data-center construction plans and keep their coal-fired plants running. A relatively small but fast-growing number of people believe the solution is nuclear power.
Enterprise tech companies have been at the vanguard of investment in renewable and sustainable energy over the last two decades, seeking new, clean power sources for their rapidly expanding data-center campuses that allowed a generation keenly aware of the threat of climate change to sleep at night. But the AI boom is pushing the limits of those sources, forcing utilities around the world to push back on new data-center construction plans and keep their coal-fired plants running.
A relatively small but fast-growing number of people believe the solution is nuclear power, which just a few years ago seemed like a dangerous relic of the 1970s and 1980s. But nuclear reactors offer almost everything data centers need in a power source; they provide a constant, efficient, and reliable stream of electricity that could supplement other renewable sources like solar and wind.
"This is stuff we figured out in the 1940s and 1950s, before the personal computer was invented," said Michael Crabb, senior vice president of commercial at Last Energy, a company building small modular reactors, or SMRs. "We've gotten a lot better at it."
SMR companies like Last Energy are betting that smaller reactors can fill the energy gap much more quickly than waiting for large-scale plants to be built to service the power grid. Other startups, like Helion Energy and Commonwealth Fusion Systems, want to aim higher by proving that nuclear fusion can be a practical alternative to meet the energy needs of the next computing boom.
And last week the White House weighed in on behalf of the nuclear revival, which if the Biden Administration manages to secure a second term could lead to profound regulatory change.
“Nuclear and renewables are complementary and nuclear is the only proven clean and firm energy technology,” said Rian Bahran, assistant director of White House Office of Science and Technology Policy, according to Data Center Knowledge.
Up and atom
A new generation of data centers designed for AI workloads is already putting a strain on the power grid, and in recent months AWS, Microsoft, Google, Meta, and other hyperscalers have announced plans to sink well north of $100 billion into data-center expansion just this year. At the same time, real-estate companies like Blackstone see a land grab underway and have aggressive plans to build data centers for companies that want to manage their own AI servers.
In 2022, Microsoft signed a deal with Terra Praxis to "decarbonize coal facilities with nuclear power, helping transition one of the world’s largest sources of carbon to zero emissions" using Microsoft software and services. The following year it posted job ads for nuclear experts who could conduct "the technical assessment for the integration of SMR and microreactors to power the data centers that the Microsoft Cloud and AI reside on," according to DCD.
SMRs like Last Energy actually borrowed a lot of design principles from the data-center buildout of the last 15 years, Crabb said. Last Energy's 20-megawatt nuclear prototypes are 12 feet tall, 12 feet wide, and 48 feet long, and they are made up of modules that can be chained together to add more power as required by modern cloud data centers, which typically consume between 20 to 100 megawatts of power depending on their size.
Last Energy's pitch to data-center companies is simple: we run the nuclear stuff, you buy the power, and we can get up and running in a fraction of the time it takes to add large-scale nuclear power plants to the U.S. electrical grid.
"If you take 15 years to build a gigawatt scale facility, there's no world where you can establish a commercial relationship with a data center that takes 18 months to build their facility," Crabb said.
Come together
However, SMRs are in the somewhat-disappointing section of the hype cycle, with only two in production around the world as of March. And like the large-scale reactors of the past, they generate a hazardous waste product that must be dealt with very carefully and protected for a longer scale of time than the server that is hosting this article will likely be online.
That lack of progress has spurred interest in the holy grail of energy production: nuclear fusion, which promises a safe, reliable source of energy with a waste product that decays much faster than waste from nuclear fission.
"It's clean, it's firm, it's safe, it's scalable, it's secure," said Rick Needham, chief commercial officer at CFS. "It finally removes you from the geopolitical supply chain completely."
However, it is very important to point out at the onset of any discussion regarding nuclear fusion that the technology has not been proven to actually work at any kind of commercially relevant scale, let alone the scale that nuclear fission has provided for decades. In late 2022 researchers demonstrated that they could generate more energy from fusion than used to produce the reaction, which was an important milestone that nonetheless leaves the industry a decade or more from actual commercial relevance.
The worst thing that happens at a fusion plant is it just turns off.
But fusion backers have a big advantage over fission fans; the U.S. has agreed to regulate fusion development "more like a particle accelerator, or a medical facility that does radiotherapy," Needham said. That means if the technology becomes commercially viable, fusion plants will be much easier to construct than fission plants — even SMRs — under the current regulatory rules.
"The worst thing that happens at a fusion plant is it just turns off," Needham said. "It is not a chain reaction; there's no such thing as a meltdown at a fusion plant."
Promises kept?
In order to build out the next generation of data centers, the hyperscalers are going to need to either find alternative sources of energy or backtrack on the climate pledges they've all made; including Amazon, which literally sponsors a hockey rink called Climate Pledge Arena. Microsoft is already running into trouble living up to its promise to be carbon-neutral by 2030, acknowledging two weeks ago that its energy footprint has grown 30% in just the last four years.
When building new data centers, Microsoft typically signs long-term power-purchasing agreements with utilities for up to ten years of supplies, said Alistair Speirs, director of Azure global infrastructure. The company has no immediate plans to specifically increase its use of nuclear power plants in the near future, he said, but it will take any form of clean energy it can get as it expands.
"Our requirement is zero carbon," Speirs said. "An electron doesn't have a barcode, you don't know where it came from." However, Microsoft is primarily interested in sourcing energy from the broader electrical grid, he said, and likely won't be running its own power plants any time soon.
This story was updated to clarify the size of Last Energy's nuclear prototypes, and to remove misleading pricing information provided by a Last Energy executive.
Tom Krazit has covered the technology industry for over 20 years, focused on enterprise technology during the rise of cloud computing over the last ten years at Gigaom, Structure and Protocol.
Despite recent challenges to their hegemony, x86 chips still power the vast majority of cloud and on-premises servers in use today. However, over all those years Intel and AMD tweaked x86 in subtle but incompatible ways to suit their own needs, and Tuesday's agreement is a promise to unify x86.
This week a U.K. regulatory agency published summaries of hearings it conducted this past July with AWS, Microsoft, and Google Their responses provide an interesting look into how the cloud providers see themselves, their competitors, and the current state of the market.
For years, Oracle tried to convince longtime database customers who wanted to shed their on-premises data centers to run those databases on Oracle's public infrastructure cloud, slamming AWS at every turn. Times have changed.
A generation of cloud architects, developers, and systems engineers has stayed loyal to AWS over nearly two decades in part because of its reputation for supporting anything it launched that was used by a customer to build their infrastructure. That commitment appears to be changing.