Powering the AI

Today I want to give you some possibly eye-opening information on AI and energy. Then, since it’s Fed week, I have a few reactions to the latest dot plots.

Long, Hard Road

Investors often get overexcited about new technologies because they don’t consider the inevitable implementation problems. You can have a great idea, do the work to prove the concept, and still face a long, hard road to executing at scale and making real profits.

This isn’t new. Building a great sailing vessel to reach the New World was one thing; getting it across the ocean was another. It’s true in warfare as well; an army really does travel on its stomach. World War II was won not just in battle but by the farms and factories that supplied the Allied forces. This is why amateurs talk about tactics, but great generals study logistics.

All this applies to AI technology as well. Achieving the breakthroughs that now seem within reach requires both software and hardware. Someone has to design the hardware, build the hardware, and then operate the hardware. That last step will require stupendous amounts of energy.

You may have heard the term “LLM” or large language model. That’s the technology behind ChatGPT and similar AI systems. LLMs read documents then calculate, letter by letter, word by word, how bits of information usually go together. This requires many millions of computations.

Think of it as building a sandcastle one grain of sand at a time. It’s possible in theory but not in reality because you can’t move fast enough to do it in one lifetime. The newest computer chips can… but only if they have a sufficient power source.

Note also, the power isn’t just for the microchips. Running so many calculations so quickly generates heat. The disposing of it requires cooling systems which consume yet more power (and sometimes massive amounts of water—another not-cheap resource). Yet more power goes into transporting data between users and servers, that may be thousands of miles apart.

You begin to see the challenge. AI generates enormous new energy demand on top of everything else. This is pure growth, not the replacement for something that will go away—at least not yet.

It’s hard to get to Net Zero when we keep inventing new technologies that consume ever larger amounts of energy. The goalposts keep moving.

We are also shifting some energy demand from direct burning (gasoline, heating oil) to electric vehicles and heating systems. The amount consumed may not change much but it puts more strain on the electric grid. US electricity demand growth has tripled since a decade ago.

AI and crypto aren’t causing all this demand growth but they are substantial parts of it. This chart shows past and projected data center energy usage, compiled by McKinsey last year.

Here is a map from S&P showing currently operating (blue) and planned (yellow) US data centers. The size of the circles represents their estimated power demand.

Many think AI will revolutionize, well, almost everything. I agree, but we will have to find ways to meet the new energy challenges that go with it.

The picture below is me and good friend Frank Holmes in one of his bitcoin mining data centers in Iceland (where cooling is no problem). This was the center of three aisles in one of several massive buildings. And the AI data centers dwarf this.

If you search for “how much energy will AI need,” you’ll find many of the articles refer to a Dutch analyst, Alex de Vries. He was an early crypto skeptic and began tracking crypto mining’s vast energy requirements.

Then in 2022, de Vries looked into AI’s energy demand. Since few of the companies doing AI would talk about their energy usage, he simply counted the number of chips Nvidia said it was shipping, how much energy they use, and then extrapolated. He estimates by 2027, powering those chips will take well over 1% of total world energy usage—not counting the cooling and other related demand.

This is from a recent New Yorker piece on the subject:

“‘There’s a fundamental mismatch between this technology and environmental sustainability,’ de Vries said. Recently, the world’s most prominent A.I. cheerleader, Sam Altman, the C.E.O. of OpenAI, voiced similar concerns, albeit with a different spin. ‘I think we still don’t appreciate the energy needs of this technology,’ Altman said at a public appearance in Davos. He didn’t see how these needs could be met, he went on, ‘without a breakthrough.’ He added, ‘We need fusion or… radically cheaper solar plus storage, or something, at massive scale—a scale that no one is really planning for.’”

In the US, data centers now account for about 4% of electricity consumption, and that figure is expected to climb to 6% by 2026.

Squaring the Circle

The excitement surrounding AI is comparable in some ways to the excitement surrounding renewable energy. They might seem like a match made in heaven: boundless AI electricity demand met by clean, plentiful solar and wind power. A virtuous circle for everyone.

These renewable energy sources are indeed growing quickly. They are an important part of the mix, but they have limitations. The main one is “intermittency,” the fact that they produce electricity only when the sun shines and the wind blows. Data centers operate 24/7 and need generally constant amounts of electricity around the clock. They can’t just shut down because the winds are calm.

People are trying to square this circle. Google is running an experimental geothermal power plant in Nevada to help run two of its data centers. Others are building giant battery farms to capture excess solar and wind production for later use. This helps but not nearly enough.

As of right now, the most consistent around-the-clock clean electricity generation is nuclear power. The tech industry sees this and is getting more interested. That’s great because our nuclear power base is aging rapidly and not being replaced.

Microsoft is reportedly investing in small modular reactor technology. These could be located adjacent to data centers and provide the kind of steady supply that other renewable sources can’t. Amazon recently moved in that direction, buying a data center next to an existing nuclear power plant in Pennsylvania.

I’m a huge nuclear power advocate, especially if we can cut through some of the bureaucracy that makes it so expensive and time-consuming to build. (See that lone 2023 addition in the chart above? That was the expansion of an existing Georgia plant which cost more than $30 billion.)

Even better and hopefully less costly nuclear technologies like thorium reactors are coming. But none of them are coming as fast as AI power demand is growing.

All this leads to an obvious conclusion many people, particularly environmentalists, don’t want to admit. We aren’t going to “phase out” fossil fuels anytime soon. They are and will remain a large, critical part of global energy supplies. Nothing else has the same combination of abundant supply, well-developed infrastructure, and ability to keep producing in any weather conditions. The International Energy Agency (IEA) increases its demand forecast seemingly every year, sometimes twice a year.

If you are worried about the climate, you will likely say this isn’t good. What are the alternatives, though? The world doesn’t have sufficient clean energy to supply demand, nor do we have good ways to reduce demand in the amounts needed. A deep, multi-year global depression might do it but at high cost.

All this energy use is from current versions projected forward of AI. As we get newer and more data-hungry versions, and more companies emerge offering AI, and even more companies use it, that energy use is going to compound in ways that we don't understand now and we certainly aren't planning for.

This makes the aspirational dream of Net Zero even further away. We will be needing oil and gas and coal for much longer than many hope. Which is why I am still bullish on energy. And nuclear.

Much like monetary policy, this is one of those things where we don’t have ideal choices. All the alternatives are bad in different ways. We can only choose the least-bad one.

But speaking of monetary policy…

Dot Plot Thoughts

We had a lot of central bank news this week. First, the Bank of Japan raised its policy rate for the first time since (checks notes) 2007! They hiked from -0.1% to 0%, thus (I hope) ending the era of negative interest rates. It was a baby step but still hugely significant. The BOJ also ended its yield curve control strategy which had been keeping long-term government bonds at 0% and will also stop buying ETFs and REITs.

The Japanese authorities had little choice in this matter, as inflation is finally taking off there. It’s nothing like we face here, but wages and some consumer prices are rising in ways unseen for many years.

Meanwhile in Europe, the Swiss National Bank became the first central bank to cut rates in this cycle. The European Central Bank, Bank of England, and Bank of Canada are also hinting they will cut soon. A turning point seems to be at hand, but the timing is still highly uncertain.

Back in the US, this week’s Federal Open Market Committee meeting brought no policy changes but a wealth of signals to interpret. The last quarterly set of “dot plots” in December showed the median committee member expected the fed funds rate to be 4.6% at the end of 2024. That would be 75 basis points less than the current level, or three quarter-point cuts. The big question this week was whether this projection would change. It didn’t, staying at 4.6%.

Each dot in that circled cluster represents one member’s forecast. While the median stayed at 4.6%, the distribution did change a bit. As of December, three members thought year-end rates would be over 5%. Now it’s four. And back then, one member had their dot below 4%. Now the lowest is 4.5%, though we don’t know if this is the same member. Note that half the members see only two rate cuts or less. Two see no cuts and two see only one.

Even though Powell was “dovish” at his press conference, the committee is still cautious. The dots’ distribution shows the committee as a whole getting a bit more unified in the hawkish direction. That’s not surprising, given the latest inflation and other economic data.

The FOMC members make “economic projections” as well. They are enlightening not for any forecasting value, but because they tell us what the committee is thinking. Comparing it with prior forecasts also shows us the evolution of their thinking.

Here is the table summarizing their projections (click here for a larger image). The blue shaded rows are the latest guess and the white row underneath each one shows what they said in December.

Looking at the “median” section, we see the FOMC expects 2024 to end with:

• 2.1% GDP growth

• 4.0% unemployment

• 2.4% PCE headline inflation

• 2.6% PCE core inflation

Notably, their GDP projection made a big jump from 1.4% as of December while their unemployment and inflation projections didn’t change much. That suggests the committee sees little or no chance of recession this year. Remember Q4 real GDP growth was at 3.2% in the second estimate (which will be updated next week). They don’t foresee growth staying that high, but they also don’t anticipate contraction.

At the same time, those economic projections are in the context of fed funds dropping by 75 points. Their collective belief seems to be, “We can cut rates three times and it will have almost no effect on inflation or unemployment.”

When you put it that way, what’s the reason to cut? Their own projections say it won’t do anything beneficial.

The answer may be that the benefits aren’t shown in this table. Lower rates would obviously help many borrowers, not least the US Treasury, along with many leveraged businesses and consumers. Lower rates might spur some construction activity which, if it expands housing supply, would help bring down inflation.

If the FOMC members really believe what their projections imply, then as of now at least half of them are still intent on three rate cuts by year end, though of course they will state it as assuming the data doesn’t change, etc.

The election is a slight complication as they presumably won’t want to be seen as influencing the outcome. But I’m not sure that will stop them; not cutting rates—after repeatedly signaling rate cuts were coming—could also be seen as interference.

Remember the Fed’s #1 goal: Keep inflation headed downward toward their target, and certainly don’t let it rise much. The projections show they think the goal (2% in core PCE) is reachable in 2026. But they also need to not keep policy so tight as to spark recession.

Can they have it both ways? Maybe. I’m one who said a “soft landing” would be tough to pull off. Two years later, it looks a lot more plausible.

Look Who’s Coming to SIC!

We’re at an historic crossroads of converging cycles—economic shifts, geopolitical instability, societal conflicts, and technological forces—reshaping markets against the backdrop of a critical US election. It’s a perfect storm for turbulence and instability.

But despite the uncertainty, there is opportunity—SIC 2024 will highlight opportunities for growth, innovation, and resilience.

The theme of this year’s Strategic Investment Conference is “Into the Storm.” We can’t avoid it. We simply must go into it and through it. That requires planning and, like the generals who focus on logistics, successful planning requires information. Which is what this year’s SIC is all about.

Who better than Felix Zulauf to help us navigate heavy waters? Rational Optimist Lord Matt Ridley will give us a deep dive on innovation, including artificial intelligence. Seriously, I could listen to Matt for hours. His book The Evolution of Everything is one of my top five must-read books.

Leon Cooperman. Howard Marks. Who better to peer into an increasingly turbulent future? We just locked down an all-star panel of experts (whom you will not know but will want to) to tell us about dual-use technologies. Say what? Why? Because that’s where the conflicts and opportunities lie. What might be a powerful technology for business can also have military uses. Who gets it first? Is there a way to control the spread?

Click here to see some of the others who will be presenting. And unlike any other year, we have kept 3‒4 slots open for some VERY special guests we are working with. This 20^th SIC will be my best ever. You really want to join us.

DC, Cape Town, and Europe?

I plan on being in DC in mid-April for another anti-aging drug presentation. Still a few years out, this is the most promising near-term drug I have seen in 20 years of research. It seems to be actually lengthening telomeres. We are trying to get something we can present at the SIC, along with the other latest health and biotech developments.

Shane and I will be in Cape Town for a speech in early June and then somewhere in Europe.

The letter is already too long, so I will hit the send button. Have a great week. It is starting to get warm and soon will be hot and humid here in Puerto Rico after a very mild winter. The Atlantic seems to be warming up, so maybe a more “active” hurricane season awaits? A little rain in paradise may be in our future. And don’t forget to follow me on X!

Your down to 185 pounds analyst,

John Mauldin

P.S. If you like my letters, you'll love reading Over My Shoulder with serious economic analysis from my global network, at a surprisingly affordable price. Click here to learn more.

A message from Advisor Perspectives and VettaFi: To learn more about this and other topics, check out our full schedule of upcoming CE-approved virtual events.

© Mauldin Economics

Read more commentaries by Mauldin Economics