Arm Holdings has the potential to become one of the most important chip companies in AI inference.
The company's energy-efficient processor designs are already in strong demand, and its move into making its own chips could unlock a new growth opportunity.
Arm's ambitious earnings-per-share guidance for fiscal 2031 suggests this stock is poised for more upside.
Artificial intelligence (AI) has been the biggest growth driver for the stock market in recent years, as the proliferation of this technology has positively impacted multiple industries and applications.
The semiconductor industry has been one of the biggest beneficiaries of the AI boom. Chips have been deployed in massive numbers in data centers over the past few years to train AI models. But now, a significant portion of chips are used for AI inference applications. That's not surprising, as inference is the process of putting a trained AI model to work in the real world by feeding it new data so it can make decisions in real-time, generate responses, and provide recommendations.
Will AI create the world's first trillionaire? Our team just released a report on the one little-known company, called an "Indispensable Monopoly" providing the critical technology Nvidia and Intel both need. Continue »
In fact, inference is going to be bigger than the training phase. Here's why.
Image source: The Motley Fool.
While training is the first phase of teaching AI models with the help of large datasets, inference is the second phase, where the model is put to work. Not surprisingly, demand for AI inference is increasing rapidly as enterprises and consumers seek to unlock productivity gains by integrating AI into their daily operations.
McKinsey estimates that inference will overtake training and become the dominant workload in AI data centers by 2030, accounting for more than half of all AI computing power. What's more, inference workloads are poised to command 30% to 40% of total data center compute demand by the end of the decade.
There are several semiconductor stocks, such as Intel and Broadcom, that you can consider buying to capitalize on the growing AI inference demand. Both companies are developing custom AI processors designed for AI inference. Additionally, Intel's server central processing units (CPUs) are being lapped up by hyperscalers to run inference workloads.
However, British technology company Arm Holdings (NASDAQ: ARM) could be one of the biggest beneficiaries of the shift toward AI inference. Arm has traditionally designed and licensed chip architecture to semiconductor companies and original equipment manufacturers (OEMs).
The company charges customers a licensing fee and receives a royalty on the sale of each chip designed using its intellectual property (IP). Arm has a solid customer base, with the likes of Apple, Nvidia, Amazon, and others utilizing its IP to design and manufacture chips for smartphones, personal computers (PCs), and data centers.
Arm's designs are in solid demand due to their energy efficiency. This explains why flagship smartphones and custom AI processors that prioritize high energy efficiency and performance-per-watt in large-scale applications such as data centers are designed using its IP. So, it is easy to see why the likes of Google, Nvidia, Amazon, Microsoft, and Marvell Technology are designing their AI data center CPUs using Arm technology.
Counterpoint Research predicts that Arm is on track to dominate the server CPU and custom AI processor markets over the next three years, cornering 90% of this space. Importantly, Arm is now going beyond just licensing its architecture and getting royalties. The company announced in March that it is now developing its own chip -- the Arm AGI CPU -- to power agentic AI and inference workloads.
The good news for Arm investors is that its foray into manufacturing its own silicon seems to be paying off. As pointed out by Arm CEO Rene Haas on the company's latest earnings call:
Customer response to the Arm AGI CPU has been very strong. We now have more than $2 billion of customer demand across fiscal 2027 and fiscal 2028. This is more than double what we stated at launch.
That's quite impressive, considering that the AGI CPU was announced on March 24 this year. Meta Platforms is Arm's lead partner for the development of this chip, and it won't be surprising to see the British company attracting more customers. That's because Arm is promising a reduction of up to $10 billion per gigawatt in data center capital expenditure and 2x the computing performance of x86 processors from AMD and Intel.
Arm estimates that it could generate $15 billion in annual revenue from the AGI CPU after five years. That could pave the way for significant upside in its stock price.
Arm's revenue in the recently concluded fiscal 2026 (which ended on March 31) increased by 23% to $4.92 billion, driven by healthy growth in both licensing and royalty revenue. So, the potential annual revenue contribution of $15 billion from the AGI CPU business that the company anticipates in fiscal 2031 could significantly boost its top line, complementing the healthy growth that it is already witnessing.
Analysts are already expecting its top-line growth to accelerate going forward, which isn't surprising as the company expects AGI CPU to start contributing materially to its growth from fiscal 2028.

Data by YCharts
The company is likely to witness accelerating growth beyond the next three years, especially given that it expects its addressable opportunity in data center CPUs to reach at least $100 billion in fiscal 2031. What's more, Arm management estimates that its overall revenue could jump to $25 billion by fiscal 2031, with earnings per share expected to reach $9.00. That would be a major improvement over Arm's fiscal 2026 earnings of $1.77 per share.
If Arm stock trades at 35.6 times earnings after five years, in line with the tech-laden Nasdaq-100 index's earnings multiple, its stock price could reach $320 (based on the $9.00 earnings per share estimate). That points toward potential gains of 51% from current levels, suggesting that investors can still buy this AI stock in anticipation of more upside.
Before you buy stock in Arm Holdings, consider this:
The Motley Fool Stock Advisor analyst team just identified what they believe are the 10 best stocks for investors to buy now… and Arm Holdings wasn’t one of them. The 10 stocks that made the cut could produce monster returns in the coming years.
Consider when Netflix made this list on December 17, 2004... if you invested $1,000 at the time of our recommendation, you’d have $460,826!* Or when Nvidia made this list on April 15, 2005... if you invested $1,000 at the time of our recommendation, you’d have $1,345,285!*
Now, it’s worth noting Stock Advisor’s total average return is 983% — a market-crushing outperformance compared to 207% for the S&P 500. Don't miss the latest top 10 list, available with Stock Advisor, and join an investing community built by individual investors for individual investors.
See the 10 stocks »
*Stock Advisor returns as of May 12, 2026.
Harsh Chauhan has no position in any of the stocks mentioned. The Motley Fool has positions in and recommends Advanced Micro Devices, Amazon, Apple, Broadcom, Intel, Marvell Technology, Meta Platforms, Microsoft, and Nvidia. The Motley Fool has a disclosure policy.