Can Custom AI Chips Challenge NVIDIA?

Advertisements

  • March 21, 2025

As competitors like AMD strive to catch up with NVIDIA in the fiercely competitive GPU market, one company has emerged as a noteworthy alternative by focusing on customized AI chipsBroadcom, a major player in the semiconductor industry, recently attracted significant attention after its astounding earnings report caused its stock price to skyrocketWithin two trading days, shares surged by 24% and 8%, respectively, leading the company to surpass a market valuation of $1 trillion for the first time, officially becoming the ninth company globally to achieve this milestone, with a current value of approximately $1.17 trillion.

Unlike NVIDIA and Intel, which primarily produce computing chips, Broadcom focuses on chips used for networking and connectivityThe company currently holds the title of the world's largest manufacturer of networking chips, producing a range of products including Ethernet switches, routers, wireless communication devices, Bluetooth, and Wi-Fi components

Virtually every internet connection around the globe will pass through at least one Broadcom chip, highlighting the company's pivotal role in the modern digital landscape.

The earnings report for Broadcom's fiscal year 2024 revealed impressive figures, with total revenue reaching $51.6 billion, indicating a remarkable year-on-year growth of 51%. Broadcom's main business segments encompass semiconductors and software, with the latest surge primarily credited to its acquisition of VMware, a virtualization software company, which significantly bolstered its software divisionThis segment alone generated $21.5 billion, accounting for nearly half of Broadcom's total revenue and achieving an incredible increase of 196% from the previous year.

On the semiconductor side, Broadcom's total income reached $30.1 billion for the fiscal year, reflecting a 7% increase year-on-yearHowever, what stands out even more than just the numerical growth is the ambitious development outlook for the company's semiconductor segment.

Broadcom's semiconductor division primarily comprises networking chips and custom ASIC (Application Specific Integrated Circuit) chips

Both categories are reaping the rewards of the generative AI boom, with AI-related business, encompassing networking chips and ASICs, soaring to $12.2 billion, an impressive 220% increase from the previous yearThis growth has been a critical factor in setting record highs for the semiconductor business.

Before the market began to wonder whether Broadcom could rival NVIDIA, the two companies worked closely togetherBroadcom's Ethernet switch chips are essential for transmitting data at high speeds, especially when building server clusters in large data centersSince the launch of ChatGPT at the end of 2022, tech companies have been in a buying frenzy for NVIDIA GPUs to support AI model training, resulting in the construction of larger server clusters utilizing ever-increasing GPU resourcesBoth Broadcom and NVIDIA have benefited from this AI-driven surge, with their stock prices reflecting the positive impact of this trend.

The market's curiosity around Broadcom's potential to challenge NVIDIA primarily revolves around its ASIC custom chip business

Unlike general-purpose chips such as CPUs and GPUs, ASICs are designed for specific applications or tasks, allowing for customized performance in terms of power consumption and sizeDuring the Bitcoin mining boom, the specialized mining chip is a prime example of ASIC application.

Broadcom produces ASIC chips mainly in collaboration with cloud computing companies to create proprietary "AI XPUs" that work alongside NVIDIA GPUsThe initial wave of demand for AI capabilities has largely stemmed from cloud giants like Amazon and MicrosoftThese companies have become significant customers for AI chips, with NVIDIA's GPUs dominating the market, holding approximately 90% of the shareAs the need for servers in data centers expands, dependence on NVIDIA GPUs grows stronger, which diminishes other cloud vendors' bargaining powerFurthermore, because NVIDIA has established itself as the industry standard for both software and hardware ecosystems, clients struggle to design products according to their specific requirements

alefox

To counter this, major players like Microsoft, Amazon, Google, and OpenAI are now planning to invest in developing their chips to reduce their reliance on NVIDIA.

Broadcom stands as a key participant in this competitive arenaThe company has partnered with Google to develop TPU AI accelerator chips while also engaging in the AI chip development endeavors of Meta and AppleRecent reports indicate that ByteDance is also collaborating with Broadcom to create customized ASIC AI chips.

During a recent fiscal earnings call, Broadcom's CEO Hock Tan discussed prospective developments in its ASIC chip sector over the next three yearsHe revealed that three major clients are crafting multiple generations of AI XPU roadmaps, with an anticipated large-scale supply of 3nm XPU chips expected to begin in the second half of 2025. By 2027, the collective market demand from these three clients is projected to reach between $60 billion and $90 billion, with Broadcom positioned to take a significant slice of that market.

The outlook for ASIC chips to become genuine competitors to NVIDIA relies significantly on their integration with cloud providers’ self-developed chip initiatives to position themselves as a viable "alternative" to GPUs

Ji Yu, founder of the startup Xinyun Integrated, expressed concerns in a recent interview about the dominance of NVIDIA GPUs in AI model training and inference scenariosHe emphasized that it would be challenging for competitors to unseat NVIDIA due to its superior performanceAdditionally, given NVIDIA's premium pricing, bulk purchases can constitute a hefty capital expense for most companiesHence, out of cost control needs and to enhance their negotiating power, customers are motivated to identify alternatives to lessen their dependence on NVIDIA.

Recent analysis from Morgan Stanley offers a balanced perspective, suggesting that the rise of ASIC technology does not necessarily spell doom for GPUsInstead, the report posits that ASICs will complement GPUs, leading to a long-term coexistence that will provide optimal solutions for varying requirements, with the AI ASIC market expected to grow from $12 billion in 2024 to $30 billion by 2027, reflecting a robust compound annual growth rate of 34%.

However, compared to GPUs, ASIC chips possess inherent technological limitations that may hinder the expansion of their market share

Comments (15 Comments)

Leave A Comment