Processors for HPC and AI

Available in June, 2026

High-performance computing (HPC) and AI are increasingly converging around accelerated, heterogeneous processors with each type of processor doing what it does best. For example, the latest platforms combine CPUs with GPUs, application-specific accelerators, high-bandwidth memory and advanced interconnects. The rapid growth of AI has made accelerators the principal source of industry expansion, while scientific computing, simulation, national labs and weather forecasting continue to support demand for conventional HPC systems.  Meanwhile, the HPC and AI processor markets has become less distinct.

This report analyses both the technology and demand changes to better understand where the money will be made in the future.  It also examines the structure of this industry sector and how it might change in the future.  For now, NVIDIA is the dominant supplier of data-center AI processors, while AMD is NVIDIA’s most important merchant-market challenger. CPUs are also a factor in this market and here we note that intel remains a major supplier of server CPUs used in HPC clusters and AI infrastructure. Other influencers in the HPC/AI process space include IBM, Fujitsu, Huawei, Cerebras, Groq, Tenstorrent and SambaNova.  Strategic profiles of these companies are provided in the report covering product development, market strategy and manufacturing.

The industry structure is also being reshaped by custom silicon developed by hyperscale cloud companies. Google designs TPUs, Amazon Web Services offers Trainium and Inferentia processors, and Microsoft has developed its Maia accelerators. These companies are both major purchasers of merchant processors and potential competitors to their suppliers. We discuss the implications of this in the report as well as explaining what it means that hyperscalers generally provide their processors as part of cloud services rather than as standalone components.

Competition extends well beyond processor specifications. Success in this market increasingly depends on software tools, optimized libraries, memory capacity, chip-to-chip interconnects, networking, power efficiency and the ability to deliver complete systems at scale. The industry is also constrained by access to leading-edge semiconductor fabrication, advanced packaging and high-bandwidth memory, creating significant dependence on a small number of foundries and component manufacturers. All of this is covered in this new CIR report.

Chapter One: Introduction
1.1 Background to Report
1.2 From Vector Supercomputers to Accelerated Computing
1.3 Convergence of HPC and AI Workloads
1.4 The Rise of Heterogeneous Architectures and expected Architectural Shifts
1.5 Research Methodology
1.6 Plan of Report

Chapter Two: HPC/AI Applications and their Impact on the Chip Sector
2.1 Scientific and Academic Simulation
2.2 Data Analytics and Visualization
2.3 AI Training
2.4 AI Inference
2.5 Cloud and Hyperscale Data Centers
2.6 Enterprise AI
2.7 Automotive and Robotics
2.8 Healthcare and Life Sciences
2.9 Financial Services
2.10 Defense and Intelligence
2.11 Edge AI and Telecommunications
2.12 Geopolitical and Export-Control Risks

Chapter Three: Technologies, Products and Architectures
3.1 CPUs
3.1.1  CPUs and CPU Roadmaps: Chips for AI Servers
3.1.2 CPU–GPU processors
3.2 GPUs
3.2.1 GPUs and GPU Roadmaps for AI and HPC
3.2.2 HPC GPUs
3.3 AI Accelerators: Their Uses and Evolution
3.3.1 Merchant AI accelerators
3.3.2 Hyperscaler accelerators
3.3.3 Data Processing Units and Infrastructure Accelerators
3.4 Other processors
3.4.1 Network processors
3.4.2 Vector Processors
3.4.3 Edge-AI processors
3.4.4 HPC Processor Market
3.5 ASICs
3.5.1 The Role of ASICs including Dedicated AI ASICs
3.6  FPGAs and Reconfigurable Computing
3.6.1 Data-center FPGAs
3.9 Chiplets and Advanced Packaging
3.10 Custom hyperscaler silicon
3.11 Memories and Interconnects
3.11.1 High-Bandwidth Memory
3.11.2 Scale-Up Interconnects
3.11.3 Scale-Out Networking
3.11.4 Cache, Memory Coherence, and Data Movement
3.12 Neuromorphic and Emerging Architectures
3.13 Proprietary Processors
3.14 Benchmarks
3.14.1 HPC Benchmarks
3.14.2 AI Training and Inference Benchmarks
3.15 Critical Software
3.15.1 Programming Models and Toolchains
3.15.2 HPC Libraries and Compilers
3.15.3 Portability and Open Standards
3.16 Performance per Watt and Total Cost of Ownership

Chapter Four: Competitive Landscape: Profiles of Market Leaders and Influencers
4.1 NVIDIA
4.2 AMD
4.3 Apple
4.4 AWS
4.5 Broadcom
4.6 Cerebras Systems
4.8 Fujitsu
4.9 Groq
4.10 Google
4.11 Huawei
4.12 IBM
4.13 Intel
4.14 Marvel
4.15 Microsoft
4.16 Qualcomm
4.17 SambaNova Systems
4.18 Tenstorrent
4.19 ARM-based Processor Suppliers
4.20 Hyperscaler-designed AI Silicon
4.21 Specialist Accelerator Companies
4.22 Chinese Processor and Accelerator Vendors
4.23 Market Consolidation and New Entrants

Chapter Five: Semiconductor Manufacturing and Supply Chain
5.1 Availability, Lead Times, and Supply Agreements
5.1.1 Procurement Decision Framework
5.2 Manufacturing Roadmaps
5.3 Foundry Dependence
5.4 Advanced Packaging Capacity
5.5 High-bandwidth Memory and Substrate Constraints
5.6 Supply Chain
5.6.1 Vendor Lock-In and Migration Costs

Chapter Six: Market Forecasts (Units Sold and Market Sizing)
6.1 Forecasting Methodology:  Forecast Assumptions and Scenarios
6.2 Processor and System Pricing
6.3 Eight-year Forecast by End User Type
6.4 Eight-year Forecast by Product
6.5 Eight-year Forecast by Geographical Region: Regional Outlook
6.6 Custom Silicon Versus Merchant Processors Forecast
6.7 Forecast Analysis

Licensing Options

Price range: $2,500 through $3,500

Choose Your License:

  • Single (One User Only)
  • Group (Up To 5 Users Only)
  • Enterprise (Company Wide Access)
- +
Scroll to Top