The chip designer's lead is a shortage profit; the foundry's and the toolmaker's are harder to copy
Three kinds of firm make AI chips. Designers such as NVIDIA, AMD and Broadcom draw them; a foundry (a factory that makes chips to other firms' designs), above all TSMC, prints them onto wafers (thin discs of silicon, each later cut into many chips); and toolmakers such as ASML build the machines that do the printing. Eliyahu Goldratt, a physicist who studied factories, found that a system runs at the pace of its slowest part. David Ricardo, an English economist who asked in 1817 why landlords grew rich when bread grew dear, found that the owner of the scarcest input collects a rent: profit above what it takes to keep a business going, earned because something holds rivals off. So while buyers cannot get enough chips, the designer they most want takes the rent. This site judges that as more chips arrive and the biggest buyers design their own, that rent is exposed, while the foundry and the toolmaker keep theirs for as long as no rival can match what they do.
- Getting cheap and interchangeable
- Chips made on older processes are cheap and interchangeable; TSMC's own filing says rivals in those processes are numerous. This site judges that the cost of a unit of computing keeps falling with each chip generation, and that the general-purpose AI chip is being copied from below: every large buyer that designs its own chip, often with Broadcom's help, turns part of NVIDIA's market into a price to negotiate. William Nordhaus, an economist who measured how much of the value of new inventions their makers keep as profit, found that it is a small part; most goes to buyers as lower prices and better products.
- Staying scarce
- This site judges that capacity at the newest processes, and the machines that print it, stay scarce. A new factory for the newest process takes years to build and the skill to run it takes longer. Hamilton Helmer, a strategy consultant who studied why some firms keep earning more than their investors could expect elsewhere, found that a lasting advantage is a benefit behind a barrier, and named the kinds that recur. Two apply here: process power (a way of working that takes rivals years to learn) and scale economies (unit costs that fall as volume grows, so a rival must match the volume to match the cost). The EUV machines have one maker, fed by one optics supplier: a cornered resource, Helmer's term for preferential access to something others need, which does not ease when chips do.
- What would make it last
- For the designer: its software (for NVIDIA, CUDA, the platform developers write AI code against) and its whole-rack systems with their own links between chips keep buyers even when rival chips are plentiful and cheaper, turning a shortage rent into switching costs, what a customer would lose by moving to a rival. For the foundry and the toolmaker: they keep a lead at each new process, so their scale and process power outlive the AI shortage.
- What would prove this wrong
- NVIDIA keeping both its share of AI chip supply and its gross margin while AMD's chips and the custom chips ship in volume and wafer supply at the newest processes keeps growing fast; or a second foundry making AI chips at the newest process in volume for a major designer.
- Powers here today
- a cornered resource, scale economies, process power, switching costs
- Binds on (how tight)
- AI chips (moderate), Chip foundries (moderate), Chip-making equipment (no reading; a model judges it probably moderate), Advanced chip packaging (no reading)
- The rival view
- Some link in the chip chain proves easier to expand