How Fast is Computing Power Growing? The Truth Behind the Numbers

Advertisements

You hear it all the time. Computing power is exploding. AI is getting smarter by the day. Your phone is more powerful than the computers that sent men to the moon. It feels like a runaway train. But if you stop and ask, "How fast is computing power actually growing?" you get a mix of marketing claims, outdated rules of thumb, and genuine scientific debate. The simple answer—the one that matters for your investments and your understanding of the future—isn't simple at all. Growth isn't on a single, predictable track anymore. It's a multi-lane highway, and some lanes are moving much faster than others, while a few old ones are hitting serious traffic. Let's cut through the noise.

The Classic Benchmark: Moore's Law and Its Evolution

For decades, the speed question had a neat answer: Gordon Moore's 1965 observation. He predicted the number of transistors on a chip would double about every two years. For a long time, it did. This became a self-fulfilling prophecy, a roadmap for the entire semiconductor industry. Performance and efficiency rode this wave beautifully.

But here's the non-consensus part everyone glosses over: Moore's Law was always about transistor density, not directly about computing speed or performance. We got lucky for a while because smaller transistors were also faster and used less power. That luck has run into physical walls. As transistors approach the size of atoms, quantum effects and heat dissipation become monstrous problems. The cost of building the factories (fabs) to make these chips is growing exponentially, too. I've talked to engineers who say the "easy" scaling ended over a decade ago. Today, maintaining density growth requires Herculean efforts in materials science and manufacturing—it's no longer a given.

So, if we measure growth purely by transistor count doubling every two years, that pace has slowed. The interval has stretched. The industry still pushes forward, but the old, predictable rhythm is gone. Relying on this single metric to gauge computing power growth is like judging a modern car only by its engine displacement. You'll miss the whole story.

The Multi-Dimensional Engine of Modern Growth

This is where it gets interesting. While the transistor scaling lane slowed, engineers and companies blasted open new ones. Computing power growth didn't stop; it changed direction. Think of it as a shift from making a single engine more powerful to designing a whole new propulsion system.

The key insight: Raw transistor count is less important than what you do with them. The fastest growth is now in computational efficiency and specialization for specific tasks.

1. Architectural Innovation: The New Performance King

This is the biggest driver you're not hearing enough about. Companies like Apple, NVIDIA, and AMD are achieving performance leaps not by waiting for the next transistor shrink, but by redesigning the brain of the chip itself.

Apple's M-series chips are a masterclass. By moving away from Intel's generic designs and creating a "system on a chip" (SoC) with unified memory and dedicated blocks for video, AI, and image processing, they delivered a performance-per-watt jump that stunned the industry. I remember benchmarking an M1 Mac against an Intel one I owned. The difference wasn't incremental; it felt like a product from two different eras. That leap came from architecture, not just a die shrink.

2. The Specialization Surge: GPUs, TPUs, and NPUs

General-purpose CPUs are becoming the jack-of-all-trades in a world of masters. For specific workloads, specialized processors are growing in capability at a blistering, non-linear rate.

  • GPUs for AI: NVIDIA's hardware for AI training has seen performance multiply by orders of magnitude in a few years, driven by architecture (tensor cores), better software (CUDA), and stacking memory (HBM). The growth curve for this type of computing power is almost vertical.
  • Domain-Specific Chips: Google's TPUs, chips for cryptocurrency mining (historically), and modern networking chips are all examples. They do one thing exceptionally well, and their growth in that specific task dwarfs general CPU progress.

3. The Software and Algorithm Layer

This is the silent multiplier. A better algorithm can make a 10-year-old computer solve a problem faster than a new one running a brute-force approach. Machine learning frameworks like TensorFlow and PyTorch, along with compiler improvements, are constantly extracting more performance from the same silicon. Growth here is hard to quantify in GHz, but it's real and significant.

Measuring the Speed: It's Not Just About Transistors

So how do we measure this multi-faceted growth? You have to look at different benchmarks for different jobs.

Computing Domain How Growth is Measured Recent Pace (Approx.) What's Driving It
Generic CPU Performance
(e.g., Laptop/Desktop)
Single/Multi-core benchmarks (Geekbench, Cinebench) 15-25% per year (highly variable) Architecture, chiplet design, process node gains (slowing).
AI Training (NVIDIA GPUs) TFLOPS (Tensor Operations), training time on models like GPT ~2-2.5x every 2 years (exceeds old Moore's Law) Specialized cores (Tensor Cores), memory bandwidth, interconnect tech.
Supercomputing (TOP500) FLOPS (Floating Point Ops/sec) in Linpack benchmark ~2x every 1.5-2 years (historically steady) Massive parallelism, scaling of GPU clusters, interconnects.
Mobile/Edge Computing Performance-per-watt, AI task speed Leaps of 40-100%+ per generation (as seen in Apple Silicon) SoC integration, dedicated NPUs, vertical design.

Look at the TOP500 list of supercomputers. The growth in FLOPS has been remarkably steady, but that's because it's achieved by throwing more parallel processors (often GPUs) at the problem, not just making each one faster. It's a different kind of growth—broad, not deep.

The takeaway? There is no single speed. Computing power for AI tasks is growing explosively. For everyday general tasks, it's growing steadily but unspectacularly. The average is meaningless. You must look at the segment.

The Future Trajectory: What's Next for Computing Power?

The next decade will be defined by diversification and hitting new walls.

Heterogeneous Integration: Growth will come from stacking different specialized chips (CPUs, GPUs, memory) in a single package, like a high-tech lasagna. This improves speed and reduces power, but adds design complexity. Intel's Foveros and AMD's 3D V-Cache are early examples.

The Memory Wall: This is the next big bottleneck. Processors are becoming so fast that waiting for data from memory is a huge drag. Progress in memory bandwidth (like HBM) and new architectures (processing-in-memory) will be critical to sustaining growth. If this isn't solved, faster cores will just sit idle more often.

Post-Silicon Explorations: Quantum computing (for specific problems), photonic chips, and neuromorphic computing are wildcards. They won't replace silicon for general computing soon, but they represent potential new curves of growth for niche, high-value applications. Don't believe the hype that they're around the corner for your laptop, but do watch the research.

Computing Growth and Your Wallet: Investment Implications

If you're thinking about this from an investment angle (tech stocks, sector ETFs), the shifting growth dynamics are crucial. Investing in "computing power" is no longer a monolithic bet.

The mistake I see: People just buy a semiconductor ETF thinking they're betting on "tech growth." That's too blunt. You need to ask: Which kind of computing power growth am I betting on?

Betting on the Specialization Lane: This means companies leading in AI hardware (NVIDIA, AMD to a degree), designers of domain-specific chips, and firms with superior architectural skills (Apple, though it's not a pure-play). Their growth trajectory is steeper, but valuations often reflect that. The risk is technological disruption or a slowdown in AI spending.

Betting on the Foundry/Manufacturing Lane: Companies like TSMC and ASML. They enable everyone else's growth. It's a more stable, oligopolistic bet, but tied to the massive capital expenditure cycles of the industry. Growth here is solid but cyclical.

The Caution: Companies reliant solely on selling traditional, general-purpose CPUs without a compelling roadmap for AI or efficiency are in a tougher spot. Their growth lane is the slower, more congested one. They must reinvent themselves.

My approach has been to look for companies that control the entire stack—hardware, architecture, software. That integration is where they can squeeze out performance gains others can't, creating a moat. It's also why I'm wary of companies that just market "more cores" or "higher GHz" without context.

Your Questions Answered (The Real Stuff)

Is Moore's Law dead?
In its original, strict sense of predictable two-year transistor doubling, it's on life support. The economic and physical challenges are immense. But as a metaphor for exponential progress in computing, it's evolving. The spirit of Moore's Law—the expectation of rapid improvement—lives on through architectural innovation and specialization. The engine changed, but the car is still accelerating.
Should I invest in semiconductor stocks based on this growth?
Not blindly. The sector is splitting. Look for companies with exposure to the high-growth vectors: AI accelerator design, advanced packaging, and architectural leadership. A pure-play foundry like TSMC is a different bet than a design powerhouse like NVIDIA. Understand which part of the multi-lane highway the company is on. Also, be prepared for volatility—this is a cyclical industry where sentiment can swing on quarterly guidance about data center spending.
How does this affect me as a regular consumer? Will my devices keep getting faster?
Yes, but differently. You won't feel a raw speed bump every year for tasks like web browsing. The gains will be in efficiency (longer battery life), smarter features (better photos, real-time language translation powered by on-device AI), and seamless experiences. Your next phone or laptop will feel "better" more because of its specialized AI processor (NPU) than because its general CPU is 10% faster. The growth is becoming more experiential and less about a spec sheet number.
What's the biggest bottleneck everyone is ignoring?
The software and programming model. We're trying to drive these incredibly complex, heterogeneous systems with programming languages and tools built for single, general-purpose CPUs. Writing software that fully exploits a modern chip with CPU, GPU, and NPU cores is brutally difficult. The gap between hardware potential and realized performance is widening. Companies that can bridge this gap with superior software (again, NVIDIA's CUDA is the prime example) have a massive advantage. The bottleneck isn't just physics; it's human ingenuity in code.

So, how fast is computing power growing? It depends. The age of one simple answer is over. We're in an era of divergent growth curves. For AI and specialized tasks, it's breathtakingly fast, driven by new silicon architectures. For general-purpose computing, it's modest and increasingly focused on efficiency. This complexity is what makes the field both challenging and endlessly fascinating. It also means that understanding these nuances is the key to making smart decisions, whether you're building a product, planning a strategy, or deciding where to invest your money. Ignore the headline hype. Look at the benchmarks that matter for the task at hand. That's where you'll find the real speed.

post your comment