Report · 2026 edition
PreviewState of GPU Compute 2026
Where GPU-hours went over twelve quarters, how big clusters really are, and how busy rented hardware is when nobody is watching.
PDF / 38 pages / 7 chapters / no sales call
State of
GPU Compute
Rental patterns, utilisation and
the B300 effect on training
What is inside
Three years of GPU‑hours. Six charts.
61%
of GPU-hours on inference
- inference 61%
- training 31%
- batch 5%
- agents 3%
Most hours now serve users
Split of all GPU-hours in Q4 2026, by workload.
- B300
- B200
- H200
- H100
The B300 year
Share of new rentals by GPU family, each quarter of 2026.
Inference took the lead
Share of GPU-hours spent serving versus training, by quarter.
- 1 node64%
- 2–422%
- 89%
- 16+5%
Most jobs fit on one node
Share of jobs by node count.
- Batch92%
- Training87%
- Serving58%
- Agents34%
Batch keeps GPUs busiest
Median utilisation by workload type.
Pinned to a region
Where EU teams keep training data.
Contents
Seven chapters, 38 pages.
- 01p. 4
Where the GPU-hours went
Training, inference, batch and agents, quarter by quarter.
- 02p. 9
The B300 year
How fast teams moved to the newest family, and why some did not.
- 03p. 14
Inference takes the lead
The quarter serving passed training, and what changed in the bill.
- 04p. 19
How big clusters really are
Node counts per job, from single servers to 32-node runs.
- 05p. 24
Busy or idle
Measured utilisation by workload, and where the idle hours hide.
- 06p. 29
Data residency in practice
Which teams pin regions, and what they pin them for.
- 07p. 35
Methodology
Sample, time window, anonymisation and the limits of the data.
Get the full report
PDF, 38 pages. We email you the link.
Method
How the numbers are made.
- 01
Sample
Aggregated GPU-hours from the meter in every Nexpod region, grouped by workload type and GPU family.
- source
- billing meter
- unit
- GPU-hours
- regions
- all live
- 02
Window
Twelve quarters, each weighted the same, so a busy quarter does not tilt the trend lines.
- from
- Q1 2024
- to
- Q4 2026
- quarters
- 12
- 03
Anonymise
Figures are rounded, and any group too small to hide a single customer is folded into other.
- rounding
- 1%
- small groups
- folded into other
- per customer
- never shown
FAQ
About the report
Who is the report for?
Is any customer data identifiable?
Can I quote the figures?
Will there be a webinar?
Put it to work
Test the numbers yourself. One node, by the second.
Pick a server, pick a region, and connect over SSH. Stop it whenever you are done; the meter stops with it.
- B300· 288 GB HBM3e€6.00/GPU·hr
- B200· 180 GB HBM3e€5.00/GPU·hr
- H200· 141 GB HBM3e€4.00/GPU·hr
- H100· 80 GB HBM3€3.00/GPU·hr