Inference = IOPS: Staying Ahead Of The Curve With The Micron 9550 High Performance Ssd
Micron, Friday, June 20th, 2025
Inference will become the most common data center workload, full stop. With the NVIDIA H100 becoming ubiquitous in the data center and the NVIDIA DGX B200 launching into non-NVL72 systems, we're seeing an explosion of compute capability.
If you look at the bandwidth scaling of PCIe generations versus the increase of compute, PCIe has increased by eight times from Gen3 to Gen6 while GPU FLOPs has increased by 37.5 times in the same time frame.
We've also seen the average FLOPS of training clusters increase by 905 times over the past four years with the datapoints in training datasets increasing 2,500 times in the same time frame.