NVIDIA's CUDA software moat deepens: 2.5x serving cost cut on GB200 NVL72 via software alone locks in hardware dominance.
CUDA software gains widen NVIDIA's moat, making AMD's ROCm-based AI inference stack increasingly uncompetitive on cost-per-token.