In beginning the NVIDIA Blackwell Linux testing with the GeForce RTX 5090 compute performance, besides all the CUDA/OpenCL/OptiX benchmarks delivered last week a number of readers asked about AI performance and in particular the Llama.cpp performance with the RTX 5090 flagship graphics card. Here are some initial benchmarks looking at the GeForce RTX 5090 performance in Llama.cpp compared to prior RTX 40 and RTX 30 graphics cards.
Read in full here: