Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system— up to 9x increase in output lets 213 GPUs perform like 1,192

AI Forum AI In The News
, , ,
1

A paper presented at SOSP 2025 details how token-level scheduling helped one GPU serve multiple LLMs, reducing demand from 1,192 to 213 H20s.

Read in full here:

2

Probably they want to start to be less dependent on NVidia GPUs.

1 Like
3

Some companies in China is probably already building their own GPU that can rival NVidia’s.

1 Like