vLLM Large Scale Serving: DeepSeek @ 2.2k tok/s/H200 with Wide-EP

[CommunityNews]

Introduction

Read in full here:

vLLM Large Scale Serving: DeepSeek @ 2.2k tok/s/H200 with Wide-EP