Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLM

(developer.nvidia.com)

148 points | by wondersky 2 days ago ago

83 comments