Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

(machinelearning.apple.com)

6 points | by vinhnx 10 hours ago ago

1 comments