Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

1 comments

• $buddyholey 5 hours ago

  MLX has been an absolute gamechanger for local AI.