Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

(machinelearning.apple.com)

6 points | by ingve 14 hours ago ago

1 comments

  • buddyholey 14 hours ago ago

    MLX has been an absolute gamechanger for local AI.