Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

(machinelearning.apple.com)

7 points | by vinhnx 18 hours ago ago

1 comments

  • TheAtomic 18 hours ago ago

    The coordination with Meta is painfully obvious, and telling. I feel like my trust in Apple (formerly 9/10) is now 6/10, by collaborating with Meta (0/10). It has been a process: before ads, 7/10; before Cook at Trump dinners, 8/10; before "Apple Intelligence," 9/10...it dwindles so quickly even Cory Doctorow would be impressed.