Deep dive into Azure Maia 300 architecture

(azure.microsoft.com)

25 points | by azhenley 15 hours ago ago

4 comments

  • psyphy2 15 hours ago ago

    Interesting seeing Jalapeno and now Mia moving away from UMA to maximize NUMA

    • Tostino 14 hours ago ago

      As soon as you scale out to multiple machines, you're already thinking about non-uniform access. If you just push that down one layer further, I don't see all that much of a difference if you're already having to do the work in your software to deal with it.

  • realcul 10 hours ago ago

    they have access to OpenAI IP on Jalapeno so not sure why they are not killing it yet on these.

  • jiggawatts 11 hours ago ago

    Since Microsoft doesn’t have to pay NVIDIA’s margins for these, they’re probably getting them 2-3x cheaper.

    That five trillion dollar market cap has an expiry.