DeepSeek Elastic Compute (DSec)

(arxiv.org)

68 points | by shenli3514 4 hours ago ago

15 comments

  • vblanco an hour ago ago

    380.000 concurrent sandboxes on 160 Epyc based server nodes. Crazy stuff

  • doc_ick an hour ago ago

    Will admit that I haven’t read it yet, just saw the crazy number of authors and think this may compete for one of the papers with the most authors.

    • justinnk 27 minutes ago ago

      This one [0] about the Higgs boson is hard to beat. Pages 25-32 are just full of around 5150 „authors“, pages 33-37 are their affilliations.

      [0] https://arxiv.org/abs/1207.7214

      • tempay 4 minutes ago ago

        Even without that particularly special case, high-energy physics collaborations have long since broken the idea of authors. There are now many collaborations with hundreds of authors publishing regularly and quite a few that are into the thousands.

    • mendylanda 17 minutes ago ago

      how do you even keep up with the amount of research coming out these days

  • swingboy 2 hours ago ago

    Is there a lab more innovative than DeepSeek? Imagine if they had the same compute resources that Anthropic and OpenAI have.

    • ProphetOfParado 2 hours ago ago

      Food for thought: Constraints are the source of creativity.

      • conception 2 hours ago ago

        Yeah if they had the resources of an OpenAI or anthropic they’d be OpenAI or Anthropic. Scrappy underdogs have to be nimble and innovative.

        • mirekrusin an hour ago ago

          They are as “underdog” as Linux is to Windows.

      • rozim an hour ago ago

        Possibly relevant: 突破技术壁垒, "break the technical barricade" -> overcome an obstacle through innovation (in this case, sub SOTA GPUs at least).

        Native Chinese speakers to confirm....

        • michaellee8 an hour ago ago

          your translation is correct, I would say Chinese labs may be able to figure out the current capability of latest frontier models in 3-6 months, but then Anthropic and OpenAI may have already been ASI in that time already. China's main problem is still lack of (good) chips, and that is a hardware issue that is unlikely to be solved for a while. and more effort for efficiency means less effort for actual capability improvements. we have already seen what anthropic can do if they focus on efficiency with opus 5.5

    • impulser_ 2 hours ago ago

      Short term they might have less compute, but long term they will most definitely have more compute. They don't have to worry about energy, they don't have to worry about people blocking them building data centers the only thing stopping them is there no Chinese manufacturer that can produce a chip as good as Nvidia but I would bet that solved in a year or so.

    • SmartestUnknown an hour ago ago

      Just because other companies don't write papers about what they do doesn't mean they aren't innovative...

      • doc_ick an hour ago ago

        Sure, but we’ll never know what they do or if it is innovate because we won’t know what they do.

    • ijidak an hour ago ago

      "Necessity is the mother of invention."

      Not sure they'd be the same without the constraints.