Running Modern LLMs on a 2GB GPU

(medium.com)

6 points | by comtom 5 hours ago ago

2 comments

  • 5 hours ago ago
    [deleted]
  • MitkoStoyanov 5 hours ago ago

    I've got boxes of mismatched old parts rather than one built machine — any rule of thumb for what's worth assembling vs. what's too old to bother with for this kind of use case?