Show HN: Self hosting a modern LLM stack

(github.com)

5 points | by sleepynoodle 10 hours ago ago

1 comments

  • mateenah 10 hours ago ago

    Have you tried running really large models with this? And how are you managing allocating resources ?