25 points | by bharatgel 10 hours ago ago
2 comments
Strongly agree with this approach. Real world task specific LLM query workloads tend to be long lived workflows. They should be brokered and handled rather than wait on.
Thanks, glad it resonates :)
Strongly agree with this approach. Real world task specific LLM query workloads tend to be long lived workflows. They should be brokered and handled rather than wait on.
Thanks, glad it resonates :)