2 comments

  • awsanswers 6 hours ago ago

    Strongly agree with this approach. Real world task specific LLM query workloads tend to be long lived workflows. They should be brokered and handled rather than wait on.

    • bharatgel 5 hours ago ago

      Thanks, glad it resonates :)