11 points | by marcobambini a day ago ago
2 comments
What are the usecase that you can think of because 3.77 tok/s is actually to slow and better call a cloud API to do the task
Any well defined problem would probably be of use. How often anyone comes across these without other help is anyones guess.
What are the usecase that you can think of because 3.77 tok/s is actually to slow and better call a cloud API to do the task
Any well defined problem would probably be of use. How often anyone comes across these without other help is anyones guess.