2 comments

  • dsemakin 7 hours ago ago

    Does it work also on multi modal LLMs?

    • ritenv 3 hours ago ago

      It does work partially. TokenSift can analyze the textual parts of prompts sent to multimodal models, but doesn’t calculate or optimize image/audio/video token usage. Non-text payload calculation is something I’d like to add.