What are the best alternatives for template + text rendering? I need Canva-level templating ability with the system matching font dimensions, positions, and the image without background.
I ended up creating an algo using color variance and auto-sizing, an LLM to select the fonts and text and nano banana. The thing I need is nano-banana-level images with Canva+human-level abilities automated.
It would be awesome to have a free LLM that can do that. Running on a 16GB RAM Mac. I have a lot of images and templates I can train on too. Not sure if I overengineered it, would love to have just one LLM that can do everything for free.
Nice to see another locally hostable model! It’s going to take me a bit longer to add this model to the GenAI Showdown benchmark [1], since I’ll need to add a bit of customization so it produces highly optimized JSON-structured prompts.
It might be worth noting that fal.ai [2] (a fairly popular router in the generative AI space) doesn’t really mention or emphasize the JSON-structured prompt format, and seems to suggest it works just as well with natural language. It might be worth reaching out to them, at least to clarify this point and make things a bit clearer.
The model should perform better with JSON prompts than with natural language prompts. The safety filter may also be triggered incorrectly by natural language prompts, we are aware of this and will make a future checkpoint update to improve it.
I made a detailed playground notebook to run on Nvidia GPU locally and a detailed article on setup.
https://snehal.ai/ideogram4-local-playground/
What are the best alternatives for template + text rendering? I need Canva-level templating ability with the system matching font dimensions, positions, and the image without background.
I ended up creating an algo using color variance and auto-sizing, an LLM to select the fonts and text and nano banana. The thing I need is nano-banana-level images with Canva+human-level abilities automated.
It would be awesome to have a free LLM that can do that. Running on a 16GB RAM Mac. I have a lot of images and templates I can train on too. Not sure if I overengineered it, would love to have just one LLM that can do everything for free.
Nice to see another locally hostable model! It’s going to take me a bit longer to add this model to the GenAI Showdown benchmark [1], since I’ll need to add a bit of customization so it produces highly optimized JSON-structured prompts.
It might be worth noting that fal.ai [2] (a fairly popular router in the generative AI space) doesn’t really mention or emphasize the JSON-structured prompt format, and seems to suggest it works just as well with natural language. It might be worth reaching out to them, at least to clarify this point and make things a bit clearer.
[1] - https://genai-showdown.specr.net
[2] - https://fal.ai/ideogram-4
[1] Nice, let us know if you need a hand
You can call our API to generate structured json from text using this endpoint (this endpoint is free of charge, but you need a free account to create an api key): https://developer.ideogram.ai/api-reference/api-reference/ma...
[2] Fal runs the text_prompt (natural language) through the magic prompt system, so indeed results should be good there
Thank you. I will test this on a Mac mini and come back here
Will it work on Apple silicon machines? Maybe in the Draw Things application? Or is it all command line
The galery of generated images looks amazing, it's hard (but often possible) to spot inconsistencies in detailed images.
Non-commercial license, you should not call that "open-weight". Words have meaning.
And people are having a laugh at how censored the model is.
https://old.reddit.com/r/StableDiffusion/comments/1tvtu2u/id...
https://old.reddit.com/r/StableDiffusion/comments/1tvxhzv/id...
The model should perform better with JSON prompts than with natural language prompts. The safety filter may also be triggered incorrectly by natural language prompts, we are aware of this and will make a future checkpoint update to improve it.
See how to prompt the model here: https://github.com/ideogram-oss/ideogram4/blob/main/docs/pro...
Disclaimer: I work at Ideogram.
Exciting!