ScreenCoder: An intelligent UI-to-code generation system

(github.com)

40 points | by Dowwie 6 hours ago ago

10 comments

  • dv_dt an hour ago ago

    Lol, I have been exploring in the opposite direction. Given a set of basic CRUD endpoints for various data structures, including links to other structures. Generate a basic UI for them, with guidance on added ui to generate based on input and data oriented interaction specs.

    This is cool though, I think there are going to be an explosion of different higher level development patterns that will be useful in a lot of different situations that AI will enable. It will be interesting to see which ones get wider adoption, and which stay useful but in smaller focused niches.

  • _fat_santa 2 hours ago ago

    At my org we have been using the Figma MCP server to generate code from Figma designs. Spent about a day writing rules to keep the AI on guardrails but it's been very smooth sailing since then and any generated code needs minimal changes.

    • alooPotato an hour ago ago

      Ohh nice can you say more? Do you somehow map your Figma components to React components?

  • vivzkestrel 42 minutes ago ago

    Would be nice if it generated HTMX

  • kocial 3 hours ago ago

    Oh! What about CSS frameworks like Tailwind, Bootstrap, etc.?

    How on earth was it able to generate and clone Images just from UI? Like did it get the source of the URL as well, where it could link those images or what did it actually do there?

  • wiradikusuma 4 hours ago ago

    I guess it's good for "Dreamweaver 2.0" in the sense that it produces plain HTML. But my understanding is most serious web applications use a framework of some sort, such as React, Vue, or Svelte, and each is opinionated.

    • pzo an hour ago ago

      It's so much harder to make very accurate image to plain HTML conversion than plain HTML to react et at. LLM are very good with translating between different web frameworks.

    • jagged-chisel 3 hours ago ago

      > … most serious web applications use a framework of some sort …

      So many things wrong with this sentiment.

      Define “serious.”

      Do people think it’s just not possible to make web apps without frameworks?

      Take the output from this tool and adapt it to whatever framework you want … if you feel that’s necessary.

    • rane 3 hours ago ago

      There's this one new cool technology that could be just the thing for converting the HTML to use web framework of preference.