46 comments

  • threecheese 17 hours ago ago

    Looks like Google has packaged dotprompt into a Python library, might allow you to make the codebase leaner: https://github.com/google/dotprompt/tree/main/python/dotprom...

    I think you mentioned elsewhere that you dont want to have a lot of dependencies, but as the format evolves using the reference impl will allow you to work on real features.

    • chr15m 9 hours ago ago

      Will have a look at this. That could be the way to go. Thanks.

  • Barathkanna a day ago ago

    This is really clever. Dotprompt as a thin, pipe-friendly layer around LLMs feels way more ergonomic than spinning up a whole agent stack. The single-file + stdlib approach is a nice touch too. How robust is the JSON schema enforcement when chaining multiple steps?

    • chr15m a day ago ago

      If the LLM returns invalid schema the next link in the chain will send that through since it defaults to string input if the JSON doesn't parse. Maybe I should make it error out in that situation.

      • anonym29 a day ago ago

        Is including a json schema validator and running the output through the validator against the input prompt, such that you can detect when the output doesn't match the schema, and optionally retry until it does match (possibly with a max number of attempts before it throws an error) too complex of an idea for the target implementation concept you were envisioning?

        It certainly doesn't intuitively sound like it matches the "Do one thing" part of the Unix philosophy, but it does seem to match the "and do it well" part.

        That said, I can totally understand a counterargument which proposes that schema validation and processing logic should be something else that someone desiring reliability pipes the output into.

        • chr15m 9 hours ago ago

          I'm not sure. I think I need to use it more to see what the LLMs do with bad data. The design you're suggesting might be the answer though.

  • cootsnuck 2 days ago ago

    This is pretty cool. I like using snippets to run little scripts I have in the terminal (I use Alfred a lot on macOS). And right now I just manually do LLM requests in the scripts if needed, but I'd actually rather have a small library of prompts and then be able to pipe inputs and outputs between different scripts. This seems pretty perfect for that.

    I wasn't aware of the whole ".prompt" format, but it makes a lot of sense.

    Very neat. These are the kinds of tools I love to see. Functional and useful, not trying to be "the next big thing".

  • dymk 2 days ago ago

    Can the base URL be overridden so I can point it at eg Ollama or any other OpenAI compatible endpoint? I’d love to use this with local LLMs, for the speed and privacy boost.

    • chr15m an hour ago ago

      I've implemented this now. You can set it with BASE_URL or OPENAI_BASE_URL which seems to vaguely be the standard. I also plan to use this with local LLMs. Thanks for the suggestion!

    • jedbrooke 2 days ago ago

      https://github.com/chr15m/runprompt/blob/main/runprompt#L9

      seems like it would be, just swap the openai url here or add a new one

    • chr15m 2 days ago ago

      Good idea. Will figure out a way to do this.

      • khimaros 2 days ago ago

        simple solution: honor OPENAI_API_BASE env var

      • benatkin 2 days ago ago

        Perhaps instead of writing an llm abstraction layer, you could use a lightweight one, such as @simonw's llm.

        • chr15m a day ago ago

          I don't want to introduce a dependency. Simon's tool is great but I don't like the way it stores template state. I want my state in a file in my working folder.

          • threecheese 18 hours ago ago

            Can you explain this decision a bit more? I’m using ‘llm’ and I find your project interesting.

            • chr15m an hour ago ago

              llm stores data (prompts, responses, chats, fragments, aliases, attachment metadta) in a central sqlite database outside the working directory, and you have to use the tool to view and manipulate that data. I prefer a tool like this to default to storing things in a file or files in the project directory I'm working in, in a way that is legible e.g. plain text files. Contrast with e.g. git where everything goes into .git.

              Functions require you to specify them on the command line every time they're invoked. I would prefer a tool like this to default to reading the functions from a hierarchy where it reads e.g. .llm-functions in the current folder, then ~/.config/llm-functions or something like that.

              In general I found myself baffled when trying to figure out where and how to configure things. That's probably me being impatient but I have found other tools to have more straightforward setup and less indirection.

              Basically I like things to be less centralized, magic, and less controlled by the tool.

              Another thing, which is not the fault of llm at all, is I find Python based tools annoying to install. I have to remember the env where I set them up. Contrast with a golang application which is generally a single file I can put in ~/bin. That's the reason I don't want to introduce a dep to runprompt if I can avoid it.

              The final thing that I found frustrating was the name 'llm' which makes it difficult to conduct searches as it is the generic name for what the thing is.

              It is an amazing piece of engineering and I am a huge fan of simonw's work, but I don't use llm much for these reasons.

  • tomComb 2 days ago ago

    Everything seems to be about agents. Glad to see a post about enabling simple workflows!

  • oddrationale 2 days ago ago

    Interesting! Seems there is a very similar format by Microsoft called `.prompty`. Maybe I'll work on a PR to support either `.prompt` or `.prompty` files.

    https://microsoft.github.io/promptflow/how-to-guides/develop...

    • chr15m 2 days ago ago

      Oh interesting. Will investigate, thanks!

  • meander_water a day ago ago

    This is really cool and interesting timing, as I created something similar recently - https://github.com/julio-mcdulio/pmp

    I've been using mlflow to store my prompts, but wanted something lightweight on the cli to version and manage prompts. I setup pmp so you can have different storage backends (file, sqlite, mlflow etc.).

    I wasn't aware of dotprompt, I might build that in too.

  • gessha 2 days ago ago

    Just like Linus being content with other people working on solutions to common problems, I’m so happy that you made this! I’ve had this idea for a long time but haven’t had the time to work on it.

  • __MatrixMan__ 2 days ago ago

    It would be cool if there were some cache (invalidated by hand, potentially distributed across many users) so we could get consistent results while iterating on the later stages of the pipeline.

    • stephenlf 2 days ago ago

      That’s a great idea. Store inputs/outputs in XDG_CACHE_DIR/runprompt.sqlite

    • chr15m 2 days ago ago

      Do you mean you want responses cached to e.g. a file based on the inputs?

      • __MatrixMan__ a day ago ago

        Yeah, if it's a novel prompt, by all means send it to the model, but if its the same prompt as 30s ago, just immediately give me the same response I got 30s ago.

        That's typically how we expect bash pipelines to work, right?

        • chr15m 9 hours ago ago

          Bash pipelines don't do any caching and will execute fresh each time, but I understand your idea and why a cache is useful when iterating on the command line. I'll implement it. Thanks!

    • dymk a day ago ago

      “tee” where you want to intercept and cat that file into later stages?

      • __MatrixMan__ a day ago ago

        Yeah sure but it breaks the flow that makes bash pipelines so fun:

        - arrow up

        - append a stage to the pipeline

        - repeat until output is as desired

        If you're gonna write to some named location and later read from it you're drifting towards a different mode of usage where you might as well write a python script.

  • cedws 2 days ago ago

    Can it be made to be directly executable with a shebang line?

    • leobuskin a day ago ago

      /usr/local/bin/promptrun

        #!/bin/bash
        file="$1"
        model=$(sed -n '2p' "$file" | sed 's/^# \*//')
        prompt=$(tail -n +3 "$file")
        curl -s https://api.anthropic.com/v1/messages \
          -H "x-api-key: $ANTHROPIC_API_KEY" \
          -H "content-type: application/json" \
          -H "anthropic-version: 2023-06-01" \
          -d "{
            \"model\": \"$model\",
            \"max_tokens\": 1024,
            \"messages\": [{\"role\": \"user\", \"content\": $(echo "$prompt" | jq -Rs .)}]
          }" | jq -r '.content[0].text'
      
      
      hello.prompt

        #!/usr/local/bin/promptrun
        # claude-sonnet-4-20250514
      
        Write a haiku about terminal commands.
    • chr15m 9 hours ago ago

      I added this and you can now make .prompt files with a runprompt shebang.

      #/usr/bin/env runprompt

    • _joel 2 days ago ago

      it already has one - https://github.com/chr15m/runprompt/blob/main/runprompt#L1

      If you curl/wget a script, you still need to chmod +x it. Git doesn't have this issue as it retains the file metadata.

      • vidarh 2 days ago ago

        I'm assuming the intent was to as if the *.prompt files could have a shebang line.

           #!/bin/env runprompt
           ---
           .frontmatter...
           ---
           
           The prompt.
        
        Would be a lot nicer, as then you can just +x the prompt file itself.
    • chr15m 2 days ago ago

      That's on my TODO list for tomorrow, thanks!

  • stephenlf 2 days ago ago

    Seeing lots of good ideas in this thread. I am taking the liberty of adding them as GH issues

  • stephenlf 2 days ago ago

    Fun! I love the idea of throwing LLM calls in a bash pipe

  • journal 2 days ago ago

    i literally vibe coded a tool like this. it supports image in, audio out, and archiving.

    • chr15m a day ago ago

      Cool, I'm going to add file modalities too. Thanks for the validation!

  • ltbarcly3 2 days ago ago

    Ooof, I guess vibecoding is only as good as the vibecoder.

  • orliesaurus 2 days ago ago

    Why this over md files I already make and can be read by any agent CLI ( Claude, Gemini, codex, etc)?

    • chr15m a day ago ago

      Less typing. More control over chaining prompts together. Reproducibility. Running different prompts on different providers and models. Easy to install and runs everywhere. Inserts into scripting workflows simply. 12 factor env config.

    • jsdwarf 2 days ago ago

      Claude.md is an input to claude code which requires a monthly plan subscription north of 15€ / month. Same applies to Gemini.md, unless you are ok that they use your prompts for training Gemini. The python script works with a pay per use api key.

    • garfij 2 days ago ago

      Do your markdown files have frontmatter configuration?

  • swah 2 days ago ago

    Thats pretty good, now lets see simonw's one...