125 comments

  • lxe 2 days ago ago

    I built something similar for Linux (yapyap — push-to-talk with whisper.cpp). The "local is too slow" argument doesn't hold up anymore if you have any GPU at all. whisper large-v3-turbo with CUDA on an RTX card transcribes a full paragraph in under a second. Even on CPU, parakeet is near-instant for short utterances.The "deep context" feature is clever, but screenshotting and sending to a cloud LLM feels like massive overkill for fixing name spelling. The accessibility API approach someone mentioned upthread is the right call — grab the focused field's content, nearby labels, window title. That's a tiny text prompt a 3B local model handles in milliseconds. No screenshots, no cloud, no latency.The real question with Groq-dependent tools: what happens when the free tier goes away? We've seen this movie before. Building on local models is slower today but doesn't have a rug-pull failure mode.

    • wolvoleo a day ago ago

      Yeah local works really fine. I tried this other tool: https://github.com/KoljaB/RealtimeVoiceChat which allows you to live chat with a (local) LLM. With local whisper and local LLM (8b llama in my case) it works phenomenally and it responds so quickly that it feels like it's interrupting me.

      Too bad that tool no longer seems to be developed. Looking for something similar. But it's really nice to see what's possible with local models.

    • Wowfunhappy a day ago ago

      > The "local is too slow" argument doesn't hold up anymore if you have any GPU at all.

      By "any GPU" you mean a physical, dedicated GPU card, right?

      That's not a small requirement, especially on Macs.

      • arach a day ago ago

        My M1 16GB Mini and M2 16GB Air both deliver insane local transcription performance without eating up much memory - I think the M line + Parakeet delivers insane local performance and you get privacy for free

        • ghrl a day ago ago

          Yeah, that model is amazing. It even runs reasonably well on my mid-range Android phone with this quite simple but very useful application, as long as you don't speak for too long or interrupt yourself for transcribing every once in a while. I do have handy.computer on my Mac too.

          https://news.ycombinator.com/item?id=46640855

          I find the model works surprisingly well and in my opinion surpasses all other models I've tried. Finally a model that can mostly understand my not-so-perfect English and handle language switching mid sentence (compare that to Gemini's voice input, which is literally THE WORST, always trying to transcribe in the wrong language and even if the language is correct produces the uttermost crap imaginable).

          • arach a day ago ago

            Ack for dictations but Gemini voice is fun for interactive voice experiments -> https://hud.arach.dev/ honestly blown away by how much Gemini could assist with with basically no dev effort

      • grosswait a day ago ago

        No. Give it a try I think you’ll be surprised

    • h3lp a day ago ago

      FWIW whisper.cpp with the default model works at 6x realtime transcription speed on my four-core ~2.4GHz laptop, and doesn't really stress CPU or memory. This is for batch transcribing podcasts.

      The downside is that couldn't get it to segment for different speakers. The concensus seemed to be to use a separate tool.

    • BatteryMountain a day ago ago

      I also built one.. mine is called whispy. I use mine to pump commands to claude. So far a bit hit & miss, still tweaking it.

      • nitroedge 12 hours ago ago

        Handy for me has worked wonders

    • wazoox a day ago ago

      I've installed murmure on my 2013 Mac, and it works through 1073 words/minute. I don't know about you, but that's plenty faster than me :D

  • digitalbase 2 days ago ago

    Was searching for this this morning and settled on https://handy.computer/

    • d4rkp4ttern 2 days ago ago

      Big fan of handy and it’s cross platform as well. Parakeet V3 gives the best experience with very fast and accurate-enough transcriptions when talking to AIs that can read between the lines. It does have stuttering issues though. My primary use of these is when talking to coding agents.

      But a few weeks ago someone on HN pointed me to Hex, which also supports Parakeet-V3 , and incredibly enough, is even faster than Handy because it’s a native MacOS-only app that leverages CoreML/Neural Engine for extremely quick transcriptions. Long ramblings transcribed in under a second!

      It’s now my favorite fully local STT for MacOS:

      https://github.com/kitlangton/Hex

    • zachlatta 2 days ago ago

      I just learned about Handy in this thread and it looks great!

      I think the biggest difference between FreeFlow and Handy is that FreeFlow implements what Monologue calls "deep context", where it post-processes the raw transcription with context from your currently open window.

      This fixes misspelled names if you're replying to an email / makes sure technical terms are spelled right / etc.

      The original hope for FreeFlow was for it to use all local models like Handy does, but with the post-processing step the pipeline took 5-10 seconds instead of <1 second with Groq.

      • sipjca 2 days ago ago

        There's an open PR in the repo which will be merged which adds this support. Post processing is an optional feature if you want to use it, and when using it, end to end latency can still be under 3 seconds easily

        • zachlatta 2 days ago ago

          That’s awesome! The specific thing that was causing the long latency was the image LLM call to describe the current context. I’m not sure if you’ve tested Handy’s post-processing with images or if there’s a technique to get image calls to be faster locally.

          Thank you for making Handy! It looks amazing and I wish I found it before making FreeFlow.

      • lemming 2 days ago ago

        Could you go into a little more detail about the deep context - what does it grab, and which model is used to process it? Are you also using a groq model for the transcription?

        • zachlatta 2 days ago ago

          It takes a screenshot of the current window and sends it to Llama in Groq asking it to describe what you’re doing and pull out any key info like names with spelling.

          You can go to Settings > Run Logs in FreeFlow to see the full pipeline ran on each request with the exact prompt and LLM response to see exactly what is sent / returned.

      • k9294 a day ago ago

        You can try ottex for this use case - it has both context capture (app screenshots), native LLMs support, meaning it can send audio AND screenshot directly to gemini 3 flash to produce the bespoke result.

      • stavros 2 days ago ago

        As a very happy Handy user, it doesn't do that indeed. It will be interesting to see if it works better, I'll give FreeFlow a shot, thanks!

    • jimmySixDOF a day ago ago

      I didn't try Handy but been using Whisper-Key its super simple get out of your way all local single file executable (portable so zero install too) -- thats for Windows idk about the Mac version

      [1] https://github.com/PinW/whisper-key-local

      • hackernewds a day ago ago

        the astroturfing here off topic of op post is unbearable

    • odiroot a day ago ago

      Not sure if it's just me but Handy crashes on my Arch setup. Never mind which version I run. Could be something with Wayland or Pipewire but didn't see anything obvious in the logs.

      • arach a day ago ago

        https://github.com/goodroot/hyprwhspr have you tried this? I have a nice 64GB new linux machine waiting to be set up for me to kick the tires on this

        pretty sure it's awesome - sorry OP about mentioning another project, we're all learning here :)

        • odiroot 20 hours ago ago

          Thanks, will take a look.

    • arach a day ago ago

      Handy's great! I find the latency to be just a bit too much for my taste. Like half the people on this thread, built my own but with a bit more emphasis on speed

      https://usetalkie.com

    • gurjeet 2 days ago ago

      Thanks for the recommendation! I picked the smallest model (Moonshine Base @ 58MB), and it works great for transcribing English.

      Surprisingly, it produced a better output (at least I liked its version) than the recommended but heavy model (Parakeet V3 @ 478 MB).

      • sipjca 2 days ago ago

        Great feedback :) also support for the v2 versions of the moonshine models should be out today!

    • vogtb 2 days ago ago

      Handy rocks. I recently had minor surgery on my shoulder that required me to be in a sling for about a month, and I thought I'd give Handy a try for dictating notes and so on. It works phenomenally well for most text-to-speech use cases - homonyms included.

    • hendersoon 2 days ago ago

      Yes, I also use Handy. It supports local transcription via Nvidia Parakeet TDT2, which is extremely fast and accurate. I also use gemini 2.5 flash lite for post-processing via the free AI studio API (post-processing is optional and can also use a locally-hosted LM).

    • irrationalfab 2 days ago ago

      Handy is genuinely great and it supports Parakeet V3. It’s starting to change how I "type" on my computer.

    • smcleod 2 days ago ago

      Handy is nothing short of fantastic, really brilliant when combined with Parakeet v2!

    • stavros 2 days ago ago

      I use handy as well, and love it.

  • p0w3n3d 2 days ago ago

    There's also an offline-running software called VoiceInk for macos. No need for groq or external AI.

    https://github.com/Beingpax/VoiceInk

    • parhamn 2 days ago ago

      +1, my experience improved quite a bit when I switched to the parakeet model, they should definitely use that as the default.

    • jiehong a day ago ago

      I used to use VoiceInk, but I found Spokenly [0] to be easier to use for post-processing the output, and more stable overall (local version with Parakeet or whisper is free).

      [0]: https://spokenly.app/

    • james2doyle a day ago ago

      Haven’t seen this one, but I settled on this offline-running one: https://github.com/hoomanaskari/mac-dictate-anywhere

    • sahildeepreel a day ago ago

      came to recommend voiceink too: https://tryvoiceink.com/

      just bought the one-time licence. this is the future of AI pricing - local models and one-time fee.

    • arach a day ago ago

      https://usetalkie.com - Parakeet and incredibly fast and made for devs

    • zackify 2 days ago ago

      My favorite too. I use the parakeet model

  • sathish316 2 days ago ago

    To build your own STT (speech-to-text) with a local model and and modify it, just ask Claude code to build it for you with this workflow.

    F12 -> sox for recording -> temp.wav -> faster-whisper -> pbcopy -> notify-send to know what’s happening

    https://github.com/sathish316/soupawhisper

    I found a Linux version with a similar workflow and forked it to build the Mac version. It look less than 15 mins to ask Claude to modify it as per my needs.

    F12 Press → arecord (ALSA) → temp.wav → faster-whisper → xclip + xdotool

    https://github.com/ksred/soupawhisper

    Thanks to faster-whisper and local models using quantization, I use it in all places where I was previously using Superwhisper in Docs, Terminal etc.

    • archb a day ago ago

      Yeah, it's really that simple. I have tried various applications as well and keep coming back to my custom script because when a new voice model drops on HuggingFace it becomes possible to customize it immediately - rather than wait for that application developer to support that new model.

  • vesterde 2 days ago ago

    Since many are asking about apps with simillar capabilities I’m very happy with MacWhisper. Has Parakeet, near instant transcription of my lengthy monologues. All local.

    Edit: Ah but Parakeet I think isn’t available for free. But very worthwhile single purchase app nonetheless!

    • SOLAR_FIELDS 2 days ago ago

      I actually got MacWhisper originally for speech to text so I could talk to my machine like a crazy person. I realized I didn't like doing that but the actual killer feature for buying it that I really enjoy is the fully local transcription of meetings, with a nice little button to start recording that pops up when you launch zoom, teams, etc. It means I can safely record meetings and encrypt them locally and keep internal notes without handing off all of that to some nebulous cloud platform.

      I had previously used Hyprnote to record meetings in this way - and indeed I still use that as a backup, it's a great free option - but the meeting prompting to record and better transcription offered by Macwhisper is a much better experience.

      • arach a day ago ago

        I initially built Talkie to talk to it like a crazy person when I was on long runs and ideas would pop into my head haha

        Been a power user of SuperWhisper and Wispr Flow for a long time and eventually decided to unify those flows - memos & dictations, everything is a file and local first, BYOK

  • kombinar 2 days ago ago

    Sounds like there's plenty of interest in those kind of tools. I'm not a huge fun API transcriptions given great local models.

    I build https://github.com/bwarzecha/Axii to keep EVERYTHING locally and be fully open source - can be easily used at any company. No data send anywhere.

  • dkhenry a day ago ago

    Just Text to speech seems like its largely solved on pretty much every compute platform. However I have found a huge gap going from independent words being transcribed, to formatted text ready for an editor, or further processing.

    If you look at how authors dictate they works ( which they have done for millennia), just getting the words written down is only the first step, and its by far the easiest. I have been helping build a tool https://bookscribe.ai that not only does the transcription, but then can post process it to make it actually usable for longer form content.

    • pegasus a day ago ago

      Aqua Voice does (at least some of) that as well.

  • strokirk a day ago ago

    Does any of these solutions work reliably for non-English languages? I’ve had a lot of issues trying to transcribe Swedish with all the products I’ve used so far.

  • threekindwords 2 days ago ago

    i've used macwhisper (paid), superwhisper (paid), and handy (free) but now prefer hex (free):

    https://github.com/kitlangton/Hex

    for me it strikes the balance of good, fast, and cheap for everyday transcription. macwhisper is overkill, superwhisper too clever, and handy too buggy. hex fits just right for me (so far)

    • shostack 2 days ago ago

      Tried to use it, installed, enabled permissions, downloaded the parakeet model for English and then it crashed every time I released the button after dictating. Completely unusable.

  • rabf 2 days ago ago

    https://github.com/rabfulton/Auriscribe

    My take for X11 Linux systems. Small and low dependency except for the model download.

  • k9294 a day ago ago

    I'm building in the same space, Workin on https://ottex.ai - It's a free STT app, with local models and BYOK support (OpenRouter, Groq, Mistral, and more).

    The top feature is the per-app custom settings - you can peak different models and instructions for different apps and websites.

    - I use the Parakeet fast model when working with Claude Code (VS Code app). - And I use a smart one when I draft notes in Obsidian. I have a prompt to clean up my rambling and format the result with proper Markdown, very convenient.

    One more cool thing is that it allows me to use LLMs with audio input modalities directly (not as text post-processing). e.g. It sends the audio to Gemini and prompts it to transcribe, format, etc., in one run. I find it a bit slow to work with CC, but it is the absolute best model in terms of accuracy, understanding, and formatting. It is the only model I trust to understand what I meant and produce the correct result, even when I use multiple languages, tech terms, etc.

  • drooby 2 days ago ago

    I just vibe coded a my own NaturalReader replacement. The subscription was $110/year... and I just canceled it.

    Chatterbox TTS (from Resemble AI) does the voice generation, WhisperX gives word-level timestamps so you can click any word to jump, and FastAPI ties it all together with SSE streaming so audio starts playing before the whole thing is done generating.

    There's a ~5s buffer up front while the first chunk generates, but after that each chunk streams in faster than realtime. So playback rarely stalls.

    It took about 4 hours today... wild.

    • bawana a day ago ago

      do you have a github?

  • Fidelix 2 days ago ago

    MacOS only. May this help you skip a click.

  • knob 2 days ago ago

    This thread is a beautiful intro into our near future. Yet more and more custom coded software. Takes me back to the days of late 90s. Loving this!

  • muratsu 2 days ago ago

    For those using something like this daily, what key combinations do you use to record and cancel. I’m using my capslock right now but was curious about others

    • qingcharles 2 days ago ago

      Someone told me the other day I should use a foot pedal, and then I remembered I already had an Elgato one under my desk connected with my Stream Deck. I got it very cheap used on eBay. So, that's an option too.

    • Doman 2 days ago ago

      Scroll Lock is really good key for that in my opinion. If your keyboard does not have it exposed then you can use some remapping program like https://github.com/jtroo/kanata

    • michaelbuckbee 2 days ago ago

      I have a Stream Deck and made a dedicated button for this. So I tap the button speak and then tap it again and it pastes into wherever my cursor was at.

      And then I set the button right below that as the enter key so it feels mostly handsoff the keyboard.

    • atestu 2 days ago ago

      Right option. Push to talk

      • tacotime 2 days ago ago

        I also use the right option key on Mac, never miss it.

    • adanto6840 2 days ago ago

      Great question. I'd love to know if anyone has had any success with handheld buttons/bluetooth remotes or similar, too.

    • Brajeshwar 2 days ago ago

      Can you please teach me how to use the CAPS LOCK key as a push-to-talk?

  • paweladamczuk a day ago ago

    I also vibe coded my own version of this. Funny to see how many people did that.

    https://github.com/PawelAdamczuk/blah

    Mine was only tested on an Arc GPU (the acceleration works nicely through Vulkan). It hooks into Win32 API and simulates key presses so it works in various non-obvious contexts.

  • stranded22 a day ago ago

    looks good although Mistral Voxtral would be a good choice, wouldn't it?

    https://mistral.ai/news/voxtral-transcribe-2

  • vittore 2 days ago ago

    For macos i found https://github.com/rselbach/jabber and was lately use that, but the iOS where I still need replacement.

  • seyz a day ago ago

    The moat here is local inference. Whisper.cpp + Metal gives you <500ms latency on M1 with the small model. no API costs + no privacy concerns. Ship that and you've got something the paid tools can't match. The UI is already solid, the edge is in going fully offline.

  • zuInnp a day ago ago

    I am a huge fan of OpenSuperWhisper (https://github.com/Starmel/OpenSuperWhisper). Works local and is more than enough for me.

  • spelk 2 days ago ago

    Does anyone know of an effective alternative for Android?

    • windthrown a day ago ago

      I installed Whisper+ through FDroid and it works well for my basic needs. Only 30s at a time but you can append multiple recordings to the same transcript: https://github.com/woheller69/whisperIMEplus

    • jskherman 2 days ago ago

      Check out the FUTO keyboard or FUTO voice input apps. It only uses the whisper models though so far.

    • uncharted9 2 days ago ago

      I have been using VoiceFlow. It works incredibly well and uses Groq to transcribe using the Whisper V3 Turbo model. You can also use it in an offline scenario with an on-device model, but I am mostly connected to the internet whenever I am transcribing.

    • xnx 2 days ago ago

      Does the Android keyboard transcription not work for your needs?

      • baseh a day ago ago

        For Android I find Google GBoard transcription most accurate and pretty solid.

        • BizarroLand a day ago ago

          Not wrong, but at the same time, some people use Android and also remove Google from the equation, so finding an alternative for Gboard is valuable to them. I'm one of them and I really like Futo.

  • arcologies1985 2 days ago ago

    Could you make it use Parakeet? That's an offline model that runs very quickly even without a GPU, so you could get much lower latency than using an API.

    • zachlatta 2 days ago ago

      I love this idea, and originally planned to build it using local models, but to have post-processing (that's where you get correctly spelled names when replying to emails / etc), you need to have a local LLM too.

      If you do that, the total pipeline takes too long for the UX to be good (5-10 seconds per transcription instead of <1s). I also had concerns around battery life.

      Some day!

    • s0l 2 days ago ago

      https://github.com/cjpais/Handy

      It’s free and offline

      • zachlatta 2 days ago ago

        Wow, Handy looks really great and super polished. Demo at https://handy.computer/

        • BizarroLand 21 hours ago ago

          [I'm using] Handy myself right now. And it's pretty good. I don't have any problems with it, except that I wish that it would slowly roll out the text as you talk instead of waiting to transcribe into the very end. because I like to rant and ramble a little bit and then go back and edit what I've written rather than having to perfectly compose on the first attempt. And that's one of the big advantages, in my opinion, of using a voice to text app is that it would let you ramble and rant and see what you have said and keep making additions and alterations to that. For instance, I'm doing this entire bit using handy in one stream of thought take. And so it's probably gonna be a bit rambly and not very polished, but at the same time it's more representative of a general use case. And I'm talking quite a bit so that I can actually put the system under stress and see how well it responds.

          My only issue with it was that it cut off the words [I'm using] at the beginning and obviously it doesn't enter paragraph breaks. It took about 25 seconds to transcribe all of that on a 10th gen i7 laptop processor.

          If they could incorporate combination typing out what was said while you're talking it would be pretty perfect.

  • yrral a day ago ago

    Does anyone know of any macos transcription apps that allow you to do speech to text live? Eg, the text outputs as you are talking? Older tech like the macos dictation as well as dragon does this, but seems like theres nothing available that uses the new, better models.

  • corlinp 2 days ago ago

    I created Voibe which takes a slightly different direction and uses gpt-4o-transcribe with a configurable custom prompt to achieve maximum accuracy (much better than Whisper). Requires your own OpenAI API key.

    https://github.com/corlinp/voibe

    I do see the name has since been taken by a paid service... shame.

  • Laurenz1337 a day ago ago

    I dont understand who this is for honestly. Unless you dont have hands, why would you want to talk to your computer. Maybe Im just autistic, but I would always prefer text over speaking out and have that translate to text.

    • zhengyi13 a day ago ago

      Some of us have hands (and wrists and arms) that are dealing with RSI. Keyboard use reduction is very important in these cases.

      Greg Priest Dorman [0][1] had other physical issues such that he had to regularly switch between sitting, standing, and walking during his workday. His solutions included (in part) some very specialized keypads, but TTS might well have been another solution for someone with similar needs.

      Another fellow on my team refuses to write/type anything other than pure code to solve issues at work, but will absolutely talk for hours on end about designs, considerations, issues, what-have-you, so we're actively trying to get him to adopt a TTS-based workflow for knowledge transfer, writing tickets/bugs, etc.

      [0]: https://computerhistory.org/profile/greg-priest-dorman/ [1]: https://www.cs.vassar.edu/people/priestdo/wearables/top

    • hackernewds a day ago ago

      you shouldn't use autism as a generic insult as you have here

  • johnbatch 2 days ago ago

    Do any of these works as an iOS keyboard to replace the awful voice transcription Apple is currently shipping?

  • arach a day ago ago

    Combine this with a nice shortcut keyboard and then you're really flying - my favorites are XP Pen and DOIO 16

  • yuppiepuppie a day ago ago

    Quick question, what’s the state of vibe coding with Xcode? I remember there were some issues months ago trying to get a seem less integration working. Has it improved?

    • b-star a day ago ago

      I just vibe coded a small app in 2 hours (mostly due to making additional adjustments). Claude Code used Xcode CLI. No issues besides the fact that it’s not notarized and you have to trust it through Gatekeeper

  • baxtr 2 days ago ago

    Is there a tool that preserves the audio? I want both, the transcript and the audio.

    • heyalexej 2 days ago ago

      Quick glance; FreeFlow already saves WAV recordings for every transcript to ~/Lib../App../FreeFlow/audio/ with UUIDs linking them to pipeline history entries in CoreData. Audio files are automatically deleted though, when their associated history entries are deleted. Shall be a quick fix. Recently did the same for hyprvoice, for debugging and auditing.

    • BizarroLand 21 hours ago ago

      Handy appears to keep the audio clips, It does have a section in the settings to limit how many of those it keeps and there does not appear to be an upper limit, but it does have to be manually set. (I set mine to 99,999).

      It would be nice if below 0 it had a -1 option to keep all recordings.

      https://handy.computer/

  • sonu27 2 days ago ago

    Nice! I vibe coded the same this weekend but for OpenAI however less polished https://github.com/sonu27/voicebardictate

    • manmal 2 days ago ago

      Also look into voxtral, their new model is good and half the price if you can live without streaming.

  • hodanli 2 days ago ago

    title lacks: for Mac

  • lemming 2 days ago ago

    Is it possible to customise the key binding? Most of these services let you customise the binding, and also support toggle for push-to-talk mode.

  • dcreater 2 days ago ago

    Why do people find the need to market as "free alternative to xyz" when its a basic utility? I take it as an instant signal that the dev is a copycat and mostly interested in getting stars and eyeballs rather than making a genuinely useful high quality product.

    Just use handy: https://github.com/cjpais/Handy

    • egonschiele 2 days ago ago

      Really good to know Handy exists; it's the first I'm hearing about it. I use a speech-to-text app that I built for myself, and I know at least one co-worker pays $10 a month for (I think) Wispr. I think it's possible there was no intention to market, and the creator simply didn't know about Handy, just like me.

  • SomaticPirate 2 days ago ago

    Seeing this thread, sounds a blog post comparing the offerings would be useful

    • copperx 2 days ago ago

      Good idea at first glance, but it would get outdated in hours.

  • dan_wood a day ago ago

    But SuperWhisper is free with Parakeet as a local model?

    • hnrodey a day ago ago

      That’s how I have it running too

  • wazoox a day ago ago

    Murmure is multiplatform, uses parakeet and can connect to your local llm (using ollama). https://murmure.al1x-ai.com/

  • 2 days ago ago
    [deleted]
  • DevX101 2 days ago ago

    Anything similar for iOS?

  • Zopieux 2 days ago ago

    Saved you a click: Mac only and actually Grok; local inference too slow.

    Won't be free when xAI starts charging.

  • ndgold a day ago ago

    Vowen

  • _blackhawk_ 2 days ago ago

    Spokenly?

  • copperx 2 days ago ago

    Utter uses your OpenAI key (~$1/month). https://utter.to/. Has an iPhone app.