I live in a two party consent state and have yet to pull the trigger on an AI transcription service. Yogurt is the first appropriate implementation of the service in my opinion, both for personal privacy and to limit potential issues if Granola or similar service gets hacked and transcriptions go public.
I appreciate that you included a default warning for the owner to let everyone on the call know they are being recorded. It might be ideal to take that a step further and have the popup occur again if another party joins the call and should also be notified of the recording.
lavendermon
It's a lot of fun to see what people can do with the voice transcription tools available now that are all open source.
I've been building my own Jarvis, and I still haven't built my own meeting mode for him yet, though it's on the trajectory. I may borrow some ideas from this.
I really like the filter for the whispered, hallucinated words that Whisper sometimes hears, like, "Thanks for watching," when it's silent. That's cool.
I do a similar splitting of speech, but I think a slightly different mechanism. So I'll have to take a look at how well yours works.
And, I'm not checking the loudness of the mic and the computer audio to figure out when the speaker output is leaking. That's nice.
If there was anything I would add to yours, it would be diarization on the same inputs. So the room mic might have two or three people behind it, and to have diarization for that to know who is talking at any one time would be probably helpful. I use NVIDIA's Nemotron on the Mac. https://huggingface.co/nvidia/Nemotron-3-Diarization
I’d love to see evals for how similar this is to Granola for meeting summarisation, on the github page
It should be possible given granola stores the transcript and the summary.
Granola has been such a fantastic sticky product for me given how simple it is: guaranteed a good summary, and a MCP that is a couple of clicks to setup with Claude/ChatGPT.
rc1
I’ll add it to my open-source directory[0].
How does it differ from Muesli[1] and OpenOats[2]?
Great job! It's refreshing to see something not limited to Macs/Apple Silicon.
When starting out, did you consider:
- Handy, either forking it or adding PRs?
- If you disliked the Handy UI, what about the choice of backend? Did you look into RealtimeSTT? The author is really serious about ASR and transcription
There are a 1000 Mac ASR and transcription projects, so it's really refreshing to see something that others outside the Mac garden can use - my worry is that by not reusing more mature foundations, you end up taking too much of a burden and burn out. The non Apple Silicon space needs more projects like these!
ProblemExplorer
Does yogurt support proper diarization and multilingual? Can’t seem to find confirmation.
Also, what’s the current best STT model? Apple’s dictation model isn’t good which is one big reason why I don’t use STT much.
Great work! Personally would love the option to skip out on some of local model post processing features or optionally offload it to openrouter, the summarization steps and the ask feature eat up tons of resources.
austinhutch
The electron use is giving me pause. It’s going to eat up memory.
Aniket-N
I also got frustrated with Granola earlier this year and have been building my replacement - Noted: https://takenoted.com/
It shares similar principles but is (currently) closed source and mac-only.
Take a look at anarlog as well - it's a great project and I wish I'd found it earlier as I probably would have contributed instead of starting my own: https://anarlog.so/
Let me know if you want to compare notes - I am sure we have hit a lot of the same issues.
comments (10)
I appreciate that you included a default warning for the owner to let everyone on the call know they are being recorded. It might be ideal to take that a step further and have the popup occur again if another party joins the call and should also be notified of the recording.
lavendermon
I've been building my own Jarvis, and I still haven't built my own meeting mode for him yet, though it's on the trajectory. I may borrow some ideas from this.
I really like the filter for the whispered, hallucinated words that Whisper sometimes hears, like, "Thanks for watching," when it's silent. That's cool.
I do a similar splitting of speech, but I think a slightly different mechanism. So I'll have to take a look at how well yours works.
And, I'm not checking the loudness of the mic and the computer audio to figure out when the speaker output is leaking. That's nice.
If there was anything I would add to yours, it would be diarization on the same inputs. So the room mic might have two or three people behind it, and to have diarization for that to know who is talking at any one time would be probably helpful. I use NVIDIA's Nemotron on the Mac. https://huggingface.co/nvidia/Nemotron-3-Diarization
And, I have enrollment for voices with speaker embeddings using this: https://github.com/wenet-e2e/wespeaker
mickdarling
It should be possible given granola stores the transcript and the summary.
Granola has been such a fantastic sticky product for me given how simple it is: guaranteed a good summary, and a MCP that is a couple of clicks to setup with Claude/ChatGPT.
rc1
How does it differ from Muesli[1] and OpenOats[2]?
0. https://opensource.builders/alternatives/granola
1. https://github.com/pHequals7/muesli
2. https://github.com/yazinsai/OpenOats
theturtletalks
When starting out, did you consider:
- Handy, either forking it or adding PRs?
- If you disliked the Handy UI, what about the choice of backend? Did you look into RealtimeSTT? The author is really serious about ASR and transcription
There are a 1000 Mac ASR and transcription projects, so it's really refreshing to see something that others outside the Mac garden can use - my worry is that by not reusing more mature foundations, you end up taking too much of a burden and burn out. The non Apple Silicon space needs more projects like these!
ProblemExplorer
Also, what’s the current best STT model? Apple’s dictation model isn’t good which is one big reason why I don’t use STT much.
newman314
How exactly?
Edit: Ah I see the parent company - https://frigade.com/
QGQBGdeZREunxLe
austinhutch
Aniket-N
It shares similar principles but is (currently) closed source and mac-only.
Take a look at anarlog as well - it's a great project and I wish I'd found it earlier as I probably would have contributed instead of starting my own: https://anarlog.so/
Let me know if you want to compare notes - I am sure we have hit a lot of the same issues.
zaius