Here's one I've been playing with https://github.com/jhj0517/Whisper-WebUI
The small model of fast Whisper has been amazing for the 3 options it gives (files, YT, or recording), tho I have in mind the limitations and I've only used it with somewhat clear audio.
I second this. Also, I have been experiencing with automating it, using https://hub.docker.com/r/onerahmet/openai-whisper-asr-webservice as a provider for Bazarr
That looks pretty much what I'm looking for, thank you! I see instructions to run in Windows, but does it also work on Macs?
If you need it for media that has subtitles available somewhere, then there are plugins for that (ex. Jellyfin/Plex/Kodi)
If you're looking for something to automatically transcribe audio locally, I'm not as sure but others already suggested some
Which are you looking for?
My friend makes youtube videos and wants an easy way to subtitle them, as YouTube auto caption is crap.
What does he edit the video with? My video editing software does speech to text subtitles. Which is nice because I can edit where and how the subs are displayed.
I'm not sure, I'll ask him
Maybe you don't even need that, at least for accessibility.
Windows for example now has exactly this feature, which is a speech-to-text-transformer powered by some "AI".
But, in contrast to the Bing chat, this works (afaik) offline by some FOSS-backend, which I don't know the name of anymore (maybe someone else will?) You could use that tool for live transcription. That is supposed to work extremely well!
Please correct my if I'm wrong, I don't use Windows anymore personally, and at work we have a business edition that doesn't ship this brand new feature yet.
(Side note: as strongly as I hate Windows, this feature is absolutely godsend for hearing-impaired people and should be adopted by every other OS!)
If you want to transcript movies and thereof in bulk by uploading them, I can't give you any information, sorry.
But I believe there are some sites that give you the "subtitle file" for download freely, which you can add manually for each movie in Plex/ Jellyfin.
AFAIK iOS and macOS have had this for some time now. I think since a couple years back it’s all local-only on newer devices as well.
Might be janky, but if you really wanted this for free you could get a speech to text program like futo, play the video and have it transcribe it and save it to a text file, then copy and paste in the subtitles
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!