Is there a lightweight tool, with source code available, for generating subtitles from videos in Finnish/Swedish/Norwegian? (lemmy.dbzer0.com)

submitted 1 month ago by flake@lemmy.dbzer0.com to c/opensource@lemmy.ml

6 comments fedilink hide all child comments

top 6 comments

sorted by: hot top controversial new old

[-] SGforce@lemmy.ca 6 points 1 month ago* (last edited 1 month ago)

https://huggingface.co/RASMUS/Whisper_Finnish_finetuned_small_200k_samples

This could work if you look into setting up Whisper Search for other languages also

[-] flake@lemmy.dbzer0.com 4 points 1 month ago

Thank youuu! I didn't know I could find models for other non-supported languages by default, that'll help me a lot!

[-] pe1uca@lemmy.pe1uca.dev 6 points 1 month ago

Not sure what'd you consider lightweight, I've been using https://github.com/jhj0517/Whisper-WebUI with fast whisper.
The GPU integration has never worked well for me, but the CPU one works wonders.
You'll have to check if the models offer good results for those languages.

[-] flake@lemmy.dbzer0.com 5 points 1 month ago

Thanks! I'm not sure what I should expect as lightweight when its about AI, i'd assume 2-4GB RAM max if possible and it seems with faster-whisper from this project according to the README it falls under 3-4GB RAM, so I guess that's fine!

There's no Finnish for Whisper last I checked but SGForce recommended a model for Finnish with it, so I guess that will do!

Thanks again for taking your time to help! :)