ASR does not work at all for me. I want to watch any American show dubbed into Hungarian. So I select Hungarian as the audio language and Hungarian-ASR as the subtitle language. Now I hear the Hungarian dubbed version, but I don’t see any ASR generated Hungarian subtitles. I have tried it with at least 15 different shows and it doesn’t work anywhere. I have also tried with other languages - equally unsuccessful.
The Whisper model isn’t that strong with Hungarian, there will be some mistakes, but with programs with clearer audio it may be acceptable. I’m not sure of the details but Whisper has the equivilent of a strong language model inside it, the erroneous sections might not match the audio but will probably still be grammatical Hungarian… need to double check this though.
As David_Wilkison said with Hungarian, this seems true with regards to Korean (the one I tried and so far as I can tell as more of a beginner learner):
I noticed that using it to get subs of shows in my target language (that don’t have original audio subs)—even though a VPN set to another country might also get me target language subs—means I don’t get every piece of spoken dialogue with the Whisper model. Still, I get enough that it works for me.
P.S. Edit. I also noticed that it can also be used to save (what is *closer to*) full sentences (or at least more contextualized phrases:
Can sb help me how this ASR are different from Netflix subs?!
I see that you are using this, but the NF already has subs and dubs for the movie that was provided in the link. So I am struggling with what is going on! Is there a feature that I missed?
Subtitles sometimes not match with the audio in regular subtitles. (Subtitle translators on Netflix usually not using same translation in dubbing) That’s why ASR is different. Maybe also this option would be more effective in youtube as sometimes them not have right language auto subtiles.
Still as netflix usually has subtitles already I would prefer this option works all html5 videos (of course it will need more power) for example my favorite site for watching russian movies not have subtitles usually.
Hey all. Very sorry I took a server offline for maintence early this morning, and a network cable was left unplugged. I don’t have notifications set up for the ASR server, so I didn’t realise. It should be working again. I’m shuffling things round, and putting in redundant machines, to get everything super-stable.