New Feature: Speech Recognition on Netflix ("Subs for Dubs") 😮

News from the Team
1

Rolling this out shortly, please stand by.

:studio_microphone::arrow_right::memo::movie_camera::globe_with_meridians::sunglasses:

This feature has been on the todo list since the first release of LLN. You can watch your favorite programs on Netflix with the dubbed audio, and the subtitles will match!

It’s technically feasible this year due to recent developments (OpenAI’s Whisper ASR model, fast inference libraries and a few in-house GPU servers - audio data is not sent to third party APIs).

How to use it? If you are a Pro user, select the ASR track in the Netflix playback menu, or the LR extension settings. If you are a free user and want to try the feature, you can open ‘Money Heist’ (https://www.netflix.com/title/80192098).

image
image831×600 37.1 KB

How well does it work? Spanish, Italian, English, Portuguese, German, Japanese, Polish, Russian should work exceptionally well, and the next 11 languages are likely ‘pretty decent’.

image
image886×1171 92 KB

Questions? Thoughts? Ideas? Leave a comment. We’ll be using ASR for some other features too (upload audiobook probably soon).

21 Likes
2

Okay, there were some last min kinks, but it’s online, putting it live right now. :slight_smile:

2 Likes
4

We got some hardware issues, will keep an eye on it.

EDIT: woke up, looks like the plx chips overheated… uff. It’s running again now but only on half the GPUs, it’ll be slower to load subs.

2 Likes
5

Issue with some newer movie audio formats… fixing…

1 Like
6

Was offline for a few hours due to a networking problem… fixed now.

2 Likes
7

Kind of related and complementary, we’re redoing the catalogue pages. The Netflix page will include option to show movies that work with ASR, and also we’ll score everything using vocabulary frequency analysis.

image
image1970×1093 423 KB

4 Likes
8

Sorry if ASR has been unstable this week, I’ve been actively working on improving stability, will make a couple of other improvements too.

2 Likes