this post was submitted on 12 Jan 2025
660 points (98.0% liked)

Technology

60473 readers
4268 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
660
VLC player demos real-time AI subtitling for videos (www.theverge.com)
submitted 3 days ago* (last edited 3 days ago) by [email protected] to c/[email protected]
113 comments fedilink hide all child comments
 

cross-posted from: https://lemmy.ca/post/37011397

[email protected]

The popular open-source VLC video player was demonstrated on the floor of CES 2025 with automatic AI subtitling and translation, generated locally and offline in real time. Parent organization VideoLAN shared a video on Tuesday in which president Jean-Baptiste Kempf shows off the new feature, which uses open-source AI models to generate subtitles for videos in several languages. 

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 49 points 3 days ago* (last edited 3 days ago) (13 children)

As vlc is open source, can we expect this technology to also be available for, say, jellyfin, so that I can for once and for all have subtitles.done right?

Edit: I think it's great that vlc has this, but this sounds like something many other apps could benefit from

[–] [email protected] 22 points 3 days ago (4 children)

It's already available for anyone to use. https://github.com/openai/whisper

They're using OpenAI's Whisper model for this: https://code.videolan.org/videolan/vlc/-/merge_requests/5155

[–] [email protected] 5 points 3 days ago (1 children)

Has there been any estimated minimal system requirements for this yet, since it runs locally?

[–] [email protected] 11 points 3 days ago* (last edited 3 days ago) (1 children)

It's actually using whisper.cpp

From the README:

Memory usage Model Disk Mem tiny 75 MiB ~273 MB base 142 MiB ~388 MB small 466 MiB ~852 MB medium 1.5 GiB ~2.1 GB large 2.9 GiB ~3.9 GiB

Those are the model sizes

[–] [email protected] 3 points 3 days ago

Oh wow those pretty tiny memory requirements for a decent modern system! That's actually very impressive! :D

Many people can probably even run this on older media servers or even just a plain NAS! That's awesome! :D

load more comments (2 replies)
load more comments (10 replies)