Repository navigation
[Feature request] Translating system audio #92
Description
Activity
here is a photo showcasing my mentioned feature in a desktop environment to make sure you know what i mean
Hi, thank you for your suggestion, unfortunately I don't have much time to work on the app at the moment, so I prefer to prioritize fixing bugs and improving the features it already has instead of adding new ones. But this would be a really useful feature, so I added it to the list of things to do in the future, if it will be possible to implement it, sooner or later it will surely be included in RTranslator.
Reacted by 🦄Reacted by wt666666 and 🦄I think a lot of people need this feature, but right now there's only one app <讯飞听见> that can do this job, but it's not open source.
Reacted by niedev, wt666666 and Alex ShirmanThis feature is technically possible as I previously stated (sndcpy can get audio stream = any android app can too) , but since I don't know Android development I can't help with code.
Speaking of live captions,I actually built a desktop web alternative before ,using Chrome's screen sharing capability (before I knew chrome included live captions , around March 2024) and streaming audio to 3rd-party recognition apis. It's bad, but better than nothing.
^ the show is an episode of Wednesday Downtown, episode 24.01.31 . Japanese -> Chinese . No longer works due to deta sunset.Reacted by niedev and wt666666Any plans to add this still? There still doesnt exist any open source way to translate system audio in realtime. Pixel 6+ are the only Android phones thathve Live Translate built in
Reacted by Alex Shirmanwell i asked gemini to make me a System audio transcriber using third party apis and you actually can
Reacted by niedev
Thank you for wanting to share an idea! But before starting, ensure to check if this feature request respects the following requirements:
It would be good if it can be used to translate system audio, similar to Chrome's auto caption when playing videos. This would be useful when consuming media content and I really didn't see any application with this functionality.
I believe starting from Android version 10 casting the screen will also receive system audio stream ( I use https://github.com/rom1v/sndcpy to redirect my device audio to computers ) so technically this might be possible. and floaty window should be available in Android since long time ago.
(Note I don't know android development so I might be wrong)