Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

API / dataloader for logging a video file directly #6532

Closed
jleibs opened this issue Jun 10, 2024 · 2 comments · Fixed by #7421
Closed

API / dataloader for logging a video file directly #6532

jleibs opened this issue Jun 10, 2024 · 2 comments · Fixed by #7421
Assignees
Labels
enhancement New feature or request 🪵 Log & send APIs Affects the user-facing API for all languages 🎞️ video

Comments

@jleibs
Copy link
Member

jleibs commented Jun 10, 2024

It is common for users to have video files they want to insert into Rerun.

Eventually, we would like to support video compression directly in the viewer (#5815), but doing so in a cross-platform way (including the browser) presents several challenges.

However, at present, we require users to decode video themselves and then log the individual image frames to Rerun. This is challenging to do performantly, generally requiring dependencies on external libraries, and often times multi-threaded/multiprocessing approaches to help with throughput.

It would be nice to offer a user-space API that allowed users to just directly submit a file-path or video-encoded bytestream and let Rerun take care of converting to a stream of images.

Although our data-loader APIs make it possible to do this as a plugin, it might be worth offering a dedicated API for this. In particular, a dedicated API would allow us to be explicit about how frame-ids map to time-points, which is not something we currently have the ability to do through data-loaders.

This is a situation where it would likely make sense to do the implementation in Rust once and then offer bindings through to the other languages.

@jleibs jleibs added enhancement New feature or request 🪵 Log & send APIs Affects the user-facing API for all languages labels Jun 10, 2024
@emilk
Copy link
Member

emilk commented Aug 27, 2024

@jleibs
Copy link
Member Author

jleibs commented Sep 10, 2024

Needs to produce video frame references

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request 🪵 Log & send APIs Affects the user-facing API for all languages 🎞️ video
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants