How do I get video frame and audio pcm when playing a video

[lp7799]

I need to work on ai tasks

[wang-bin]

viseo frame is decoded by gpu, and may be not accessible by cpu. you have to render video to a texture, the texture is what you need. in fact the video widget is already a texture, you can find a way to read the content from widget.

audio data api ia wip.

[lp7799]

I want to get the data callback when we decode it

[wang-bin]

I want to get the data callback when we decode it

You have to use cpu decoder, or read back gpu decoded data, the performance will be very poor for both. data read back is impossible for some hardware decoders, for example android mediacodec.

The api you need is onFrame, here is an example