[windows] Consider using the flutter TextureRegistrar API

[jnschulze]

First of all, I‘d like to thank you for your efforts.

Still, there‘s room for improvement here and there ;)

Looking at your Windows implementation, for example, I realized that video pixel buffers are currently being passed through the method channel as opposed to using the texture registrar API.

I assume that using flutter::PixelBufferTexture should improve efficiency. This might require swizzling the pixel format from BGRA to RGBA and requires the stride size to be equal to the width, though.

Feel free to contact me for assistance.

[alexmercerind]

This plugin is really ahead of time, there isn't much documentation available and Linux doesn't support texture either yet.

The idea is to have a cross platform, native & performant media playback, broadcast & recording solution for all platforms (although I'm having few problems in the process right now).
I have already started to work on ffi based binding here which might eventually replace current platform channel interface. This project isn't just a pure Dart and C++ mapping, but a wrapper around libVLC, which is here and shared by both platforms as of now. I'm connecting this existing wrapper with FFI (WIP) instead of platform channel interface (here in case you're interested).
I would've picked ffi for the first place but it doesn't support async callbacks from another isolate, although now that's been circumvented, this project can also do media playback from Dart as well (not just Flutter). Main issue that I'm having is to compile libVLC along with my shared library for various architectures of Android. After this FFI migration, I'd love to see this running on mac too.

Current implementation just sends RAW frames in RV32 format and fortunately there exists a RawImage widget/class in Flutter for me to use. So, current video playback is kinda wacky, but is the best that I could've done.

First of all, I‘d like to thank you for your efforts.

I received fine amount of donation from @DomingoMG to work on this. It isn't my sole interest, but a motivation by supporters.

Thanks.
Glad you are liking the project, looking forward to make more additions.

[teukuridho]

Hi, I have the same problem as unorovi had which is very high CPU usage. Is there any update on this? Thanks🙏

[alexmercerind]

@Qorn flutter/flutter#80057

[alexmercerind]

@Qorn
Please checkout this issue comment flutter/flutter#78517 (comment).
It was an issue in Flutter's Windows Runner itself.

[teukuridho]

@alexmercerind there's no windows/runner/run_loop.cpp file in my flutter project. I'm using Flutter 2.4.0-1.0.pre.65

[alexmercerind]

@Qorn

See my CPU usage is always about 15-20% (in release mode). And my processor is also not powerful (old Zen I, entry level Ryzen 3 laptop variant 2200U) processor.

[alexmercerind]

Closing this issue as this project is no longer a plugin but FFI binding to existing C++ wrapper to libVLC.

I've refactored code to use FFI instead of Flutter's platform channel & now this can be used from Dart aswell (independent of Flutter).
As a result, now whole API is completely synchronous & more performant aswell.

Thanks