Not Working on Android 11 and 12

[arsallion313786]

I have added latest google ml kit version in our flutter app its working fine for Android 9 but for higher versions Android 11 and 12 not working even i tested google ml kit example app and same behaviour for Android 11 and 12. I also tried this for IOS and there its working fine. On Android 11 and developer all feature are not working properly.

If any one try google ml kit features for Android 11 and 12 then please share solution or even share their problem

[fbernaly]

@arsallion313786 : what do you mean with "not working"? which API are you using: face detection, barcode, text recognition, etc? I used a Pixel 4 with Android 12 to test our example app, and so far all the APIs are working. So, could you be more specific what is not working for you Android 12 testing device?
Also, thanks for trying Google's native app, if you are getting the same behavior in Google's native app, then you should open an issue there. We are just consuming and wrapping their APIs in this plugins, doing the same processing they have in their documentation. We won't be able to fix that, but them. If you find that we are consuming and exposing incorrectly their APIs then come and let us know, or contribute with a PR.

[arsallion313786]

@fbernaly
Thanks to comment. I have Samsung A23 Testing device and i have tested Barcode and Text detection API its working fine on all iOS devices and on Android Devices which they have version upto 9 but same code not working for Android 11 and 12.
I really wonder if all things working fine for all iOS devices and also for Android 9 then why not for Android 11 and 12

[umangsh]

Possibly related, google_mlkit_barcode_scanning doesn't work for me on Pixel 3, Android 12. The camera switches on, but nothing happens when pointed at a barcode. Barcode detection works fine on iOS. Flutter logs:

I/Camera (20069): close
W/Camera (20069): The selected imageFormatGroup is not supported by Android. Defaulting to yuv420
I/Camera (20069): startPreview
I/Camera (20069): CameraCaptureSession onConfigured
I/Camera (20069): Updating builder settings
D/Camera (20069): Updating builder with feature: ExposureLockFeature
D/Camera (20069): Updating builder with feature: ExposurePointFeature
I/Camera (20069): closeCaptureSession
D/Camera (20069): Updating builder with feature: ZoomLevelFeature
D/Camera (20069): Updating builder with feature: AutoFocusFeature
D/Camera (20069): Updating builder with feature: NoiseReductionFeature
I/Camera (20069): updateNoiseReduction | currentSetting: fast
D/Camera (20069): Updating builder with feature: FocusPointFeature
D/Camera (20069): Updating builder with feature: ResolutionFeature
D/Camera (20069): Updating builder with feature: SensorOrientationFeature
D/Camera (20069): Updating builder with feature: FlashFeature
D/Camera (20069): Updating builder with feature: ExposureOffsetFeature
D/Camera (20069): Updating builder with feature: FpsRangeFeature
I/Camera (20069): refreshPreviewCaptureSession
I/Camera (20069): refreshPreviewCaptureSession: captureSession not yet initialized, skipping preview capture session refresh.
I/Camera (20069): CameraCaptureSession onClosed
I/Camera (20069): startPreviewWithImageStream
I/Camera (20069): CameraCaptureSession onConfigured
I/Camera (20069): Updating builder settings
D/Camera (20069): Updating builder with feature: ExposureLockFeature
D/Camera (20069): Updating builder with feature: ExposurePointFeature
D/Camera (20069): Updating builder with feature: ZoomLevelFeature
D/Camera (20069): Updating builder with feature: AutoFocusFeature
D/Camera (20069): Updating builder with feature: NoiseReductionFeature
I/Camera (20069): updateNoiseReduction | currentSetting: fast
D/Camera (20069): Updating builder with feature: FocusPointFeature
D/Camera (20069): Updating builder with feature: ResolutionFeature
D/Camera (20069): Updating builder with feature: SensorOrientationFeature
D/Camera (20069): Updating builder with feature: FlashFeature
D/Camera (20069): Updating builder with feature: ExposureOffsetFeature
D/Camera (20069): Updating builder with feature: FpsRangeFeature
I/Camera (20069): refreshPreviewCaptureSession
W/System (20069): A resource failed to call release.
W/System (20069): A resource failed to call release.
D/TransportRuntime.SQLiteEventStore(20069): Storing event with priority=VERY_LOW, name=FIREBASE_ML_SDK for destination cct
D/TransportRuntime.JobInfoScheduler(20069): Upload for context TransportContext(cct, VERY_LOW, 90bzNc) is already scheduled. Returning...
D/TransportRuntime.SQLiteEventStore(20069): Storing event with priority=DEFAULT, name=FIREBASE_ML_SDK for destination cct
D/TransportRuntime.JobInfoScheduler(20069): Upload for context TransportContext(cct, DEFAULT, 90bzNc) is already scheduled. Returning...
D/TransportRuntime.SQLiteEventStore(20069): Storing event with priority=VERY_LOW, name=FIREBASE_ML_SDK for destination cct
D/TransportRuntime.JobInfoScheduler(20069): Upload for context TransportContext(cct, VERY_LOW, 90bzNc) is already scheduled. Returning...
D/TransportRuntime.SQLiteEventStore(20069): Storing event with priority=VERY_LOW, name=FIREBASE_ML_SDK for destination cct
D/TransportRuntime.JobInfoScheduler(20069): Upload for context TransportContext(cct, VERY_LOW, 90bzNc) is already scheduled. Returning...

[umangsh]

From the linked bug, there is likely an issue with some Android 12 devices (emulators are okay) and google_mlkit_barcode_scanning:

1. Works on emulators - Pixel 3, Pixel5 with Android 12, Pixel 3 with Android 9.
2. Works on device - lenovo Tab with Android 10.
3. Works on Samsung Galaxy Tab S6 Lite, Android 12.
4. Does NOT work on Pixel 3 and Pixel 5 with Android 12.
5. Does NOT work on Nokia x20, with google services, Android version unknown.

[sorgfal]

From the linked bug, there is likely an issue with some Android 12 devices (emulators are okay) and google_mlkit_barcode_scanning:

1. Works on emulators - Pixel 3, Pixel5 with Android 12, Pixel 3 with Android 9.
2. Works on device - lenovo Tab with Android 10.
3. Works on Samsung Galaxy Tab S6 Lite, Android 12.
4. Does NOT work on Pixel 3 and Pixel 5 with Android 12.
5. Does NOT work on Nokia x20, with google services, Android version unknown.

nokia x20 android 12

[mahbubabbas]

Not working on Vivo Y33T having android 12

[ErrorCode-404]

I am using this plugin together with the camera plugin to create a barcode scanner. The imageSream on the CameraController delivers CameraImage's which will be used for barcode detection while using the mlkit BarcodeScanner.
On some devices like Pixel 6 everything works good and fast. But on the Pixel 5 the detection doesn't work at all.
I am holding the camera over the barcode but nothing happens.

But I changed something which made it work. Surprisingly it's the "ResolutionPreset" in the CameraController constructor.
First I set it to medium which works on the pixel 6 but not pixel 5. Then I changed it to high and after that it also works on the pixel 5.

Maybe there is some kind of correlation between the resolution of the images and the detector(s).

[rubenferreira97]

But I changed something which made it work. Surprisingly it's the "ResolutionPreset" in the CameraController constructor.
First I set it to medium which works on the pixel 6 but not pixel 5. Then I changed it to high and after that it also works on the pixel 5.

I can confirm that changing the ResolutionPreset results in different behavior. Setting ResolutionPreset to ResolutionPreset.max seems to work, but slows down the camera framerate. Maybe this bug have something to do with the camera package not finding the asked camera resolution and sending wrong metadata or MLKit can't process images with low resolution (setting a low ResolutionPreset).

I don't think this problem is Android Version related since I can reproduce this on Android 10 (Xiaomi Redmi 9S) using ResolutionPreset.medium.

[mahbubabbas]

Guys I have created one new plugin for face detection using CameraX which will solve the mentioned issues in sha Allaah. Please visit https://pub.dev/packages/camerax2.

…

On Thu, Jul 14, 2022 at 4:41 PM Rúben Ferreira ***@***.***> wrote: But I changed something which made it work. Surprisingly it's the "ResolutionPreset" in the CameraController constructor. First I set it to medium which works on the pixel 6 but not pixel 5. Then I changed it to high and after that it also works on the pixel 5. I can confirm that changing the ResolutionPreset results in different behavior. Setting ResolutionPreset to ResolutionPreset.max seems to work, but slows down the camera framerate. Maybe this bug have something to do with the camera package not finding the asked camera resolution and sending wrong metadata or MLKit can't process images with low resolution (setting a low ResolutionPreset setting like ResolutionPreset.medium). — Reply to this email directly, view it on GitHub <#285 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AC2R3SYE76JUHQUBWF4CDP3VT7YVBANCNFSM5Z2TRYVQ> . You are receiving this because you commented.Message ID: ***@***.***>

[fbernaly]

Hi guys, sorry for the delay. Thanks for using our plugin. @bharat-biradar and I have been maintaining this plugin, but sometimes we cannot provide all the support you need. Both of us are busy with school, work and family. We created this plugin as an open source project. We do not have an ETA for this fix, too busy with so many things, but you are welcome to fork our repo, fix whatever is broken and sent the PR. We will review PRs as soon as possible and release a new version.

I think that @rubenferreira97 is right, during my initial testing I found issues with the camera plugin similar to whar @rubenferreira97 reported: issues when changing the resolution.

ML Kit has these guidelines for input image resolution: https://developers.google.com/ml-kit/vision/face-detection/ios#input-image-guidelines

Unfortunately, because most of us are using the camera plugin, some how the out of that plugin does not conform with what ML Kit expects as input image, and therefore our plugin is failing. Basically we are passing the native camera output to Flutter (with camera plugin), then we are sending it back using FlutterMethodChannel to the native layer to be processed by ML Kit, in all that process there is a big delay, also compressing and decompressing issues. A better approach would be something like @mahbubabbas did: capture the image in the native layer and send it directly to ML Kit for processing without passing for Flutter.

I would appreciate if someone takes the time to fork our repo and starts leading that effort. I think we are going to continue seeing this issues related to using camera plugin, until we refactor the plugin to process the camera directly in the native layer.