How to improve the performance of facerecognition-external-model (for nextcloud-aio)

[luzfcb]

I started testing Nextcloud AIO v7.10.0 Beta. Is there any way to improve performance of facerecognition-external-model?
For me, it analyzes 1 image every 16 seconds.
My server runs on Ryzen 5600G, 32 GB of RAM, and Nvidia GTX 1650 GPU, so I suppose it's more than enough to have a very good performance.

[luzfcb]

from goodspb/pdlib#56 (comment) by @matiasdelellis

Hi @luzfcb

My server runs on Ryzen 5600G, 32 GB of RAM, and Nvidia GTX 1650 GPU, so I suppose it's more than enough to have a very good performance.

Mainly it's great that you have an Nvidia GTX 1650 😬 , but the docker container is not compiled to use cuda. You should install CUDA on your host, and build the container to make use of it. 😉
It will be much faster. 😬
It shouldn't be complicated, but I can't help you because I never had a video card. 😞

On the other hand, you can reduce the size of temporary images on settings. By default this container is in 4Mpx, and with 2Mps you will get it will be 50% faster and you will get practically the same result.

I left 4mpx as the default because the larger the images, the more likely you are to find all your faces, but in practice, you don't get more than 10% new faces.

Finally no matter how long the process takes, it is designed to do the job progressively. We try not to take shortcuts but do better.

p.s: Not even Google gives you the results so quickly when you upload many images... 😅
Let's be pacient.. 😉

[szaimen]

I think one idea would be parallelization of the analyzation? Currrently it looks like only one image is analyzed at a time... WDYT @matiasdelellis ?

[szaimen]

Now I'm thinking about using an approach similar to Memories. This is using locks on each scanned file which still doesn't convince me, but it's such a simple approach that it can work

Sounds good to me :)

[matiasdelellis]

We have something.. 🤪

#237 (comment)

Note that unfortunately the external model is still single threaded, and will probably fail with timeouts. It needs to be investigated. 😞

[matiasdelellis]

Small update..
We don't need to change the external model since we can make a pool or load balancer with gunicorn very easily.

Just call:

$ gunicorn -w 4 'facerecognition-external-model:app' --threads 4 --access-logfile -

However I am looking for something as simple as this to run the occ face:background_job --analyze-mode command several times and wait for it to finish, since all of them must finish before running occ face:background_job --cluster-mode

🤔 ps: I already saw parallel, I know wait, $!, etc, but nothing is as simple as I want. 😞

[matiasdelellis]

Well,
I never commented this, it's definitely not elegant but we have to use something like this.

#!/bin/bash
echo "Synchronizing user files..."
php occ face:background_job -u user --sync-mode
echo "Done"

echo "Analyzing user files..."
for i in {1..4}; do
    php occ face:background_job -u user --analyze-mode &
    pids[${i}]=$!
done

for pid in ${pids[*]}; do
    wait $pid
done
echo "Done"

echo "Calculating user face clusters..."
php occ face:background_job -u user --cluster-mode
echo "Done"

[doppelgrau]

And it seems to work, see the pull request for the docker image. Reducing for me the import of one of my family members to a somewhat manageable time.

[wojciechczyz]

To speed up processin, I am following this guide and I am running 4 background jobs on the machine with 4 CPU cores. Very frecuently they keep having problem resolving external model docker container. Why is that?

Faces found: 0. Image will be skipped because of the following error: Could not resolve host: nextcloud-aio-facerecognition
Processing image /mnt/external_storage/Photos/PhotosExport/IMG_7650.JPG

    Faces found: 0. Image will be skipped because of the following error: Could not resolve host: nextcloud-aio-facerecognition
    Processing image /mnt/external_storage/Photos/PhotosExport/20210412_185714.jpg

    Processing image /mnt/external_storage/Photos/PhotosExport/DSC_1351.JPG
    Faces found: 1
    Processing image /mnt/external_storage/Photos/PhotosExport/IMG_9096 (2).JPG
    Faces found: 3
    Processing image /mnt/external_storage/Photos/PhotosExport/20210222_133830_IMG_2223.HEIC

[szaimen]

You could try if AIO v9.7.0 beta resolves the connection problems. See https://github.com/nextcloud/all-in-one?tab=readme-ov-file#how-to-switch-the-channel