Request for guidance regarding training

[mittalgovind]

Hello,

I trained a 512 model with VGGFace2 for 390k steps and I got the following video output . I have also attached one of the samples obtained at step 390k. Do you know where I might be messing up?

I used the SimSwap colab.ipnyb

[netrunner-exe]

Hello,

I trained a 512 model with VGGFace2 for 390k steps and I got the following video output . I have also attached one of the samples obtained at step 390k. Do you know where I might be messing up?

I used the SimSwap colab.ipnyb

Hello! Maybe some missing fix in code? Can you share your checkpoints?

[Fibonacci134]

Did you set --Gdeep True ? Even though 400k should be the minimum you should have seen semi normal results with 390k. Make sure your weights have updated properly and you are pointing to them when initiating testing. I believe they will get better with more iterations but the current output does not make sense.

[netrunner-exe]

Did you set --Gdeep True ? Even though 400k should be the minimum you should have seen semi normal results with 390k. Make sure your weights have updated properly and you are pointing to them when initiating testing. I believe they will get better with more iterations but the current output does not make sense.

I think this is still a problem with the code - it seems that some layers do not load properly. Even after 80,000 I already had a bad result, and the faces changed, albeit in poor quality. But unfortunately, while there is no checkpoint, it is impossible to test it with the code and say for sure or help ...

[Fibonacci134]

I see, the training code seems very straightforward, i lack knowledge in this particular area but the generator functions may not be set up properly. I really need to learn this next. Theres just so much to learn 😭.

[papipulato]

omg man, can you share it how to train vggface with 512 ? the dataset is 100GB. my colab only can 70gb free.

[netrunner-exe]

omg man, can you share it how to train vggface with 512 ? the dataset is 100GB. my colab only can 70gb free.

I do not think that he will share his checkpoints or dataset. During my observation of this repository, not many people have contributed to the SimSwap community. Of course, really cool guys like @ftaker887, @instant-high, @woctezuma and others helped solve problems, wrote GUIs, made suggestions for improving the code (sorry if I forgot to mention someone). But unfortunately, most users are used to receiving help or resources but prefer not contributing anything in return. This is my opinion, correct me if I'm wrong.

[neuralchen]

Turn off the mask, and print the results.
From the training output, the training should be no problem.
The problem may occur with the test code.
There may be a code compatibility problem, the test code and the training model forward code are not compatible

[netrunner-exe]

Turn off the mask, and print the results. From the training output, the training should be no problem. The problem may occur with the test code. There may be a code compatibility problem, the test code and the training model forward code are not compatible

Hi! @neuralchen! I try to train 224. epoch 88500
Hope this helps solve the problem

With mask:

Without mask:

[doctorcui]

I also have the same problem The model can be successfully trained and the training sample data is normal but Error while testing

[doctorcui]

I think the effect is too white ， is this normal?

[netrunner-exe]

I did a little experiment with the code. If in videoswap.py in line 89 change swap_result = swap_model(None, frame_align_crop_tenor, id_vetor, None, True)[0] to swap_result = swap_model(None, spNorm(frame_align_crop_tenor), id_vetor, None, True)[0]
The result will be slightly better but the face will be very contrasting:

But this affect other public models - people and 512:

Perhaps they should be accepted, something like parse --name arg from base_options (I didn't manage to do it) and add input_norm = spNorm(frame_align_crop_tenor) if name != 'people' or name != '512' else frame_align_crop_tenor and swap_result = swap_model(None, input_norm, id_vetor, None, True)[0]

[netrunner-exe]

Perhaps some layer from the model does not load or does not load correctly. If we compare it with a screen with a white face, then in addition to high contrast, there is a difference in the eyes, teeth, etc.

[neuralchen]

Sent your ckpt to my email, i will check what has happend.

[netrunner-exe]

Sent your ckpt to my email, i will check what has happend.

I send link on gmail in profile

[mittalgovind]

Hey guys,

Sorry for the late reply. I was busy with some things. Here is my checkpoint I got the results from. I have not debugged it till now. I will look into it and get back to you guys soon. Also, I did set --Gdeep True.