When building an image with cog build --separate-weights, it changes permanently the configuration of the project. Even if we run other build commands after without the flag, the models/checkpoints are not added to the docker image anymore.
It seems that adding the flag --separate-weights adds the models to a .dockerignore file, resulting in this behavior.
I think that adding a flag to the build command should not change the containerization even with subsequent builds without the flag.
At least this should be documented.