Improved the performance of generated-files.Dockerfile by skipping pa…#5948
Improved the performance of generated-files.Dockerfile by skipping pa…#5948cowwoc wants to merge 1 commit intomoby:masterfrom
Conversation
…ckaging of unused files Signed-off-by: Gili Tzabari <cowwoc2020@gmail.com>
84075fd to
69a2929
Compare
jsternberg
left a comment
There was a problem hiding this comment.
Sorry for taking so long to respond to this.
The google apis are used by some of the protobuf files. In particular, I think it gets the status proto from there and maybe one other thing. I don't know the specifics off the top of my head, but they are used and necessary.
It also might be ok to filter vtproto, but I don't think this ends up improving the performance of the resulting dockerfile from within our own dockerfile because these files are generally either cached or the files stay inside of buildkit. The performance improvement seems to be when you want to copy the files to the filesystem.
I might try to revisit this. If you're still interested in this kind of change, can you create an issue and ping me on it? I think that might be easier than doing a back and forth on a pull request as I want to respect your time and effort and I don't think I can do that through pull request reviews in good conscience.
…ckaging of unused files
Following up on #5924, I noticed that exporting files from the protobuf stage is extremely slow and of the 5800+ files, only 5 are actually needed to build language bindings. This reduces the build time by 2 minutes on my end.
@jsternberg As far as I can tell, the
googleapisstage contains the majority of the unused files and it isn't actually used by anyone. Can you please confirm this is the case?