This slows my system to a crawl. I've had to disable vet entirely.

See @ramya-rao-a comment in gitter here

About vet. Long long ago we ran go tool vet filename, then that changed to go vet . to stay consistent with build and lint which operate on package rather than single file. With this we noticed that the vet flags were getting ignored. So changed that to go tool vet .. Its the go tool vet . that is picking up the vendor folders. Do log a bug for this and we can see how we can fix it

I'd love to be able to run vet on just my own code.