Scale down replica sets to allow transfer of persistPaths pvc between pods

[lizardruss]

What issue type does this pull request address?
/kind enhancement

What does this pull request do? Which issues does it resolve?
Fixes ENG-634

Please provide a short message that should be published in the DevSpace release notes
Improves DevSpace's deployment of persistentPaths

[lizardruss]

Logs with Recreate deployment strategy:

dev:my-dev Waiting for pod to become ready...
dev:my-dev Pod devspace-59df4bcf9b-789sg: Error: cannot find volume "kube-api-access-sxb89" to mount into container "default" (Failed)
dev:my-dev Pod devspace-devspace-6b98fb5466-68fs9: 0/4 nodes are available: 4 persistentvolumeclaim "devspace-devspace-x-pvc-x-pvc" not found. (FailedScheduling)
dev:my-dev Pod devspace-6d7577c8c5-dqnhw: Error: cannot find volume "kube-api-access-7pbnn" to mount into container "default" (Failed)
dev:my-dev Pod devspace-devspace-686fd789c9-xzkwt: Multi-Attach error for volume "pvc-d1912cf4-a8bb-4f33-ab03-e8a4f4d2a6d2" Volume is already used by pod(s) devspace-devspace-7b8f798849-9zvqv-x-pvc-x-pvc (FailedAttachVolume)
dev:my-dev Pod devspace-59b7d9c797-b8hv6: Error: cannot find volume "kube-api-access-rkr56" to mount into container "default" (Failed)
dev:my-dev Pod devspace-devspace-7b8f798849-xwlt5: Multi-Attach error for volume "pvc-d1912cf4-a8bb-4f33-ab03-e8a4f4d2a6d2" Volume is already used by pod(s) devspace-devspace-c4fb685d5-4xc8x-x-pvc-x-pvc (FailedAttachVolume)
dev:my-dev Pod devspace-7d69b8bcd5-4dmp7: Error: cannot find volume "kube-api-access-n9q22" to mount into container "default" (Failed)
dev:my-dev Pod devspace-devspace-c4fb685d5-bhnnb: Multi-Attach error for volume "pvc-d1912cf4-a8bb-4f33-ab03-e8a4f4d2a6d2" Volume is already used by pod(s) devspace-devspace-568f854658-lll7t-x-pvc-x-pvc (FailedAttachVolume)
dev:my-dev Pod devspace-devspace-568f854658-lll7t: Multi-Attach error for volume "pvc-d1912cf4-a8bb-4f33-ab03-e8a4f4d2a6d2" Volume is already used by pod(s) devspace-devspace-7468f78d9-mrtfp-x-pvc-x-pvc (FailedAttachVolume)
dev:my-dev Pod devspace-78b9cbf74d-qfxw9: Error: cannot find volume "kube-api-access-sd5vr" to mount into container "default" (Failed)
dev:my-dev Pod devspace-devspace-568f854658-gqg6z: Multi-Attach error for volume "pvc-d1912cf4-a8bb-4f33-ab03-e8a4f4d2a6d2" Volume is already used by pod(s) devspace-devspace-7468f78d9-mrtfp-x-pvc-x-pvc (FailedAttachVolume)
dev:my-dev Pod devspace-devspace-7468f78d9-wh4qf: 0/4 nodes are available: 4 persistentvolumeclaim "devspace-devspace-x-pvc-x-pvc" not found. (FailedScheduling)
dev:my-dev Pod devspace-devspace-7468f78d9-mrtfp: 0/4 nodes are available: 4 persistentvolumeclaim "devspace-devspace-x-pvc-x-pvc" not found. (FailedScheduling)
dev:my-dev Pod devspace-7774d94f7c-24qz8: Error: cannot find volume "kube-api-access-kdmpw" to mount into container "default" (Failed)
dev:my-dev Pod devspace-devspace-7dcd5c659c-cwl4f: 0/4 nodes are available: 4 persistentvolumeclaim "devspace-devspace-x-pvc-x-pvc" not found. (FailedScheduling)
dev:my-dev Pod devspace-devspace-7dcd5c659c-cwl4f: 0/4 nodes are available: 4 persistentvolumeclaim "devspace-devspace-x-pvc-x-pvc" not found. (FailedScheduling)
dev:my-dev Pod devspace-devspace-7dcd5c659c-pql6z: 0/4 nodes are available: 4 persistentvolumeclaim "devspace-devspace-x-pvc-x-pvc" not found. (FailedScheduling)
dev:my-dev Pod devspace-5f5b7fdc64-mf4gk: Error: cannot find volume "kube-api-access-rp8rf" to mount into container "default" (Failed)
dev:my-dev Pod devspace-devspace-85b864cbcd-rrqn8: 0/4 nodes are available: 4 persistentvolumeclaim "devspace-devspace-x-pvc-x-pvc" not found. (FailedScheduling)
dev:my-dev DevSpace still couldn't find any Pods that match the selector. DevSpace will continue waiting, but this operation might timeout
dev:my-dev DevSpace still couldn't find any Pods that match the selector. DevSpace will continue waiting, but this operation might timeout
dev:my-dev DevSpace still couldn't find any Pods that match the selector. DevSpace will continue waiting, but this operation might timeout
dev:my-dev DevSpace still couldn't find any Pods that match the selector. DevSpace will continue waiting, but this operation might timeout
dev:my-dev DevSpace is waiting, because Pod devspace-devspace-57db89f586-l6snd has status: Init:0/1
dev:my-dev Selected pod devspace-devspace-57db89f586-l6snd
dev:my-dev ports Port forwarding started on: 3000 -> 3000
dev:my-dev sync  Sync started on: ./ <-> ./
dev:my-dev sync  Waiting for initial sync to complete
dev:my-dev sync  Initial sync completed
dev:my-dev term  Opening shell to default:devspace-devspace-57db89f586-l6snd (pod:container)

[lizardruss]

Logs with preemptive scalling down of the replica set:

dev:my-dev Waiting for pod to become ready...
dev:my-dev Pod devspace-devspace-6bdf5ccb84-f976t: Multi-Attach error for volume "pvc-03bbb535-1727-4172-ae23-1770088a2c42" Volume is already used by pod(s) devspace-devspace-6ffc58bbbf-4htwl-x-pvc-x-pvc (FailedAttachVolume)
dev:my-dev DevSpace is waiting, because Pod devspace-devspace-6bdf5ccb84-f976t has status: Init:0/1
dev:my-dev DevSpace is waiting, because Pod devspace-devspace-6bdf5ccb84-f976t has status: Init:0/1
dev:my-dev DevSpace is waiting, because Pod devspace-devspace-6bdf5ccb84-f976t has status: Init:0/1
dev:my-dev DevSpace is waiting, because Pod devspace-devspace-6bdf5ccb84-f976t has status: Init:0/1
dev:my-dev DevSpace is waiting, because Pod devspace-devspace-6bdf5ccb84-f976t has status: Init:0/1
dev:my-dev DevSpace is waiting, because Pod devspace-devspace-6bdf5ccb84-f976t has status: Init:0/1
dev:my-dev Selected pod devspace-devspace-6bdf5ccb84-f976t
dev:my-dev ports Port forwarding started on: 3000 -> 3000
dev:my-dev sync  Sync started on: ./ <-> ./
dev:my-dev sync  Waiting for initial sync to complete
dev:my-dev sync  Initial sync completed
dev:my-dev term  Opening shell to default:devspace-devspace-6bdf5ccb84-f976t (pod:container)