Script 7 waits for app pods to avoid flaky tests

[doodlesbykumbi]

below are the logs from the init container.
the first few requests to the follower service timeout. and because there's exponential backoff the next try gets further and further away and can lead to a scenario where the app service is ready but the pod is unhealthy.

adding health checking for the app and waiting until the app pods are ready would prevent the flaky tests.

2019/03/07 19:06:24 logging in as test-app-4-5be44c04-5/service_account/test-app-summon-init.
2019/03/07 19:06:24 making login request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login
ERROR: 2019/03/07 19:06:34 main.go:89: on login: Post https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/03/07 19:06:35 logging in as test-app-4-5be44c04-5/service_account/test-app-summon-init.
2019/03/07 19:06:35 making login request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login
ERROR: 2019/03/07 19:06:45 main.go:89: on login: Post https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/03/07 19:06:49 logging in as test-app-4-5be44c04-5/service_account/test-app-summon-init.
2019/03/07 19:06:49 making login request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login
ERROR: 2019/03/07 19:06:59 main.go:89: on login: Post https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/03/07 19:07:06 logging in as test-app-4-5be44c04-5/service_account/test-app-summon-init.
2019/03/07 19:07:06 making login request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login
ERROR: 2019/03/07 19:07:16 main.go:89: on login: Post https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/03/07 19:07:24 logging in as test-app-4-5be44c04-5/service_account/test-app-summon-init.
2019/03/07 19:07:24 making login request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login
ERROR: 2019/03/07 19:07:34 main.go:89: on login: Post https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/03/07 19:07:48 logging in as test-app-4-5be44c04-5/service_account/test-app-summon-init.
2019/03/07 19:07:48 making login request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login
ERROR: 2019/03/07 19:07:58 main.go:89: on login: Post https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/03/07 19:08:16 logging in as test-app-4-5be44c04-5/service_account/test-app-summon-init.
2019/03/07 19:08:16 making login request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/login
INFO: 2019/03/07 19:08:16 main.go:94: authenticating as test-app-4-5be44c04-5/service_account/test-app-summon-init ...
2019/03/07 19:08:16 making authn request to https://conjur-follower.conjur-4-5be44c04-5-test.svc.cluster.local/api/authn-k8s/conjur-4-5be44c04-5-test/users/test-app-4-5be44c04-5%2Fservice_account%2Ftest-app-summon-init/authenticate
INFO: 2019/03/07 19:08:17 main.go:97: valid authentication response
2019/03/07 19:08:17 successfully authenticated.