Speech fails when using 0.17.1-alpha google-cloud library

[lesv]

If I upgrade to 0.17.1-alpha weird stuff happens.

@gguuss Is this something you did? Very strange errors from gax.

Vision appears to have similar issues

[gguuss]

I didn't see anything similar, in the PR I made last night / this morning, I'm not seeing any issues, all tests pass.