[FEATURE] Support for timeout in http connector

[austintlee]

Is your feature request related to a problem?
Occasionally, a request to OpenAI just sits for 10 minutes and fails with a "bad gateway" error.

What solution would you like?
I would like to specify the maximum amount of time an http connector should wait before it cancels a request.

What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.

Do you have any additional context?
Add any other context or screenshots about the feature request here.

[ylwu-amzn]

@zane-neo , Zan, since you built the http client factory, can you give some suggestion/solution for this?

[ylwu-amzn]

@zane-neo as you find other http client perfromance issue, can you create issue for tracking that?

[zane-neo]

@zane-neo , Zan, since you built the http client factory, can you give some suggestion/solution for this?

I think we can let user configure these, including: connection timeout, read timeout, connection pool size etc, I will create a PR to address this.

[zane-neo]

@zane-neo as you find other http client perfromance issue, can you create issue for tracking that?

Found it here: #1537

[austintlee]

#1835

[ylwu-amzn]

Done in this PR #1835