[CHAT] Refactor ChatGPTProvider to use openai-java client

[bowenliang123]

Why are the changes needed?

• use Java SDK openai-java for ChatGPT which is popular and listed in official website, https://github.com/TheoKanning/openai-java
• Focus on lifecycle in ChatGPTProvider, and prevent handling lower-level concepts in details, like POJO mapping, HTTP request handling.
• follow the changes from upstream changes from OpenAI

How was this patch tested?

• Add some test cases that check the changes thoroughly including negative and positive cases if possible

• Add screenshots for manual tests if appropriate

• Run test locally before make a pull request

[codecov-commenter]

Codecov Report

Merging #4556 (ecf1e2c) into master (06e69dd) will decrease coverage by 0.04%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #4556      +/-   ##
============================================
- Coverage     53.30%   53.26%   -0.04%     
  Complexity       13       13              
============================================
  Files           573      573              
  Lines         31493    31493              
  Branches       4237     4237              
============================================
- Hits          16786    16776      -10     
- Misses        13128    13135       +7     
- Partials       1579     1582       +3     

see 7 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[pan3793]

Please check the following things:

• it introduces new deps into Kyuubi binary tarball, thus LICENSE-binary and NOTICE-binary should be updated
• the backend of retrofit should be okhttp, please make sure it does not create no-daemon threads which may block engine shutdown.

[pan3793]

let's make it configurable in next PR :)

[bowenliang123]

Sure. Make it configurable of other ChatCompletionRequest settings like model name, max tokens, etc.

[pan3793]

I remember that okhttp provides a mock server module for testing, we can add UT then.

[bowenliang123]

Please check the following things:

• it introduces new deps into Kyuubi binary tarball, thus LICENSE-binary and NOTICE-binary should be updated
• the backend of retrofit should be okhttp, please make sure it does not create no-daemon threads which may block engine shutdown.

How can I update the LICENSE-binary and NOTICE-binary, in manual way or auto-collect by tools?

[bowenliang123]

I remember that okhttp provides a mock server module for testing, we can add UT then.

Shall we do the ut in the next PR ?

[pan3793]

How can I update the LICENSE-binary and NOTICE-binary, in manual way or auto-collect by tools?

Currently, we should update them manually, we haven't found a tool smart enough to automatically process them.

[pan3793]

I remember that okhttp provides a mock server module for testing, we can add UT then.

Shall we do the ut in the next PR ?

it's fine.

[pan3793]

LGTM, linked in #4549

[bowenliang123]

Locally tested with the packaged tarball. Works properly as before refactoring, with - message history in the context of session - HTTP proxy

[bowenliang123]

Thanks, merged to master.