Add integration tests for the remote inference feature (#1073)

* Add remote inference integration tests for OpenAI and Cohere

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Change edits model test

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Change loop number in edits test

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Change edits model test again

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Fix spotless

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Refactoring

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Fix typo

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Remove env vars

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

* Removing unnecessary comments

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Rebase with 2.x and remove set up for master key

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Remove print line

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Add throttling check

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Minor change for assert statement

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Test changes

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Uncomment delete connector test

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

---------

Signed-off-by: Ryan Bogan <rbogan@amazon.com>
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Co-authored-by: Peter Zhu <zhujiaxi@amazon.com>

.github/workflows/CI-workflow.yml

@@ -35,7 +35,6 @@ jobs:
           role-to-assume: ${{ secrets.ML_ROLE }}
           aws-region: us-west-2
 
-      # ml-commons
       - name: Checkout MLCommons
         uses: actions/checkout@v2