Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BFCL] Add ability to evaluate Nemotron-4-340B-Instruct #489

Merged
merged 3 commits into from
Jul 5, 2024

Conversation

Fanjia-Yan
Copy link
Contributor

This PR will add ability to inference on Nemotron via Nvidia NIM. It's open source and hosted by Nvidia without specifying the price per inference call. Therefore, no cost per thousand function calls will be recorded. Model result will be updated in a separate PR.

rm delete
Copy link
Collaborator

@HuanzhiMao HuanzhiMao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ShishirPatil ShishirPatil merged commit 897e068 into ShishirPatil:main Jul 5, 2024
ShishirPatil pushed a commit that referenced this pull request Jul 7, 2024
…491)

This PR adds Nemotron-4-340b-insturct #489 to leaderboard via prompting.
This PR will change leaderboard ranking.

---------

Co-authored-by: CharlieJCJ <charliechengjieji@berkeley.edu>
Co-authored-by: Huanzhi Mao <huanzhimao@gmail.com>
devanshamin pushed a commit to devanshamin/gorilla that referenced this pull request Jul 9, 2024
…#489)

This PR will add ability to inference on Nemotron via Nvidia NIM. It's
open source and hosted by Nvidia without specifying the price per
inference call. Therefore, no cost per thousand function calls will be
recorded. Model result will be updated in a separate PR.

---------

Co-authored-by: CharlieJCJ <charliechengjieji@berkeley.edu>
Co-authored-by: Huanzhi (Hans) Mao <huanzhimao@gmail.com>
aw632 pushed a commit to vinaybagade/gorilla that referenced this pull request Aug 22, 2024
…#489)

This PR will add ability to inference on Nemotron via Nvidia NIM. It's
open source and hosted by Nvidia without specifying the price per
inference call. Therefore, no cost per thousand function calls will be
recorded. Model result will be updated in a separate PR.

---------

Co-authored-by: CharlieJCJ <charliechengjieji@berkeley.edu>
Co-authored-by: Huanzhi (Hans) Mao <huanzhimao@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants