Skip to content

Tags: ShishirPatil/gorilla

Tags

v1.1

Toggle v1.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[BFCL] Relocate Formatting Instructions and Function Documentation to…

… System Prompt (#593)

Previously, formatting instructions and function documentation were
included in the user prompt when interacting with models in prompting
mode. However, these details are better suited for the system prompt,
where they can more effectively guide the model's behaviour. This PR
updates the model prompting process by moving the formatting
instructions and function documentation to the system prompt, ensuring
they are appropriately positioned for optimal model performance.

This **will affect** the leaderboard score.

----

Also in this PR:

1. Update the model handlers to record the processed prompt/message and
tools (if FC mode) in the result file when inference. This helps to
identify if there are any issues with the pre-processing phase.
2. Fix 6 dataset issues: `irrelevance_49, live_irrelevance_157-18-1,
live_simple_79-40-0, live_parallel_0-0-0, live_parallel_4-1-0,
live_parallel_5-2-0`

v1.0

Toggle v1.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[BFCL Chore] Fix Functionary Medium 3.1 model name & add readme paral…

…lel inference (#577)

Changes:
- Fix Functionary Medium 3.1 model version name in
`eval_runner_helper.py`
- add readme parallel inference

---------

Co-authored-by: Huanzhi (Hans) Mao <huanzhimao@gmail.com>

v0.3

Toggle v0.3's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fix breaking changes due to updated Anthropic SDK (#452)

Anthropic just moved their tool use from beta to main so we have to
change the import `from anthropic.types.beta.tools import ToolUseBlock`
to `from anthropic.types import ToolUseBlock`. You cannot run the eval
without this change as things break.

Also, my IDE automatically sorted the imported packages and removed some
extra spaces -- this explains all the other changes.

v0.2

Toggle v0.2's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Correction in BFCL README instruction, fixed path in instructions (#329)

- Corrected a legacy path to be consistent in
berkeley-function-call-leaderboard folder README instruction.

v0.1

Toggle v0.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Update project roadmap and repository structure (#257)

Updating stale project roadmap to also include Openfunctions effort and
Berkeley Function Calling Leaderboard

v0.0.1

Toggle v0.0.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Update README about gorilla-cli release (#57)

https://github.com/gorilla-llm/gorilla-cli