Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: bigcode-project/bigcodebench
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.2.4
Choose a base ref
...
head repository: bigcode-project/bigcodebench
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.2.5
Choose a head ref
  • 17 commits
  • 13 files changed
  • 1 contributor

Commits on Feb 25, 2025

  1. feat: support anthropic extended thinking

    @terryyz
    terryyz committed Feb 25, 2025
    Configuration menu
    Copy the full SHA
    8930906 View commit details
    Browse the repository at this point in the history

  2. fix: remove unused args

    @terryyz
    terryyz committed Feb 25, 2025
    Configuration menu
    Copy the full SHA
    c05694c View commit details
    Browse the repository at this point in the history

  3. fix: correctly process anthropic treaming

    @terryyz
    terryyz committed Feb 25, 2025
    Configuration menu
    Copy the full SHA
    57eb973 View commit details
    Browse the repository at this point in the history

  4. fix: only append text output

    @terryyz
    terryyz committed Feb 25, 2025
    Configuration menu
    Copy the full SHA
    78dceb2 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2025

  1. doc: fix endpoints

    @terryyz
    terryyz committed Mar 2, 2025
    Configuration menu
    Copy the full SHA
    05b7f1f View commit details
    Browse the repository at this point in the history

  2. update the results analysis script

    @terryyz
    terryyz committed Mar 2, 2025
    Configuration menu
    Copy the full SHA
    0ecd667 View commit details
    Browse the repository at this point in the history

  3. doc: add new model outputs

    @terryyz
    terryyz committed Mar 2, 2025
    Configuration menu
    Copy the full SHA
    f087e3b View commit details
    Browse the repository at this point in the history

  4. feat: support vllm lora

    @terryyz
    terryyz committed Mar 2, 2025
    Configuration menu
    Copy the full SHA
    6d96733 View commit details
    Browse the repository at this point in the history

  5. fix: vllm lora attribute

    @terryyz
    terryyz committed Mar 2, 2025
    Configuration menu
    Copy the full SHA
    82fc40d View commit details
    Browse the repository at this point in the history

  6. fix: customize lora output file

    @terryyz
    terryyz committed Mar 2, 2025
    Configuration menu
    Copy the full SHA
    d37847d View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2025

  1. feat: add model release date

    @terryyz
    terryyz committed Mar 24, 2025
    Configuration menu
    Copy the full SHA
    fa21527 View commit details
    Browse the repository at this point in the history

  2. fix: remove vllm max length

    @terryyz
    terryyz committed Mar 24, 2025
    Configuration menu
    Copy the full SHA
    5f0743d View commit details
    Browse the repository at this point in the history

  3. fix: hardcode the model max length for vllm

    @terryyz
    terryyz committed Mar 24, 2025
    Configuration menu
    Copy the full SHA
    3513d99 View commit details
    Browse the repository at this point in the history

  4. fix model metadata

    @terryyz
    terryyz committed Mar 24, 2025
    Configuration menu
    Copy the full SHA
    00fc9bb View commit details
    Browse the repository at this point in the history

  5. feat: add max_model_len for vllm

    @terryyz
    terryyz committed Mar 24, 2025
    Configuration menu
    Copy the full SHA
    720681b View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2025

  1. update model metadata

    @terryyz
    terryyz committed Mar 31, 2025
    Configuration menu
    Copy the full SHA
    c9e2cbb View commit details
    Browse the repository at this point in the history

  2. feat: use google genai

    @terryyz
    terryyz committed Mar 31, 2025
    Configuration menu
    Copy the full SHA
    9bd90fe View commit details
    Browse the repository at this point in the history
Loading