Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: algorithmicsuperintelligence/optillm
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.0.9
Choose a base ref
...
head repository: algorithmicsuperintelligence/optillm
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.0.10
Choose a head ref
  • 16 commits
  • 4 files changed
  • 2 contributors

Commits on Nov 7, 2024

  1. fix msg

    @femto
    femto committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    3cfe9f3 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #88 from femto/fix_msg 

    fix msg
    @codelion
    codelion authored Nov 7, 2024
    Configuration menu
    Copy the full SHA
    476719c View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. initial implementation 

    - allow loading any model from hf and any lora adapter
- support caching
- support batchs
- support optimized attention
- add dynamic temperature
    @codelion
    codelion committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    23e48ef View commit details
    Browse the repository at this point in the history

  2. return logprobs and toplogprobs 

    add support for logprobs
    @codelion
    codelion committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    60a84ef View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2024

  1. Update README.md

    @codelion
    codelion authored Nov 9, 2024
    Configuration menu
    Copy the full SHA
    08cdffd View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @codelion
    codelion authored Nov 9, 2024
    Configuration menu
    Copy the full SHA
    87c5f3a View commit details
    Browse the repository at this point in the history

  3. Add none approach 

    fix logprobs return
    @codelion
    codelion committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    2c66fc2 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat-add-local-inference' of https://github.com/codelio… 

    …n/optillm into feat-add-local-inference
    @codelion
    codelion committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    9c2426a View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2024

  1. Update README.md

    @codelion
    codelion authored Nov 10, 2024
    Configuration menu
    Copy the full SHA
    795556f View commit details
    Browse the repository at this point in the history

  2. Update inference.py 

    fix multiple loras loading and setting of adapters
    @codelion
    codelion committed Nov 10, 2024
    Configuration menu
    Copy the full SHA
    26030d0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat-add-local-inference' of https://github.com/codelio… 

    …n/optillm into feat-add-local-inference
    @codelion
    codelion committed Nov 10, 2024
    Configuration menu
    Copy the full SHA
    24b559d View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. add support for cot_decoding and entropy_decoding in local inference … 

    …server
    @codelion
    codelion committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    e6d61b1 View commit details
    Browse the repository at this point in the history

  2. Aggregate paths in cot decoding by default

    @codelion
    codelion committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    6a3ffa7 View commit details
    Browse the repository at this point in the history

  3. Update README.md

    @codelion
    codelion authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3ff58a3 View commit details
    Browse the repository at this point in the history

  4. Update setup.py 

    bump version for new release
    @codelion
    codelion committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ad90fd8 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #89 from codelion/feat-add-local-inference 

    Feat add local inference
    @codelion
    codelion authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    7381008 View commit details
    Browse the repository at this point in the history
Loading