Commits

Branch selector

 main

User selector

DocShotgun

Datepicker

All time

Commit History

Commits on Jun 18, 2024

• Dependencies: Fix AMD triton (theroyallab#139)

  DocShotgun

  authored
  107436f

  Copy full SHA for 107436f

Commits on Jun 12, 2024

• Fix disabling flash attention in exl2 config (theroyallab#136)

  Show description for 85387d9
  DocShotgun

  authored
  85387d9

  Copy full SHA for 85387d9

Commits on Jun 9, 2024

• Revision to paged attention checks (theroyallab#133)

  Show description for 156b74f
  DocShotgun

  authored
  156b74f

  Copy full SHA for 156b74f

• Update dependencies, support Python 3.12, update for exl2 0.1.5 (theroyallab#134)

  Show description for 55d979b
  DocShotgun

  authored
  55d979b

  Copy full SHA for 55d979b

Commits on Jun 5, 2024

• Model: Warn if cache size is too small for CFG (theroyallab#132)

  DocShotgun

  authored
  dcd9428

  Copy full SHA for dcd9428

• More extensive checks for paged mode support (theroyallab#121)

  Show description for e391d84
  DocShotgun

  authored
  e391d84

  Copy full SHA for e391d84

Commits on May 27, 2024

• Tree: Lint

  DocShotgun

  committed
  7084081

  Copy full SHA for 7084081

• Logging: Clarify new vs cached tokens in prompt processing

  DocShotgun

  committed
  ce5e2ec

  Copy full SHA for ce5e2ec

Commits on May 26, 2024

• Tree: Format

  DocShotgun

  committed
  7ab7ffd

  Copy full SHA for 7ab7ffd

• API + Model: Add support for specifying k/v cache size

  DocShotgun

  committed
  767e6a7

  Copy full SHA for 767e6a7

Commits on May 13, 2024

• API + Model: Add support for regex pattern constraints

  Show description for abe411c
  DocShotgun

  committed
  abe411c

  Copy full SHA for abe411c

Commits on May 12, 2024

• Samplers: Add example override for generate_window

  DocShotgun

  committed
  dad3423

  Copy full SHA for dad3423

• Samplers: Minor fixes for sampler override

  Show description for 9463ecf
  DocShotgun

  committed
  9463ecf

  Copy full SHA for 9463ecf

Commits on May 10, 2024

• API: Add banned_strings

  Show description for c0b631b
  DocShotgun

  committed
  c0b631b

  Copy full SHA for c0b631b

• API: Add min_tokens

  Show description for a1df226
  DocShotgun

  committed
  a1df226

  Copy full SHA for a1df226

Commits on Mar 2, 2024

• Additional clarification for override_base_seq_len

  DocShotgun

  authored
  8245488

  Copy full SHA for 8245488

Commits on Dec 22, 2023

• Colab: Expose new config arguments

  DocShotgun

  authored
  7967607

  Copy full SHA for 7967607

Commits on Dec 9, 2023

• Implement lora support (theroyallab#24)

  Show description for 7380a3b
  

  DocShotgun

  and

  bdashore3

  committed
  7380a3b

  Copy full SHA for 7380a3b

Commits on Dec 6, 2023

• Add fallback to draft_rope_scale to 1.0

  DocShotgun

  authored
  3f2fcbc

  Copy full SHA for 3f2fcbc

Commits on Dec 5, 2023

• Expose draft_rope_scale

  DocShotgun

  authored
  39f7a2a

  Copy full SHA for 39f7a2a

• Update colab, expose additional args

  Show description for 6750710
  DocShotgun

  authored
  6750710

  Copy full SHA for 6750710

Commits on Dec 3, 2023

• Add Colab example

  Show description for 2a9e4ca
  

  DocShotgun

  authored and

  bdashore3

  committed
  2a9e4ca

  Copy full SHA for 2a9e4ca

• Force auto-alpha to 1.0 if config ctx == base ctx

  DocShotgun

  authored
  bd2c5d0

  Copy full SHA for bd2c5d0

• Add automatic NTK-aware alpha scaling to model

  Show description for 1c398b0
  DocShotgun

  authored
  1c398b0

  Copy full SHA for 1c398b0

Commits on Nov 24, 2023

• Add start-up shell script for Linux

  Show description for cffd20f
  DocShotgun

  authored
  cffd20f

  Copy full SHA for cffd20f