Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 6, 2024

• Config + Model: Allow for default fallbacks from config for model loads

  Show description for 27d2d5f
  bdashore3

  committed
  27d2d5f

Commits on Jun 9, 2024

• Update dependencies, support Python 3.12, update for exl2 0.1.5 (theroyallab#134)

  Show description for 55d979b
  DocShotgun

  authored
  55d979b

Commits on May 27, 2024

• Config: Change cache_size description and location

  Show description for bec919e
  bdashore3

  committed
  bec919e

Commits on May 26, 2024

• API + Model: Add support for specifying k/v cache size

  DocShotgun

  committed
  767e6a7

• Model: Change FA2 and paged attention checks

  Show description for 408c66a
  bdashore3

  committed
  408c66a

Commits on Apr 7, 2024

• Model: Fix chunk size handling

  Show description for d759a15
  bdashore3

  committed
  d759a15

• Templates: Support list style chat_template keys

  Show description for 46ac3be
  bdashore3

  committed
  46ac3be

Commits on Mar 17, 2024

• Config: Update description part 2

  Show description for 08bcc63
  bdashore3

  committed
  08bcc63

• Config: Update Q4 in comments

  Show description for 7abbac0
  bdashore3

  committed
  7abbac0

Commits on Mar 2, 2024

• Additional clarification for override_base_seq_len

  DocShotgun

  authored
  8245488

Commits on Feb 15, 2024

• Config: Add experimental torch cuda malloc backend

  Show description for 949248f
  bdashore3

  committed
  949248f

Commits on Feb 9, 2024

• Config: Expose auto GPU split reserve config

  Show description for 2f568ff
  bdashore3

  committed
  2f568ff

Commits on Feb 8, 2024

• Config: Add option to force streaming off

  Show description for 58590a6
  bdashore3

  committed
  58590a6

Commits on Feb 7, 2024

• Model: Auto-detect a one GPU setup and fix gpu_split_auto

  Show description for c0ad647
  bdashore3

  committed
  c0ad647

• Model: Make loading use less VRAM

  Show description for 849179d
  bdashore3

  committed
  849179d

Commits on Feb 3, 2024

• Launch: Make exllamav2 requirement more friendly

  Show description for 1919bf7
  bdashore3

  committed
  1919bf7

Commits on Jan 25, 2024

• API + Model: Add new parameters and clean up documentation

  Show description for fc45702
  bdashore3

  committed
  fc45702

• Tree: Unify sampler parameters and add override support

  Show description for 6c30f24
  bdashore3

  committed
  6c30f24

Commits on Jan 2, 2024

• API: Fix CFG reporting

  Show description for 6b04463
  bdashore3

  committed
  6b04463

• Model: Add CFG support

  Show description for b378773
  bdashore3

  committed
  b378773

Commits on Dec 29, 2023

• Config: Make the sample a drop-in solution

  Show description for 4136f19
  bdashore3

  committed
  4136f19

• Model: Read scale_pos_emb from config

  Show description for ec92972
  bdashore3

  committed
  ec92972

Commits on Dec 28, 2023

• Config: Default None -> Empty in comments

  Show description for c72d309
  bdashore3

  committed
  c72d309

• API: Fix num_experts_per_token reporting

  Show description for 3622710
  bdashore3

  committed
  3622710

Commits on Dec 22, 2023

• Auth: Add option to disable authentication

  Show description for 8fa764b
  bdashore3

  committed
  8fa764b

• Config: Change default dirs in sample

  Show description for 72e19db
  bdashore3

  committed
  72e19db

Commits on Dec 21, 2023

• Config: Clarify rope parameters

  Show description for bee758d
  bdashore3

  committed
  bee758d

Commits on Dec 20, 2023

• Model: Add override base seq len

  Show description for ab10b26
  bdashore3

  committed
  ab10b26

• Model: Fix max seq len handling

  Show description for ce2602d
  bdashore3

  committed
  ce2602d

Commits on Dec 19, 2023

• Templating: Add generation prompt appending

  Show description for de9a19b
  bdashore3

  committed
  de9a19b

• Templates: Switch to Jinja2

  Show description for f631dd6
  bdashore3

  committed
  f631dd6

Commits on Dec 17, 2023

• Model: Add support for num_experts_by_token

  Show description for ad8807a
  bdashore3

  committed
  ad8807a

Commits on Dec 13, 2023

• Tree: Add generation logging support

  Show description for 083df7d
  bdashore3

  committed
  083df7d

Commits on Dec 10, 2023

• OAI: Add ability to specify fastchat prompt template

  Show description for db87efd
  bdashore3

  committed
  db87efd

Commits on Dec 9, 2023

• Implement lora support (theroyallab#24)

  Show description for 7380a3b
  

  DocShotgun

  and

  bdashore3

  committed
  7380a3b

Pagination

PreviousNext