Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
81 commits
Select commit Hold shift + click to select a range
880f579
llama : fix integer overflow during quantization (#4284)
ggerganov Dec 1, 2023
37c746d
llama : add Qwen support (#4281)
simonJJJ Dec 1, 2023
03562f3
llama : support attention bias on LLaMA architecture (#4283)
RealJosephus Dec 1, 2023
511f52c
build : enable libstdc++ assertions for debug builds (#4275)
cebtenzzre Dec 1, 2023
b220222
swift : fix token_to_piece implementation (#4278)
ensan-hcl Dec 1, 2023
d5a1cbd
llama : support optional tensors (#4283)
ggerganov Dec 1, 2023
5a7d312
llama : avoid using "optional" keyword (#4283)
ggerganov Dec 1, 2023
6570a20
token count includes ids
LostRuins Dec 3, 2023
d7b800b
llama : pad KV cache size (#4280)
ggerganov Dec 3, 2023
6949b50
py : add grammar to oai like api (#4294)
neph1 Dec 3, 2023
33e171d
server : fix OpenAI API `stop` field to be optional (#4299)
Mardak Dec 3, 2023
48544cd
Revert "Revert "ggml : add ggml_soft_max_ext (#4256)""
LostRuins Dec 3, 2023
adf3de4
ggml : fix soft max out-of-bounds access (#4307)
ggerganov Dec 3, 2023
ac36aee
Merge branch 'master' into concedo_experimental
LostRuins Dec 3, 2023
fbbc428
ggml : reuse ggml_get_n_tasks() in ggml_graph_plan() (#4308)
ggerganov Dec 3, 2023
8602f5a
Merge branch 'master' into concedo_experimental
LostRuins Dec 3, 2023
4fa44e8
grammar-parser : fix typo (#4318)
eltociear Dec 4, 2023
a5a5839
handle accidentally selecting a kcpps file as model instead
LostRuins Dec 4, 2023
5c9f90c
swift : fix prompt tokenization logic (#4321)
ensan-hcl Dec 4, 2023
d208995
swift : fix concatenation method to avoid invalid UTF8 stringfication…
ensan-hcl Dec 4, 2023
23b5e12
simple : update error message for KV cache check (#4324)
danbev Dec 4, 2023
e4b76bb
swift : revert compiler checks for swift package (#4332)
kchro3 Dec 5, 2023
52c8bc3
sampling : custom samplers order (#4285)
MaggotHATE Dec 5, 2023
b6f952f
improved exit logic
LostRuins Dec 5, 2023
5aa365d
llama : allow overriding GGUF metadata when loading model (#4092)
KerfuffleV2 Dec 5, 2023
5f6e0c0
grammar : pre-computed pieces + reserve mem + less string copies (#4330)
MarcusDunn Dec 5, 2023
da5eaef
speculative : support `--color` (#4343)
stduhpf Dec 6, 2023
caa9249
common : fix compile warning
ggerganov Dec 6, 2023
12002d8
very basic noscript mode
LostRuins Dec 6, 2023
c751152
noscript mode is done
LostRuins Dec 6, 2023
05cd6e5
server : recognize cache_prompt parameter in OAI API (#4347)
ggerganov Dec 6, 2023
81bc921
train : fix #4227 (double free in examples/train-text-from-scratch/tr…
casavaca Dec 7, 2023
bcc0eb4
llama : per-layer KV cache + quantum K cache (#4309)
ggerganov Dec 7, 2023
fe680e3
sync : ggml (new ops, tests, backend, etc.) (#4359)
ggerganov Dec 7, 2023
930cdfb
updated lite, added patch that links to noscript mode
LostRuins Dec 8, 2023
ec21fa7
Merge branch 'master' into concedo_experimental
LostRuins Dec 8, 2023
7469f20
use lowvram flag for offload qkv
LostRuins Dec 8, 2023
c47bc28
slight refactor for noscript ui
LostRuins Dec 8, 2023
7418bca
up ver
LostRuins Dec 8, 2023
7a69152
lowvram var defaults
LostRuins Dec 8, 2023
e18f734
grammar : revert the replacement of llama_token_to_piece with id_to_t…
AlienKevin Dec 9, 2023
e2cf3b7
koboldcpp.sh - The Mamba Multitool (#554)
henk717 Dec 10, 2023
8a7b2fa
Update README.md (#4388)
y10ab1 Dec 10, 2023
4b854d4
Hide hipBLAS (ROCm) if CuBLAS exists - vice versa
YellowRoseCx Dec 11, 2023
fce971d
do not build the clblast noavx2 binary if not on windows
LostRuins Dec 11, 2023
06581f2
perf endpoint lets you monitor if the embedded horde worker has issues
LostRuins Dec 11, 2023
74acc54
Revert "Hide hipBLAS (ROCm) if CuBLAS exists - vice versa"
LostRuins Dec 12, 2023
41a11aa
ggml : increased GGML_MAX_PARAMS to allow finetuning of 70b models (#…
Taikono-Himazin Dec 12, 2023
d9d4cfe
server : fix local model name in server (#4420)
epicfilemcnulty Dec 12, 2023
6391817
llama : document logits_all deprecation (#4418)
crasm Dec 12, 2023
6138963
build : target Windows 8 for standard mingw-w64 (#4405)
cebtenzzre Dec 12, 2023
9494d7c
english : use `typos` to fix comments and logs (#4354)
richardkiss Dec 12, 2023
fecac45
server : tweak default sampling parameters (#4367)
kalomaze Dec 12, 2023
4db9586
do not display the "maybe" MMQ console output
LostRuins Dec 13, 2023
c2c238b
Merge branch 'master' into concedo_experimental
LostRuins Dec 13, 2023
799a1cb
llama : add Mixtral support (#4406)
slaren Dec 13, 2023
113f994
readme : update hot topics
ggerganov Dec 13, 2023
9fb13f9
common : add `--version` option to show build info in CLI (#4433)
yusiwen Dec 13, 2023
e447af6
Merge branch 'master' into concedo_experimental
LostRuins Dec 13, 2023
2810151
update docs
LostRuins Dec 13, 2023
3067547
Koboldcpp.sh Fix & Nocuda (#562)
henk717 Dec 13, 2023
70f806b
build : detect host compiler and cuda compiler separately (#4414)
cebtenzzre Dec 13, 2023
4d98d9a
sync : ggml (SD ops, tests, kernels) (#4444)
ggerganov Dec 13, 2023
948ff13
server : fix handling of characters that span multiple tokens when st…
shibe2 Dec 13, 2023
ec2cf6c
Merge branch 'concedo' into concedo_experimental
LostRuins Dec 14, 2023
8dd9756
removing existing yml files
LostRuins Dec 14, 2023
146e3bb
Automatically generate Linux Binaries (#564)
henk717 Dec 14, 2023
0e31f53
Revert "lowvram var defaults"
LostRuins Dec 14, 2023
0353a18
readme : update supported model list (#4457)
BarfingLemurs Dec 14, 2023
1ad8f0d
Fixes "Not enough space in the context's memory pool" encountered on …
LostRuins Dec 14, 2023
873637a
convert : support loading vocab from fast tokenizer config (#3633)
strutive07 Dec 14, 2023
34b3dac
Fixes "Not enough space in the context's memory pool" encountered on …
LostRuins Dec 14, 2023
c88fc19
Merge branch 'master' into concedo_experimental
LostRuins Dec 14, 2023
55e87c3
ggml : fix OpenCL broadcast requirement for ggml_mul (close #4453)
ggerganov Dec 14, 2023
05f7db4
do not cast to size_t, instead just use doubles
LostRuins Dec 14, 2023
53bbd1e
Merge branch 'pr_fix_buf_resize_type' into concedo_experimental
LostRuins Dec 14, 2023
04bd895
Revert "Fixes "Not enough space in the context's memory pool" encount…
LostRuins Dec 14, 2023
f0de495
fixed length exceeding max ctx
LostRuins Dec 14, 2023
aac7f0b
Merge branch 'master' into concedo_experimental
LostRuins Dec 14, 2023
ae3d829
manual workflow for generating builds instead
LostRuins Dec 14, 2023
7798587
Workflow Build from experimental branch
LostRuins Dec 14, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .editorconfig
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,9 @@ indent_size = 4
[Makefile]
indent_style = tab

[scripts/*.mk]
indent_style = tab

[prompts/*.txt]
insert_final_newline = unset

Expand Down
184 changes: 0 additions & 184 deletions .github/ISSUE_TEMPLATE/bug.md

This file was deleted.

28 changes: 0 additions & 28 deletions .github/ISSUE_TEMPLATE/enhancement.md

This file was deleted.

36 changes: 0 additions & 36 deletions .github/workflows/code-coverage.yml

This file was deleted.

17 changes: 0 additions & 17 deletions .github/workflows/editorconfig.yml

This file was deleted.

44 changes: 0 additions & 44 deletions .github/workflows/gguf-publish.yml

This file was deleted.

32 changes: 32 additions & 0 deletions .github/workflows/kcpp-build-release.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
name: Koboldcpp Builder Linux

on: workflow_dispatch
env:
BRANCH_NAME: ${{ github.head_ref || github.ref_name }}

jobs:
linux:
runs-on: ubuntu-20.04
steps:
- name: Clone
id: checkout
uses: actions/checkout@v3
with:
ref: concedo_experimental

- name: Dependencies
id: depends
run: |
sudo apt-get update
sudo apt-get install git curl bzip2

- name: Build
id: make_build
run: |
./koboldcpp.sh dist

- name: Save artifact
uses: actions/upload-artifact@v3
with:
name: kcpp_linux_binary
path: dist/
20 changes: 0 additions & 20 deletions .github/workflows/python-lint.yml

This file was deleted.

20 changes: 0 additions & 20 deletions .github/workflows/tidy-post.yml

This file was deleted.

Loading