Commits

Breadcrumbs

History for

on260b7c6

User selector

All users

Datepicker

All time

Commit History

Commits on May 7, 2024

• server : update readme with undocumented options (#7013)

  K-Mistele

  authored
  260b7c6

Commits on Apr 29, 2024

• build(cmake): simplify instructions (cmake -B build && cmake --build build ...) (#6964)

  Show description for b8a7a5a
  

  3 peopleauthored
  b8a7a5a

Commits on Apr 12, 2024

• JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)

  Show description for ab9a324
  ochafik

  authored
  ab9a324

Commits on Apr 8, 2024

• llama : save and restore kv cache for single seq id (#6341)

  Show description for beea6e1
  

  3 peopleauthored
  beea6e1

Commits on Apr 4, 2024

• server : remove obsolete --memory-f32 option

  ggerganov

  committed
  4399f13

Commits on Apr 3, 2024

• A few small fixes to server's README docs (#6428)

  Show description for 5fb1574
  fat-tire

  authored
  5fb1574

Commits on Mar 26, 2024

• cuda : rename build flag to LLAMA_CUDA (#6299)

  slaren

  authored
  2803459

Commits on Mar 25, 2024

• Server: clean up OAI params parsing function (#6284)

  Show description for ad3a050
  ngxson

  authored
  ad3a050

Commits on Mar 23, 2024

• common: llama_load_model_from_url split support (#6192)

  Show description for f482bb2
  

  phymbert

  and

  ggerganov

  authored
  f482bb2

• server: docs: --threads and --threads, --ubatch-size, --log-disable (#6254)

  phymbert

  authored
  1997577

Commits on Mar 21, 2024

• server : update readme doc from slot_id to id_slot (#6213)

  kaetemi

  authored
  be07a03

Commits on Mar 17, 2024

• common: llama_load_model_from_url using --model-url (#6098)

  Show description for d01b3c4
  

  phymbert

  and

  ggerganov

  authored
  d01b3c4

Commits on Mar 11, 2024

• Update server docker image URLs (#5997)

  GetTuh

  authored
  828defe

• Server: format error to json (#5961)

  Show description for caa106d
  ngxson

  authored
  caa106d

Commits on Mar 9, 2024

• server : clarify some items in the readme (#5957)

  Show description for 97c0958
  ggerganov

  authored
  97c0958

• Server: reorganize some http logic (#5939)

  Show description for 950ba1a
  ngxson

  authored
  950ba1a

• server : add SSL support (#5926)

  Show description for e1fa956
  gabe-l-hart

  authored
  e1fa956

Commits on Mar 7, 2024

• server : refactor (#5882)

  Show description for 2002bc9
  

  ggerganov

  and

  phymbert

  authored
  2002bc9

Commits on Mar 3, 2024

• server : init http requests thread pool with --parallel if set (#5836)

  phymbert

  authored
  8ef969a

Commits on Mar 1, 2024

• server : remove api_like_OAI.py proxy script (#5808)

  ggerganov

  authored
  38d16b1

• server: allow to override threads server pool with --threads-http (#5794)

  phymbert

  authored
  5cb02b4

Commits on Feb 25, 2024

• server: docs - refresh and tease a little bit more the http server (#5718)

  Show description for 8b35035
  

  phymbert

  and

  ggerganov

  authored
  8b35035

• server: logs - unified format and --log-format option (#5700)

  Show description for 930b178
  

  phymbert

  and

  ggerganov

  authored
  930b178

• server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708)

  Show description for d52d781
  phymbert

  authored
  d52d781

Commits on Feb 24, 2024

• server: init functional tests (#5566)

  Show description for 525213d
  

  phymbert

  and

  ggerganov

  authored
  525213d

Commits on Feb 22, 2024

• server : clarify some params in the docs (#5640)

  z80maniac

  authored
  c5688c6

Commits on Feb 21, 2024

• Add docs for llama_chat_apply_template (#5645)

  Show description for 7c8bcc1
  ngxson

  authored
  7c8bcc1

• server: health: fix race condition on slots data using tasks queue (#5634)

  Show description for 1ecea25
  phymbert

  authored
  1ecea25

Commits on Feb 20, 2024

• server : health endpoint configurable failure on no slot (#5594)

  phymbert

  authored
  c0a8c6d

Commits on Feb 18, 2024

• common, server : surface min_keep as its own parameter (#5567)

  Show description for 5ee99c3
  robeyh

  authored
  5ee99c3

• server : slots monitoring endpoint (#5550)

  phymbert

  authored
  c145f8a

• server : enhanced health endpoint (#5548)

  Show description for e75c627
  phymbert

  authored
  e75c627

• server : --n-predict option document and cap to max value (#5549)

  Show description for 36376ab
  phymbert

  authored
  36376ab

Commits on Feb 16, 2024

• server : add "samplers" param to control the samplers order (#5494)

  z80maniac

  authored
  6dcc02d

• ggml : add numa options (#5377)

  Show description for f486f6e
  

  4 peopleauthored
  f486f6e

Pagination

PreviousNext