Commits

Branch selector

 master

User selector

rgerganov

Datepicker

All time

Commit History

Commits on Feb 4, 2025

• arg : list RPC devices first when using --list-devices (#11655)

  Show description for 1bef571
  rgerganov

  authored
  1bef571

  Copy full SHA for 1bef571

Commits on Jan 21, 2025

• rpc : better caching of the base buffer pointer (#11331)

  Show description for 6da5bec
  rgerganov

  authored
  6da5bec

  Copy full SHA for 6da5bec

Commits on Jan 17, 2025

• rpc : early register backend devices (#11262)

  Show description for 667d728
  rgerganov

  authored
  667d728

  Copy full SHA for 667d728

Commits on Jan 13, 2025

• ggml : do not define GGML_USE_CUDA when building with GGML_BACKEND_DL (#11211)

  Show description for 1244cdc
  rgerganov

  authored
  1244cdc

  Copy full SHA for 1244cdc

Commits on Jan 8, 2025

• ggml : allow loading backend with env variable (ggml/1059)

  Show description for c792dcf
  

  rgerganov

  authored and

  ggerganov

  committed
  c792dcf

  Copy full SHA for c792dcf

Commits on Jan 7, 2025

• rpc : code cleanup (#11107)

  Show description for a4dd490
  rgerganov

  authored
  a4dd490

  Copy full SHA for a4dd490

Commits on Dec 23, 2024

• rpc-server : add support for the SYCL backend (#10934)

  rgerganov

  authored
  86bf31c

  Copy full SHA for 86bf31c

Commits on Oct 21, 2024

• rpc : pack only RPC structs (#9959)

  rgerganov

  authored
  d5ebd79

  Copy full SHA for d5ebd79

Commits on Oct 18, 2024

• rpc : backend refactoring (#9912)

  Show description for afd9909
  rgerganov

  authored
  afd9909

  Copy full SHA for afd9909

Commits on Oct 3, 2024

• rpc : enable vulkan (#9714)

  Show description for 841713e
  rgerganov

  authored
  841713e

  Copy full SHA for 841713e

Commits on Oct 2, 2024

• vulkan : do not use tensor->extra (#9407)

  Show description for 00b7317
  

  rgerganov

  and

  0cc4m

  authored
  00b7317

  Copy full SHA for 00b7317

Commits on Sep 9, 2024

• rpc : fix segfault with nkvo (#9389)

  Show description for 293bebe
  

  rgerganov

  and

  slaren

  authored
  293bebe

  Copy full SHA for 293bebe

• rpc : update README [no ci] (#9320)

  Show description for 54f376d
  rgerganov

  authored
  54f376d

  Copy full SHA for 54f376d

Commits on Sep 4, 2024

• rpc : make RPC servers come first in the device list (#9296)

  Show description for 82e3b03
  rgerganov

  authored
  82e3b03

  Copy full SHA for 82e3b03

Commits on Aug 19, 2024

• rpc : print error message when failed to connect endpoint (#9042)

  rgerganov

  authored
  1b6ff90

  Copy full SHA for 1b6ff90

• rpc : prevent crashes on invalid input (#9040)

  Show description for 18eaf29
  rgerganov

  authored
  18eaf29

  Copy full SHA for 18eaf29

Commits on Aug 12, 2024

• ci : enable RPC in all of the released builds (#9006)

  Show description for 1f67436
  rgerganov

  authored
  1f67436

  Copy full SHA for 1f67436

Commits on Jun 14, 2024

• llama-bench : fix RPC indication (#7936)

  Show description for e65bbf6
  rgerganov

  authored
  e65bbf6

  Copy full SHA for e65bbf6

Commits on Jun 13, 2024

• rpc : fix ggml_backend_rpc_supports_buft() (#7918)

  rgerganov

  authored
  172c825

  Copy full SHA for 172c825

Commits on Jun 3, 2024

• llama : offload to RPC in addition to other backends (#7640)

  Show description for bde7cd3
  

  rgerganov

  and

  slaren

  authored
  bde7cd3

  Copy full SHA for bde7cd3

Commits on May 29, 2024

• llama-bench : add support for the RPC backend (#7435)

  rgerganov

  authored
  210d991

  Copy full SHA for 210d991

Commits on May 28, 2024

• rpc : resource management rework (#7562)

  Show description for 2b737ca
  rgerganov

  authored
  2b737ca

  Copy full SHA for 2b737ca

Commits on May 20, 2024

• rpc : track allocated buffers (#7411)

  Show description for db10f01
  rgerganov

  authored
  db10f01

  Copy full SHA for db10f01

Commits on May 17, 2024

• rpc : set SO_REUSEADDR for the server socket (#7320)

  Show description for f4bd8b3
  rgerganov

  authored
  f4bd8b3

  Copy full SHA for f4bd8b3

• server : add support for the RPC backend (#7305)

  Show description for ee94172
  rgerganov

  authored
  ee94172

  Copy full SHA for ee94172

Commits on May 16, 2024

• rpc : get available mem for the CPU backend

  Show description for 9afdffe
  rgerganov

  committed
  9afdffe

  Copy full SHA for 9afdffe

• rpc : add command line arg for specifying backend memory

  Show description for 3b3963c
  rgerganov

  committed
  3b3963c

  Copy full SHA for 3b3963c

Commits on May 14, 2024

• ggml : add RPC backend (#6829)

  Show description for 5e31828
  rgerganov

  authored
  5e31828

  Copy full SHA for 5e31828

Commits on Mar 14, 2023

• Add section to README on how to run the project on Android (#130)

  rgerganov

  authored
  60f819a

  Copy full SHA for 60f819a