Commits

Branch selector

 refactor_vec_copy

User selector

All users

Datepicker

All time

Commit History

Commits on May 14, 2024

• delete copy_vector

  Courtesy-Xs

  committed
  30ea54f

  Copy full SHA for 30ea54f

• [Feat]Inference RPC Server Support (#5705)

  Show description for 18d67d0
  

  LRY89757

  and

  pre-commit-ci[bot]

  authored
  18d67d0

  Copy full SHA for 18d67d0

Commits on May 11, 2024

• [Inference]Adapt repetition_penalty and no_repeat_ngram_size (#5708)

  Show description for de4bf3d
  isky-cd

  authored
  de4bf3d

  Copy full SHA for de4bf3d

Commits on May 10, 2024

• [Inference/Feat] Add convert_fp8 op for fp8 test in the future (#5706)

  Show description for 50104ab
  Courtesy-Xs

  authored
  50104ab

  Copy full SHA for 50104ab

Commits on May 9, 2024

• [Inference/Feat] Add quant kvcache interface (#5700)

  Show description for bfad393
  Courtesy-Xs

  authored
  bfad393

  Copy full SHA for bfad393

• Merge pull request #5588 from hpcaitech/feat/online-serving

  Show description for 492520d
  CjhHa1

  authored
  492520d

  Copy full SHA for 492520d

• [Inference] Add example test_ci script

  CjhHa1

  committed
  5d9a494

  Copy full SHA for 5d9a494

Commits on May 8, 2024

• resolve rebase conflicts on Branch feat/online-serving

  CjhHa1

  committed
  bc9063a

  Copy full SHA for bc9063a

• [Inference] Fix bugs and docs for feat/online-server (#5598)

  Show description for 61a1b2e
  CjhHa1

  committed
  61a1b2e

  Copy full SHA for 61a1b2e

• [Inference] resolve rebase conflicts

  Show description for 7bbb28e
  CjhHa1

  committed
  7bbb28e

  Copy full SHA for 7bbb28e

• [Online Server] Chat Api for streaming and not streaming response (#5470)

  Show description for c064032
  CjhHa1

  committed
  c064032

  Copy full SHA for c064032

• [Inference] Finish Online Serving Test, add streaming output api, continuous batching test and example (#5432)

  Show description for de378cd
  CjhHa1

  committed
  de378cd

  Copy full SHA for de378cd

• [Inference] ADD async and sync Api server using FastAPI (#5396)

  Show description for 69cd7e0
  CjhHa1

  committed
  69cd7e0

  Copy full SHA for 69cd7e0

• [Inference] Support the logic related to ignoring EOS token (#5693)

  Show description for d482922
  isky-cd

  authored
  d482922

  Copy full SHA for d482922

• [Inference]Adapt temperature processing logic (#5689)

  Show description for 9c2fe79
  isky-cd

  authored
  9c2fe79

  Copy full SHA for 9c2fe79

• [hotfix] fix OpenMOE example import path (#5697)

  yuanheng-zhao

  authored
  12e7c28

  Copy full SHA for 12e7c28

• [Fix] Fix Inference Example, Tests, and Requirements (#5688)

  Show description for 55cc7f3
  yuanheng-zhao

  authored
  55cc7f3

  Copy full SHA for 55cc7f3

Commits on May 7, 2024

• [hotfix] Fix KV Heads Number Assignment in KVCacheManager (#5695)

  Show description for f9afe0a
  yuanheng-zhao

  authored
  f9afe0a

  Copy full SHA for f9afe0a

Commits on May 6, 2024

• [Inference/Feat] Add quant kvcache support for decode_kv_cache_memcpy (#5686)

  Courtesy-Xs

  authored
  1ace106

  Copy full SHA for 1ace106

• [Sync] Update from main to feature/colossal-infer (Merge pull request #5685)

  Show description for db7b305
  yuanheng-zhao

  authored
  db7b305

  Copy full SHA for db7b305

• [Inference] Remove unnecessary float4_ and rename float8_ to float8 (#5679)

  SunflowerAries

  authored
  725fbd2

  Copy full SHA for 725fbd2

Commits on May 5, 2024

• [Fix] Fix & Update Inference Tests (compatibility w/ main)

  yuanheng-zhao

  committed
  8754aba

  Copy full SHA for 8754aba

• [sync] resolve conflicts of merging main

  yuanheng-zhao

  committed
  56ed09a

  Copy full SHA for 56ed09a

Commits on May 3, 2024

• [kernel] Support New KCache Layout - Triton Kernel (#5677)

  Show description for 537a3cb
  

  yuanheng-zhao

  and

  pre-commit-ci[bot]

  authored
  537a3cb

  Copy full SHA for 537a3cb

Commits on Apr 30, 2024

• [Inference] Fix quant bits order (#5681)

  Courtesy-Xs

  authored
  9df016f

  Copy full SHA for 9df016f

• [inference]Add alibi to flash attn function (#5678)

  Show description for f799631
  isky-cd

  authored
  f799631

  Copy full SHA for f799631

• [Inference/Feat] Add kvcache quant support for fused_rotary_embedding_cache_copy (#5680)

  Courtesy-Xs

  authored
  ef8e4ff

  Copy full SHA for ef8e4ff

• [Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… (#5663)

  Show description for 5cd75ce
  SunflowerAries

  authored
  5cd75ce

  Copy full SHA for 5cd75ce

• [Inference] Adapt Baichuan2-13B TP (#5659)

  Show description for 5f00002
  isky-cd

  authored
  5f00002

  Copy full SHA for 5f00002

• [Inference/Feat] Feat quant kvcache step2 (#5674)

  Courtesy-Xs

  authored
  808ee6e

  Copy full SHA for 808ee6e

Commits on Apr 29, 2024

• [Shardformer] add assert for num of attention heads divisible by tp_size (#5670)

  Show description for d3f34ee
  

  wangbluo

  and

  pre-commit-ci[bot]

  authored
  d3f34ee

  Copy full SHA for d3f34ee

• [shardformer] support bias_gelu_jit_fused for models (#5647)

  Show description for 6af6d6f
  flybird11111

  authored
  6af6d6f

  Copy full SHA for 6af6d6f

• [misc] refactor launch API and tensor constructor (#5666)

  Show description for 7f8b166
  

  ver217

  and

  pre-commit-ci[bot]

  authored
  7f8b166

  Copy full SHA for 7f8b166

Commits on Apr 28, 2024

• [Feature] qlora support (#5586)

  Show description for 91fa553
  

  2 peopleauthored and

  ver217

  committed
  91fa553

  Copy full SHA for 91fa553

• [LowLevelZero] low level zero support lora (#5153)

  Show description for 8954a0c
  

  flybird11111

  authored and

  ver217

  committed
  8954a0c

  Copy full SHA for 8954a0c

Pagination

Previous

Next