Commits

Branch selector

 master

User selector

KexinFeng

Datepicker

All time

Commit History

Commits on Jan 8, 2024

• [LMIDist] Add test that calls LmiDistRollingBatch with python script (deepjavalibrary#1443)

  Show description for f1f0e04
  

  KexinFeng

  and

  KexinFeng

  authored
  f1f0e04

Commits on Nov 22, 2023

• [doc] seq_scheduler_document (deepjavalibrary#1336)

  Show description for 40ab1b5
  

  KexinFeng

  and

  KexinFeng

  authored
  40ab1b5

Commits on Nov 10, 2023

• [feat] Better output format from seq-scheduler (deepjavalibrary#1305)

  Show description for e4f13f1
  

  KexinFeng

  and

  KexinFeng

  authored
  e4f13f1

Commits on Nov 9, 2023

• [fix] Refactor device on the scheduler (deepjavalibrary#1302)

  KexinFeng

  authored
  28ad36a

Commits on Nov 7, 2023

• [feat] Expose max sparse params (deepjavalibrary#1273)

  Show description for d0bfe7e
  

  KexinFeng

  and

  KexinFeng

  authored
  d0bfe7e

Commits on Oct 4, 2023

• Give a version of seq scheduler (deepjavalibrary#1146)

  Show description for ee3c293
  

  KexinFeng

  and

  KexinFeng

  authored
  ee3c293

Commits on Oct 3, 2023

• [fix] version_fix (deepjavalibrary#1144)

  Show description for 72820a6
  

  KexinFeng

  and

  KexinFeng

  authored
  72820a6

• [fix] Gptq dependency (deepjavalibrary#1137)

  Show description for e7afbe4
  

  KexinFeng

  and

  KexinFeng

  authored
  e7afbe4

Commits on Oct 2, 2023

• [fix] fix hf transformer handler dependency (deepjavalibrary#1132)

  Show description for 3b2a71e
  

  KexinFeng

  and

  KexinFeng

  authored
  3b2a71e

• [fix] Fix falcon in seq_scheduler (deepjavalibrary#1131)

  Show description for 6cfa300
  

  KexinFeng

  and

  KexinFeng

  authored
  6cfa300

Commits on Sep 30, 2023

• Integrate with seq_scheduler wheel (deepjavalibrary#1122)

  Show description for 1b8f783
  

  KexinFeng

  and

  KexinFeng

  authored
  1b8f783

• [fix] falcon test model failure in unittest (deepjavalibrary#1129)

  Show description for 2311de6
  

  KexinFeng

  and

  KexinFeng

  authored
  2311de6

• [feature] Test llama-7b-gptq on scheduler_rolling_batch (deepjavalibrary#1101)

  Show description for 66b6a87
  

  KexinFeng

  and

  KexinFeng

  authored
  66b6a87

Commits on Sep 28, 2023

• [fix] Device_and_search_config_issue (deepjavalibrary#1120)

  Show description for 5c07559
  

  KexinFeng

  and

  KexinFeng

  authored
  5c07559

Commits on Sep 25, 2023

• [feature] Enable model sharding on seq_scheduler tested on gpt_neox_20B (deepjavalibrary#1086)

  Show description for 7dfeee2
  

  KexinFeng

  and

  KexinFeng

  authored
  7dfeee2

Commits on Sep 12, 2023

• [fix] Fix device map (deepjavalibrary#1074)

  KexinFeng

  authored
  4f79d7a

Commits on Sep 8, 2023

• [fix] Device and format and implementation optimization (deepjavalibrary#1055)

  KexinFeng

  authored
  ed03dac

Commits on Aug 9, 2023

• [fix] Fix Kwargs in AutoConfig (deepjavalibrary#995)

  KexinFeng

  authored
  72f1bfc

Commits on Jul 29, 2023

• [fix] Fix the cpu unittests issue due to device_map = 'auto' (deepjavalibrary#970)

  Show description for e77bcb0
  

  KexinFeng

  and

  KexinFeng

  authored
  e77bcb0

Commits on Jul 20, 2023

• Enable multi-gpu inference (device_map='auto') on seq_batch_scheduler (deepjavalibrary#960)

  KexinFeng

  authored
  0f5a52b

Commits on Jul 11, 2023

• [Fix] bug_fix_for_empty_tensor_input (deepjavalibrary#928)

  Show description for 666162a
  KexinFeng

  authored
  666162a

Commits on Jul 10, 2023

• bug_fix (deepjavalibrary#923)

  Show description for 882ac89
  

  KexinFeng

  and

  KexinFeng

  authored
  882ac89

Commits on Jul 6, 2023

• [WIP] Unit test with fixed random seed (deepjavalibrary#909)

  KexinFeng

  authored
  86e9c9c

Commits on Jul 5, 2023

• Runtime kv cache (deepjavalibrary#879)

  

  KexinFeng

  authored and

  frankfliu

  committed
  8b7a072

Commits on Jul 2, 2023

• Falcon support (deepjavalibrary#890)

  KexinFeng

  authored
  bba1578

Commits on Jun 30, 2023

• Sampling decoding implementation (deepjavalibrary#878)

  Show description for dc930a7
  

  KexinFeng

  and

  KexinFeng

  authored
  dc930a7

Commits on Jun 24, 2023

• Compute kv cache utility function (deepjavalibrary#863)

  KexinFeng

  authored
  aeba410

Commits on Jun 22, 2023

• fix the type of max_seq_len (deepjavalibrary#853)

  Show description for 8b33993
  

  KexinFeng

  and

  KexinFeng

  authored
  8b33993

• max_gen_seqlen (deepjavalibrary#845)

  KexinFeng

  authored
  7781688

Commits on Jun 21, 2023

• Max_seqbatcher_number_threshold_api (deepjavalibrary#843)

  KexinFeng

  authored
  45ed4c5

• Sampling seqBatcher (deepjavalibrary#842)

  KexinFeng

  authored
  8e0c377

Commits on Jun 20, 2023

• Efficiency issue on bmm and contiguous (deepjavalibrary#841)

  KexinFeng

  authored
  577319c

Commits on Jun 16, 2023

• SeqBatchScheduler with rolling batch (deepjavalibrary#803)

  Show description for f4dc287
  

  3 peopleauthored
  f4dc287