Skip to content

Commit

Permalink
Fix DB to prefer batches with preferred batch size for default max_qu…
Browse files Browse the repository at this point in the history 
…eue_d… (triton-inference-server#3298)

* Fix DB to prefer batches preferred batch size for default max_queue_delay

* Add additional tests for checking different preferred batch size scenarios
  • Loading branch information
@tanmayv25
tanmayv25 authored Sep 7, 2021
1 parent 7266004 commit 51ae001
Show file tree
Hide file tree
Showing 3 changed files with 436 additions and 30 deletions.
Loading

0 comments on commit 51ae001

Please sign in to comment.