Commits

Branch selector

 main

User selector

Tabrizian

Datepicker

All time

Commit History

Commits on Dec 18, 2023

• Fix warning for GPU tensors (triton-inference-server#330)

  Tabrizian

  authored
  7551f03

  Copy full SHA for 7551f03

Commits on Oct 12, 2023

• Restructure cleaning up of the futures in decoupled mode (triton-inference-server#309)

  Show description for a2e8f9b
  Tabrizian

  authored
  a2e8f9b

  Copy full SHA for a2e8f9b

Commits on Sep 26, 2023

• Fix response iterator memory leak (triton-inference-server#302)

  Tabrizian

  authored
  b136bf3

  Copy full SHA for b136bf3

Commits on Aug 22, 2023

• Reduce the default required shm size to 1MB (triton-inference-server#291)

  Show description for 6f369ef
  Tabrizian

  authored
  6f369ef

  Copy full SHA for 6f369ef

Commits on Aug 11, 2023

• Add custom parameters documentation (triton-inference-server#288)

  Tabrizian

  authored
  74722ba

  Copy full SHA for 74722ba

Commits on Jun 29, 2023

• Improve CUDA context management (triton-inference-server#263)

  Show description for 611a298
  Tabrizian

  authored
  611a298

  Copy full SHA for 611a298

Commits on Jun 6, 2023

• Fix error handling for GPU tensors (triton-inference-server#249)

  Show description for 0a54e59
  Tabrizian

  authored
  0a54e59

  Copy full SHA for 0a54e59

Commits on Jun 5, 2023

• Remove the requirement to specify output_tensors when setting an error (triton-inference-server#251)

  Show description for 637c7e3
  Tabrizian

  authored
  637c7e3

  Copy full SHA for 637c7e3

Commits on Jun 2, 2023

• Update mentions of Python 3.8 -> 3.10 (triton-inference-server#253)

  Tabrizian

  authored
  a156eba

  Copy full SHA for a156eba

Commits on May 20, 2023

• Fix cuda synchronization (triton-inference-server#245)

  Show description for a654b4f
  Tabrizian

  authored
  a654b4f

  Copy full SHA for a654b4f

Commits on Apr 28, 2023

• Fix Stub initialization (triton-inference-server#238)

  Tabrizian

  authored
  01cbb2d

  Copy full SHA for 01cbb2d

Commits on Apr 19, 2023

• fix shm-size out_of_range error (triton-inference-server#234)

  Tabrizian

  authored
  ad88027

  Copy full SHA for ad88027

Commits on Apr 6, 2023

• Clarify the request.parameters() return type (triton-inference-server#228)

  Tabrizian

  authored
  9ca21ee

  Copy full SHA for 9ca21ee

Commits on Mar 27, 2023

• Initialize CUDA driver API before using it (triton-inference-server#222)

  Show description for 076e2f7
  Tabrizian

  authored
  076e2f7

  Copy full SHA for 076e2f7

Commits on Mar 15, 2023

• Add request parameters to Python models (triton-inference-server#213)

  Show description for 7f5f32e
  Tabrizian

  authored
  7f5f32e

  Copy full SHA for 7f5f32e

Commits on Mar 6, 2023

• Add documentation for shared memory region name prefix (triton-inference-server#210)

  Show description for 2bd5a05
  Tabrizian

  authored
  2bd5a05

  Copy full SHA for 2bd5a05

Commits on Dec 29, 2022

• Make sure to use correct shared memory mapping before deallocation (triton-inference-server#200)

  Show description for 62fe726
  Tabrizian

  authored
  62fe726

  Copy full SHA for 62fe726

Commits on Dec 14, 2022

• Fix GPU buffers when dynamic batching is enabled (triton-inference-server#199)

  Tabrizian

  authored
  54c693e

  Copy full SHA for 54c693e

Commits on Nov 28, 2022

• Acquire GIL lock when releasing DLPack tensors (triton-inference-server#198)

  Tabrizian

  authored
  685711d

  Copy full SHA for 685711d

Commits on Oct 31, 2022

• Fix broken links Python BE (triton-inference-server#193)

  Tabrizian

  authored
  8466d33

  Copy full SHA for 8466d33

• Improve the documentation for custom exec envs (triton-inference-server#192)

  Tabrizian

  authored
  6327d48

  Copy full SHA for 6327d48

Commits on Oct 7, 2022

• Fix link to the decoupled models (triton-inference-server#190)

  Tabrizian

  authored
  f0de211

  Copy full SHA for f0de211

Commits on Jul 14, 2022

• Fix requested output names (triton-inference-server#173)

  Show description for ae297ac
  Tabrizian

  authored
  ae297ac

  Copy full SHA for ae297ac

Commits on Jun 6, 2022

• Fix deferred callback when there is an error (triton-inference-server#164)

  Tabrizian

  authored
  b106301

  Copy full SHA for b106301

• Add request statistic reporting for decoupled mode (triton-inference-server#163)

  Tabrizian

  authored
  73fdcda

  Copy full SHA for 73fdcda

Commits on Jun 1, 2022

• Disable async BLS support in decoupled models (triton-inference-server#157)

  Tabrizian

  authored
  03914b2

  Copy full SHA for 03914b2

• Allow FORCE_CPU_ONLY_INPUT to be off for decoupled (triton-inference-server#158)

  Tabrizian

  authored
  6edcdd8

  Copy full SHA for 6edcdd8

Commits on May 28, 2022

• Improve decoupled API known issue failure (triton-inference-server#155)

  Show description for 85613cf
  

  2 peopleauthored and

  mc-nv

  committed
  85613cf

  Copy full SHA for 85613cf

Commits on May 21, 2022

• Add GPU tensor support to decoupled API (triton-inference-server#154)

  Tabrizian

  authored
  92245a7

  Copy full SHA for 92245a7

Commits on May 10, 2022

• Improve lifetime of NumPy objects (triton-inference-server#149)

  Show description for b62f9f7
  Tabrizian

  authored
  b62f9f7

  Copy full SHA for b62f9f7

Commits on May 6, 2022

• Improve the GPU memory manager (triton-inference-server#148)

  Tabrizian

  authored
  84a6405

  Copy full SHA for 84a6405

• Update building stub instructions to include other repo tags (triton-inference-server#147)

  Tabrizian

  authored
  6f681ad

  Copy full SHA for 6f681ad

Commits on May 5, 2022

• Add support for flags in response send (triton-inference-server#146)

  Show description for 4d889c7
  Tabrizian

  authored
  4d889c7

  Copy full SHA for 4d889c7

Commits on May 4, 2022

• Fix building from source (triton-inference-server#144)

  Show description for c37a358
  Tabrizian

  authored
  c37a358

  Copy full SHA for c37a358

Commits on May 2, 2022

• Implement the decoupled API (triton-inference-server#136)

  Show description for c434d47
  

  Tabrizian

  and

  tanmayv25

  authored
  c434d47

  Copy full SHA for c434d47

Pagination

Previous

Next