Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: NVIDIA Triton server Blueprint with vLLM #535

Merged
merged 12 commits into from
Jun 2, 2024
Merged

feat: NVIDIA Triton server Blueprint with vLLM #535

merged 12 commits into from
Jun 2, 2024

Commits on May 7, 2024

  1. Nvidia Triton server with vLLM blueprint

    @vara-bonthu
    vara-bonthu committed May 7, 2024
    Configuration menu
    Copy the full SHA
    bb34920 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. feat: Triton server vllm blueprint enhancements (#521)

    @ratnopamc
    ratnopamc authored May 9, 2024
    Configuration menu
    Copy the full SHA
    3b41b10 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Added null provider version 

    Signed-off-by: Vara Bonthu <vara.bonthu@gmail.com>
    @vara-bonthu
    vara-bonthu committed May 20, 2024
    Configuration menu
    Copy the full SHA
    d7849d1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/awslabs/data-on-eks into tr… 

    …iton-server-vllm
    @vara-bonthu
    vara-bonthu committed May 20, 2024
    Configuration menu
    Copy the full SHA
    22bfbe2 View commit details
    Browse the repository at this point in the history

  3. Corrected spelling in the docs 

    Signed-off-by: Vara Bonthu <vara.bonthu@gmail.com>
    @vara-bonthu
    vara-bonthu committed May 20, 2024
    Configuration menu
    Copy the full SHA
    9a7ea7f View commit details
    Browse the repository at this point in the history

  4. Fixed doc link

    @vara-bonthu
    vara-bonthu committed May 20, 2024
    Configuration menu
    Copy the full SHA
    0a53e31 View commit details
    Browse the repository at this point in the history

  5. Added architecture diagram 

    Signed-off-by: Vara Bonthu <vara.bonthu@gmail.com>
    @vara-bonthu
    vara-bonthu committed May 20, 2024
    Configuration menu
    Copy the full SHA
    5a1e743 View commit details
    Browse the repository at this point in the history

  6. Added excalidraw file for tritonserver 

    Signed-off-by: Vara Bonthu <vara.bonthu@gmail.com>
    @vara-bonthu
    vara-bonthu committed May 20, 2024
    Configuration menu
    Copy the full SHA
    2ef7392 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Added multiple models

    @vara-bonthu
    vara-bonthu committed May 31, 2024
    Configuration menu
    Copy the full SHA
    22836e2 View commit details
    Browse the repository at this point in the history

  2. Updated with multi model deployment approach 

    Signed-off-by: Vara Bonthu <vara.bonthu@gmail.com>
    @vara-bonthu
    vara-bonthu committed May 31, 2024
    Configuration menu
    Copy the full SHA
    db07af2 View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2024

  1. Updates to the Triton server doc

    @vara-bonthu
    vara-bonthu committed Jun 2, 2024
    Configuration menu
    Copy the full SHA
    535ed46 View commit details
    Browse the repository at this point in the history

  2. renamed the folder for pattern

    @vara-bonthu
    vara-bonthu committed Jun 2, 2024
    Configuration menu
    Copy the full SHA
    aa23adf View commit details
    Browse the repository at this point in the history