Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: pytorch/serve
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.12.0
Choose a base ref
...
head repository: pytorch/serve
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
  • 8 commits
  • 91 files changed
  • 14 contributors

Commits on Oct 3, 2024

  1. set model_snapshot_path to None to prevent unbound local error (#3336)

    * set model_snapshot_path to None to prevent unbound local error
    
    * address PR comments with pythonic usage, fix README
    
    * small change
    
    * revert formatting changes
    johnathanchiu authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    9d10087 View commit details
    Browse the repository at this point in the history
  2. Create export path if not present (#3331)

    Co-authored-by: Ankith Gunapal <agunapal@ischool.Berkeley.edu>
    mreso and agunapal authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    e8879c1 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Bump onnx from 1.16.0 to 1.17.0 in /requirements (#3354)

    Bumps [onnx](https://github.com/onnx/onnx) from 1.16.0 to 1.17.0.
    - [Release notes](https://github.com/onnx/onnx/releases)
    - [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog-ml.md)
    - [Commits](onnx/onnx@v1.16.0...v1.17.0)
    
    ---
    updated-dependencies:
    - dependency-name: onnx
      dependency-type: direct:development
    ...
    
    Signed-off-by: dependabot[bot] <support@github.com>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    f4fbcbe View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2024

  1. Adding Multi-Image generation usecase app (#3356)

    * Added OV SDXL registration to chat_bot app
    
    * sdxl image generation
    
    * pass model params
    
    * fixes
    
    * fixes
    
    * llm-sd pipeline
    
    * store images
    
    * need to fix sd_xl checkbox
    
    * fix for num_of_img==1
    
    * fix for 1 img, total time
    
    * perf fixes
    
    * fixes
    
    * llm with torch.compile
    
    * fixed tocken auth issue, ui fixes
    
    * gpt fast version, bad quality of output prompts
    
    * rm extra files, updated readme
    
    * added llama params, sd default res 768, better prompts
    
    * fix, updated default workers num
    
    * button for prompts generation
    
    * fix
    
    * fix
    
    * Changed SDXL to LCM SDXL
    
    * updated lcm example
    
    * updated lcm example
    
    * updated lcm example
    
    * add llm_sd_app
    
    * Updated llm_diffusion_serving_app
    
    * Updated llm_diffusion_serving_app
    
    * Update llm_diffusion_serving_app
    
    * Update llm_diffusion_serving_app
    
    * Update examples/usecases/llm_diffusion_serving_app/Readme.md
    
    Co-authored-by: Ankith Gunapal <agunapal@ischool.Berkeley.edu>
    
    * Update llm_diffusion_serving_app
    
    * update llm_diffusion_serving_app
    
    * update llm_diffusion_serving_app
    
    * update llm_diffusion_serving_app
    
    * Update llm_diffusion_serving_app
    
    * Update llm_diffusion_serving_app
    
    * Minor Updates, Added sd_benchmark
    
    * Add docs for llm_diffusion_serving_app
    
    * Apply suggestions from code review
    
    Co-authored-by: Ankith Gunapal <agunapal@ischool.Berkeley.edu>
    
    * Update llm_diffusion_serving_app, fix linter issues
    
    * Update img, add assests
    
    * update readme
    
    ---------
    
    Co-authored-by: likholat <anna.likholat@gmail.com>
    Co-authored-by: likholat <anna.likholat@intel.com>
    Co-authored-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
    Co-authored-by: Ankith Gunapal <agunapal@ischool.Berkeley.edu>
    5 people authored Nov 23, 2024
    Configuration menu
    Copy the full SHA
    55c2f6b View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2024

  1. Update README.md (#3368)

    ravi9 authored Nov 25, 2024
    Configuration menu
    Copy the full SHA
    3182443 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2024

  1. Configuration menu
    Copy the full SHA
    0985386 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2024

  1. 740 add generic support for different gpu hardware (#3371)

    * Add AMD backend support
    
    * Add AMD frontend support
    
    * Add Dockerfile.rocm
    
    Co-authored-by: Samu Tamminen <stammine@amd.com>
    
    * Add AMD documentation
    
    * Fix null pointer bug with populateAccelerators trying to get null AppleUtil GPU env value
    
    * Fix formatting
    
    ---------
    
    Co-authored-by: Rony Leppänen <rleppane@amd.com>
    Co-authored-by: Anders Smedegaard Pedersen <asmedega@amd.com>
    Co-authored-by: Samu Tamminen <stammine@amd.com>
    4 people authored Dec 19, 2024
    Configuration menu
    Copy the full SHA
    9bcbd22 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2024

  1. Add Apple system metrics support (#3377)

    * Add Apple system metrics support
    
    Co-authored-by: Bipradip Chowdhury <bichowdh@amd.com>
    Co-authored-by: Rony Leppänen <rleppane@amd.com>
    Co-authored-by: Anders Smedegaard Pedersen <asmedega@amd.com>
    
    * Fix ModelServerTest.testMetricManager for other HW vendors
    
    * Add GPUUtilization as expect metric
    
    ---------
    
    Co-authored-by: Bipradip Chowdhury <bichowdh@amd.com>
    Co-authored-by: Rony Leppänen <rleppane@amd.com>
    Co-authored-by: Anders Smedegaard Pedersen <asmedega@amd.com>
    4 people authored Dec 20, 2024
    Configuration menu
    Copy the full SHA
    1a3b18b View commit details
    Browse the repository at this point in the history
Loading