Search results

text-generation-bloom560m-example cannot run

Status: Open.

#551 In microsoft/DeepSpeed-MII;

· helloburke opened on Jan 13, 2025

deepspeed-kernels 0.0.1.dev1698255861 is not supported on this platform

Status: Open.

#550 In microsoft/DeepSpeed-MII;

· SoloTillDawn opened on Jan 3, 2025

ValueError: Unsupported model type mllama

Status: Open.

#549 In microsoft/DeepSpeed-MII;

· MaorSagi opened on Dec 1, 2024

persistent deployment (qwen2-7b-instruct) model responds abnormally

Status: Open.

#548 In microsoft/DeepSpeed-MII;

· chengjixin opened on Nov 26, 2024

splitting models across nodes

Status: Open.

#547 In microsoft/DeepSpeed-MII;

· rastinrastinii opened on Nov 26, 2024

How to use data parallelism in multi gpus inference

Status: Open.

#546 In microsoft/DeepSpeed-MII;

· hhf-hu opened on Nov 22, 2024

Issue: Multi-node and Multi-GPU Inference Problems with DeepSpeed MII

Status: Open.

#545 In microsoft/DeepSpeed-MII;

· lcnmzz00 opened on Nov 20, 2024

Please clarify structured output support

Status: Open.

#544 In microsoft/DeepSpeed-MII;

· MRYingLEE opened on Nov 19, 2024

Bug: Removal of mii.pydantic_v1 broke entrypoint scripts

Status: Open.

#543 In microsoft/DeepSpeed-MII;

· KMouratidis opened on Nov 11, 2024

Updating transformers issue with bloom models

Status: Open.

#541 In microsoft/DeepSpeed-MII;

· loadams opened on Nov 1, 2024

Updating transformers issue with zero-shot-image-classification

Status: Open.

#540 In microsoft/DeepSpeed-MII;

· loadams opened on Nov 1, 2024

Logits Processors

Status: Open.

#532 In microsoft/DeepSpeed-MII;

· psitronic opened on Oct 21, 2024