Search results

ValueError: Unsupported model type mllama

Status: Open.

#549 In microsoft/DeepSpeed-MII;

· MaorSagi opened on Dec 1, 2024

persistent deployment (qwen2-7b-instruct) model responds abnormally

Status: Open.

#548 In microsoft/DeepSpeed-MII;

· chengjixin opened on Nov 26, 2024

splitting models across nodes

Status: Open.

#547 In microsoft/DeepSpeed-MII;

· rastinrastinii opened on Nov 26, 2024

How to use data parallelism in multi gpus inference

Status: Open.

#546 In microsoft/DeepSpeed-MII;

· hhf-hu opened on Nov 22, 2024

Issue: Multi-node and Multi-GPU Inference Problems with DeepSpeed MII

Status: Open.

#545 In microsoft/DeepSpeed-MII;

· lcnmzz00 opened on Nov 20, 2024

Please clarify structured output support

Status: Open.

#544 In microsoft/DeepSpeed-MII;

· MRYingLEE opened on Nov 19, 2024

Bug: Removal of mii.pydantic_v1 broke entrypoint scripts

Status: Open.

#543 In microsoft/DeepSpeed-MII;

· KMouratidis opened on Nov 11, 2024

Updating transformers issue with bloom models

Status: Open.

#541 In microsoft/DeepSpeed-MII;

· loadams opened on Nov 1, 2024

Updating transformers issue with zero-shot-image-classification

Status: Open.

#540 In microsoft/DeepSpeed-MII;

· loadams opened on Nov 1, 2024

Logits Processors

Status: Open.

#532 In microsoft/DeepSpeed-MII;

· psitronic opened on Oct 21, 2024

need help understanding profiler in deespeed mio

Status: Open.

#531 In microsoft/DeepSpeed-MII;

· krishnanpooja opened on Oct 7, 2024

DeepSpeed with Phi-3-mini-128K-instruct does not generate <|endoftext|> token

Status: Open.

#529 In microsoft/DeepSpeed-MII;

· shubhanshu786 opened on Sep 27, 2024