Search results

[Bug] Excessive Memory Usage for Phi-3-Mini

Status: Open.

#559 In deepspeedai/DeepSpeed-MII;

· riedgar-ms opened on Mar 13, 2025

text-generation-bloom560m-example cannot run

Status: Open.

#551 In deepspeedai/DeepSpeed-MII;

· helloburke opened on Jan 13, 2025

ValueError: Unsupported model type mllama

Status: Open.

#549 In deepspeedai/DeepSpeed-MII;

· MaorSagi opened on Dec 1, 2024

splitting models across nodes

Status: Open.

#547 In deepspeedai/DeepSpeed-MII;

· rastinrastinii opened on Nov 26, 2024

How to use data parallelism in multi gpus inference

Status: Open.

#546 In deepspeedai/DeepSpeed-MII;

· hhf-hu opened on Nov 22, 2024

Issue: Multi-node and Multi-GPU Inference Problems with DeepSpeed MII

Status: Open.

#545 In deepspeedai/DeepSpeed-MII;

· lcnmzz00 opened on Nov 20, 2024

Please clarify structured output support

Status: Open.

#544 In deepspeedai/DeepSpeed-MII;

· MRYingLEE opened on Nov 19, 2024

Updating transformers issue with bloom models

Status: Open.

#541 In deepspeedai/DeepSpeed-MII;

· loadams opened on Nov 1, 2024

Updating transformers issue with zero-shot-image-classification

Status: Open.

#540 In deepspeedai/DeepSpeed-MII;

· loadams opened on Nov 1, 2024

Logits Processors

Status: Open.

#532 In deepspeedai/DeepSpeed-MII;

· psitronic opened on Oct 21, 2024

need help understanding profiler in deespeed mio

Status: Open.

#531 In deepspeedai/DeepSpeed-MII;

· krishnanpooja opened on Oct 7, 2024

DeepSpeed with Phi-3-mini-128K-instruct does not generate <|endoftext|> token

Status: Open.

#529 In deepspeedai/DeepSpeed-MII;

· shubhanshu786 opened on Sep 27, 2024