Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[LLM Inference] Support Qwen2_Moe Inference with MultiGPU #9121

Merged
merged 5 commits into from
Sep 12, 2024

fix

0eb1eae
Select commit
Loading
Failed to load commit list.
Merged

[LLM Inference] Support Qwen2_Moe Inference with MultiGPU #9121

fix
0eb1eae
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed Sep 12, 2024 in 0s

0.00% of diff hit (target 80.00%)

View this Pull Request on Codecov

0.00% of diff hit (target 80.00%)

Annotations

Check warning on line 384 in paddlenlp/experimental/transformers/fused_transformer_layers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/fused_transformer_layers.py#L384 

Added line #L384 was not covered by tests

Check warning on line 390 in paddlenlp/experimental/transformers/fused_transformer_layers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/fused_transformer_layers.py#L389-L390 

Added lines #L389 - L390 were not covered by tests

Check warning on line 649 in paddlenlp/experimental/transformers/fused_transformer_layers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/fused_transformer_layers.py#L647-L649 

Added lines #L647 - L649 were not covered by tests

Check warning on line 2249 in paddlenlp/experimental/transformers/fused_transformer_layers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/fused_transformer_layers.py#L2249 

Added line #L2249 was not covered by tests

Check warning on line 2254 in paddlenlp/experimental/transformers/fused_transformer_layers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/fused_transformer_layers.py#L2253-L2254 

Added lines #L2253 - L2254 were not covered by tests

Check warning on line 21 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L21 

Added line #L21 was not covered by tests

Check warning on line 38 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L38 

Added line #L38 was not covered by tests

Check warning on line 112 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L111-L112 

Added lines #L111 - L112 were not covered by tests

Check warning on line 118 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L118 

Added line #L118 was not covered by tests

Check warning on line 130 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L124-L130 

Added lines #L124 - L130 were not covered by tests

Check warning on line 283 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L283 

Added line #L283 was not covered by tests

Check warning on line 299 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L298-L299 

Added lines #L298 - L299 were not covered by tests

Check warning on line 310 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L309-L310 

Added lines #L309 - L310 were not covered by tests

Check warning on line 313 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L313 

Added line #L313 was not covered by tests

Check warning on line 316 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L316 

Added line #L316 was not covered by tests

Check warning on line 320 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L320 

Added line #L320 was not covered by tests

Check warning on line 877 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L877 

Added line #L877 was not covered by tests

Check warning on line 883 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L882-L883 

Added lines #L882 - L883 were not covered by tests

Check warning on line 896 in paddlenlp/experimental/transformers/qwen2_moe/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/qwen2_moe/modeling.py#L890-L896 

Added lines #L890 - L896 were not covered by tests
View more details on Codecov