Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Embedding] Support StaticGPUHashMap to optimize GPU EmbeddingVariable in inference. #878

Merged
merged 1 commit into from
Jun 5, 2023
Merged

[Embedding] Support StaticGPUHashMap to optimize GPU EmbeddingVariable in inference. #878

merged 1 commit into from
Jun 5, 2023

Conversation

Mesilenceki
Copy link
Contributor

Performance Comparison:

Benchmark batch_size Global_steps
DCNv2 train EV 8192 11.5
DCNv2 inference EV 8192 12.6
DCNv2 train EV 2048 25.80
DCNv2 inference EV 2048 29.20

@Mesilenceki Mesilenceki force-pushed the features/gpu-ev-for-inference branch from c678f2b to ecabd01 Compare June 5, 2023 02:48
@Mesilenceki
[Embedding] Resolve merge conflicts.
0586bc6 
Performance Comparison:
| Benchmark | batch_size | Global_steps |
| -------------- | ----- | ----- |
| DCNv2 train EV | 8192 | 11.5 |
| DCNv2 inference EV | 8192 | 12.6 |
| DCNv2 train EV | 2048 | 25.80 |
| DCNv2 inference EV | 2048 | 29.20 |

Signed-off-by: JunqiHu <silenceki@hotmail.com>
@Mesilenceki Mesilenceki force-pushed the features/gpu-ev-for-inference branch from ecabd01 to 0586bc6 Compare June 5, 2023 02:49
@liutongxuan liutongxuan merged commit 5dba495 into DeepRec-AI:main Jun 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@liutongxuan liutongxuan liutongxuan approved these changes

@candyzone candyzone Awaiting requested review from candyzone

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Mesilenceki @liutongxuan