Closed
Description
openedon Jul 10, 2024
Describe the issue
The bug is produced when running in multi gpus, since I only can test benchmark_e2e.py with --context_window 512000. Then, I used dual card for Qwen2-7B for context 1M and this error is produced. How to fix?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
