-
Notifications
You must be signed in to change notification settings - Fork 716
Open
Description
How to evaluate from opencompass/AIME2025 not aliyun ? cannot download from aliyun.
Prerequisite
- I have searched Issues and Discussions but cannot get the expected help.
- The bug has not been fixed in the latest version.
Type
I'm evaluating with the officially supported tasks/models/datasets.
Environment
{'CUDA available': True,
'CUDA_HOME': '/usr/local/cuda',
'GCC': 'gcc (Ubuntu 11.4.0-1ubuntu1~22.04.2) 11.4.0',
'GPU 0,1,2,3,4,5,6,7': 'NVIDIA H100 NVL',
'MMEngine': '0.10.7',
'MUSA available': False,
'NVCC': 'Cuda compilation tools, release 12.4, V12.4.99',
'OpenCV': '4.11.0',
'PyTorch': '2.8.0+cu128',
'Python': '3.11.14 | packaged by conda-forge | (main, Oct 22 2025, 22:46:25) '
'[GCC 14.3.0]',
'TorchVision': '0.23.0+cu128',
'lmdeploy': '0.10.2',
'numpy_random_seed': 2147483648,
'opencompass': '0.5.1+9dd57d3',
'sys.platform': 'linux',
'transformers': '4.57.3'}
Reproduces the problem - code/configuration sample
na
Reproduces the problem - command or script
python eval/eval.py JetLM/SDAR-4B-Chat --mode all --api-server http://127.0.0.1:10000 --judger-server http://127.0.0.1:20000 -w ./oc_outputReproduces the problem - error message
File "/home/user1/miniconda3/envs/lmdeploy/lib/python3.11/urllib/request.py", line 1351, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [Errno 110] Connection timed out>
Other information
No response
Metadata
Metadata
Assignees
Labels
No labels