Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError when run test_tracktor.py #143

Open
sfwang20 opened this issue Aug 8, 2021 · 1 comment
Open

RuntimeError when run test_tracktor.py #143

sfwang20 opened this issue Aug 8, 2021 · 1 comment

Comments

@sfwang20
Copy link

sfwang20 commented Aug 8, 2021

Hi Philipp,
Thanks for your excellent work!
I followed README.md to build the environment and when I run test_tracktor.py, it shows the RuntimeError as following:

INFO - main - Initializing object detector(s).
INFO - main - Initializing reID network(s).
INFO - main - Tracking: MOT17-02-FRCNN
0%| | 0/600 [00:02<?, ?it/s]
ERROR - test_tracktor - Failed after 0:00:27!
Traceback (most recent calls WITHOUT Sacred internals):
File "experiments/scripts/test_tracktor.py", line 143, in main
tracker.step(frame_data)
File "d:\research\projects\tracking_wo_bnw\src\tracktor\tracker.py", line 261, in step
self.obj_detect.load_image(blob['img'])
File "d:\research\projects\tracking_wo_bnw\src\tracktor\frcnn_fpn.py", line 75, in load_image
self.features = self.backbone(preprocessed_images.tensors)
File "C:\Users\shinfu\anaconda3\envs\tracking_wo_bnw\lib\site-packages\torch\nn\modules\module.py", line 722, in _call_impl
result = self.forward(*input, **kwargs)
File "C:\Users\shinfu\anaconda3\envs\tracking_wo_bnw\lib\site-packages\torchvision\models\detection\backbone_utils.py", line 39, in forward
x = self.body(x)
File "C:\Users\shinfu\anaconda3\envs\tracking_wo_bnw\lib\site-packages\torch\nn\modules\module.py", line 722, in _call_impl
result = self.forward(*input, **kwargs)
File "C:\Users\shinfu\anaconda3\envs\tracking_wo_bnw\lib\site-packages\torchvision\models_utils.py", line 63, in forward
x = module(x)
File "C:\Users\shinfu\anaconda3\envs\tracking_wo_bnw\lib\site-packages\torch\nn\modules\module.py", line 722, in _call_impl
result = self.forward(*input, **kwargs)
File "C:\Users\shinfu\anaconda3\envs\tracking_wo_bnw\lib\site-packages\torch\nn\modules\conv.py", line 419, in forward
return self._conv_forward(input, self.weight)
File "C:\Users\shinfu\anaconda3\envs\tracking_wo_bnw\lib\site-packages\torch\nn\modules\conv.py", line 416, in _conv_forward
self.padding, self.dilation, self.groups)
RuntimeError: cuDNN error: CUDNN_STATUS_ALLOC_FAILED

I search by google if there are solutions about the error and it seems like the memory of my GPU is not enough.
My GPU is Nvidia GTX 1660Ti with 6 GB memory.
Besides, I also tried change the batch size (to 32) in res50.yml but it didn't work (it seems like testing won't use this file, I'm not sure about that)
Is there any other way for me to get smaller GPU memory usage?
Thanks for your help!
Best regards.

@timmeinhardt
Copy link
Collaborator

Yes, the file you changed is just for the training of the reid model. You could run the tracking evaluation on the CPU or reduce the resolution of the images. The latter might hurt the performance though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants