Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tusimple数据集评估代码某行代码的疑问 #164

Open
mmpp406 opened this issue Nov 15, 2023 · 3 comments
Open

tusimple数据集评估代码某行代码的疑问 #164

mmpp406 opened this issue Nov 15, 2023 · 3 comments
Labels
lane detection question Further information is requested

Comments

@mmpp406
Copy link

mmpp406 commented Nov 15, 2023

作者你好,在tools/tusimple_evaluation/lane.py第36行到37行中,有如下代码:
if running_time > 200 or len(gt) + 2 < len(pred): return 0., 0., 1.
我在这个地方有疑问,请问为什么running_time大于200或者真实的车道数量加2小于预测的车道数量就直接返回了,并且acc、fp、fn的值返回为0 0 1

@voldemortX
Copy link
Owner

作者你好,在tools/tusimple_evaluation/lane.py第36行到37行中,有如下代码:
if running_time > 200 or len(gt) + 2 < len(pred): return 0., 0., 1.
我在这个地方有疑问,请问为什么running_time大于200或者真实的车道数量加2小于预测的车道数量就直接返回了,并且acc、fp、fn的值返回为0 0 1

这个应该是官方评测代码移植的。逻辑是按一开始tusimple比赛标准定的。

@voldemortX voldemortX added question Further information is requested lane detection labels Nov 15, 2023
@mmpp406
Copy link
Author

mmpp406 commented Nov 15, 2023

了解了,不过关于这一块的逻辑有什么解释吗?因为确实这块看不太明白

@mmpp406
Copy link
Author

mmpp406 commented Nov 15, 2023

作者你好,在tools/tusimple_evaluation/lane.py第36行到37行中,有如下代码:
if running_time > 200 or len(gt) + 2 < len(pred): return 0., 0., 1.
我在这个地方有疑问,请问为什么running_time大于200或者真实的车道数量加2小于预测的车道数量就直接返回了,并且acc、fp、fn的值返回为0 0 1

这个应该是官方评测代码移植的。逻辑是按一开始tusimple比赛标准定的。

我找到原始数据集的解释了:https://github.com/TuSimple/tusimple-benchmark/blob/master/doc/lane_detection/readme.md 大概是因为竞赛中把耗时太长或者输出车道数过多的预测结果视作为无效值

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lane detection question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants