Skip to content

Commit

Permalink
sparse4d v2
Browse files Browse the repository at this point in the history
  • Loading branch information
linxuewu committed Jun 9, 2023
1 parent 01981c5 commit 70d4be5
Show file tree
Hide file tree
Showing 15 changed files with 820 additions and 140 deletions.
14 changes: 6 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,5 @@
# Sparse4D

Sparse4D v2 will be released soon, which will have lower GPU memory usage, as well as higher training and inference speed.
Paper url of Sparse4Dv2: https://arxiv.org/abs/2305.14018
**State-of-the-Art Performance of Sparse4Dv2 in the NuScenes Benchmark for Online Models.**

## Overall Architecture
### Sparse4D v2
Expand All @@ -14,11 +12,11 @@ Paper url of Sparse4Dv2: https://arxiv.org/abs/2305.14018
## nuScenes Benchmark
### Validation
These experiments were conducted using 8 RTX 3090 GPUs with 24 GB memory.
|model| backbone |pretrain| img size | Epoch | Traning | FPS | NDS | mAP |mATE| mASE | mAOE |mAVE| mAAE | ckpt | log |
| :---: | :---: | :---: | :---: | :---: | :---:| :---:|:---:|:---: | :---: | :----: | :----: | :----: | :----: | :----: | :---: |
|Sparse4D-T4|Res101|[FCOS3D](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/fcos3d.pth)|640x1600|24|2Day5H|2.9|0.5438|0.4409|0.6282|0.2721|0.3853|0.2922|0.1888|[ckpt](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/sparse4dv1_r101_H4_release.pth)|[log](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/sparse4d.log)|
|Sparse4Dv2|Res50|[ImageNet]()|256x704| 100 |15H | 20.3 |0.5384|0.4392|0.5998|0.2694|0.4709|0.2916|0.1800|ckpt|log|
|Sparse4Dv2|Res101|[nuImage](https://download.openmmlab.com/mmdetection3d/v0.1.0_models/nuimages_semseg/cascade_mask_rcnn_r50_fpn_coco-20e_20e_nuim/cascade_mask_rcnn_r50_fpn_coco-20e_20e_nuim_20201009_124951-40963960.pth)|512x1408| 100 |2Day | 8.4 |0.5939|0.5051|0.5478|0.2677|0.3481|0.2386|0.1838|-|-|
|model | backbone |pretrain| img size | Epoch | Traning | FPS | NDS | mAP | config | ckpt | log |
| :----: | :---: | :---: | :---: | :---: | :---:| :---:|:---:|:---: | :---: | :----: | :----: |
|Sparse4D-T4 |Res101|[FCOS3D](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/fcos3d.pth)|640x1600|24|2Day5H|2.9|0.5438|0.4409|[cfg](https://github.com/linxuewu/Sparse4D/blob/main/projects/configs/sparse4d_r101_H4.py)|[ckpt](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/sparse4dv1_r101_H4_release.pth)|[log](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/sparse4d.log)|
|Sparse4Dv2|Res50|[ImageNet]()|256x704| 100 |15H | 20.3 |0.5384|0.4392|[cfg](https://github.com/linxuewu/Sparse4D/blob/main/projects/configs/sparse4dv2_r50_HInf_256x704.py)|[ckpt](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/sparse4dv2_r50_HInf_256x704.pth)|[log](https://github.com/linxuewu/Sparse4D/releases/download/v0.0/sparse4dv2_r50_HInf_256x704.log.json)|
|Sparse4Dv2|Res101|[nuImage](https://download.openmmlab.com/mmdetection3d/v0.1.0_models/nuimages_semseg/cascade_mask_rcnn_r50_fpn_coco-20e_20e_nuim/cascade_mask_rcnn_r50_fpn_coco-20e_20e_nuim_20201009_124951-40963960.pth)|512x1408| 100 |2Day | 8.4 |0.5939|0.5051|-|-|-|

### Test
|model| backbone | img size | NDS | mAP |mATE| mASE | mAOE |mAVE| mAAE |
Expand Down
6 changes: 4 additions & 2 deletions local_test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -18,10 +18,12 @@ then
${config} \
${checkpoint} \
${gpu_num} \
--eval bbox
--eval bbox \
$@
else
python ./tools/test.py \
${config} \
${checkpoint} \
--eval bbox
--eval bbox \
$@
fi
Loading

0 comments on commit 70d4be5

Please sign in to comment.