Skip to content

official code for PseR: Pseudo-label Refinement for Point-Supervised Temporal Action Detection

Notifications You must be signed in to change notification settings

zhenyingfang/PseR

Repository files navigation

PseR

official code for PseR: Pseudo-label Refinement for Point-Supervised Temporal Action Detection

Install

  • Install the python environment and get dataset of HR-Pro
  • cd models/ops and run: python setup.py build_ext --inplace
  • cd ../..

Generate seed proposals

PseR generates seed proposals based on existing methods. Take LACP, for example

  • Run LACP to get the initial prediction
  • Execute python seed_process/ge_seed_proposal.py to get lacp_seed_final.json
  • [Optionally], you can use the lacp_seed_final.json[7vx4] we have already gotten

Training PseR

  • Run python main.py to get the pseudo-label of the PseR prediction: lacp_pser.json
  • [Optionally], you can use the lacp_pser.json[ip52] we have already gotten

Training TAD

We trained on the THUMOS'14 dataset based on OpenTAD and lacp_pser.json

Results

ActF stands for ActionFormer

Model mAP@0.3 mAP@0.4 mAP@0.5 mAP@0.6 mAP@0.7 ave. mAP Config Download
LACP 64.6 56.5 45.3 34.5 21.8 44.5
LACP+ActF 77.1 68.5 56.2 41.8 23.3 53.4 config log[k7b4] | model
Ours+ActF 78.5 70.9 59.3 43.2 26.2 55.6 config log[a67a] | model

Acknowledgement

Our code is based on HR-Pro, OpenTAD, LACP. We would like to express our gratitude for their outstanding work

About

official code for PseR: Pseudo-label Refinement for Point-Supervised Temporal Action Detection

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published