AbnormalBehaviorDetection

Requirements

• Ubuntu 22.04
• CUDA 11.3 <=
• Docker.ce
• Docker-compose

Dataset Information

• docs/dataset.md

Installation

git clone --recursive https://github/jinhasong/AbnormalBehaviorDetection.git
cd AbnormalBehaviorDetection
docker-compose up -d

Preprocessing

Training

Evaluation

Inference

Project Structure

Expand

AbnormalBehaviorDetection/
 ├─ docker/
 │   ├─ dev/
 │   ├─ mmaction2/
 │   ├─ pose/
 │   ├─ yolo/
 ├─ lib
 │   ├─ mmaction2/
 │   ├─ pose/
 │   │   └─ alphapose/  
 │   └─ tracker/
 │       ├─ bytetracker/
 │       └─ sort/
 ├─ models/
 ├─ scripts/
 ├─ tools/
 ├─ utils/
 └─ docker-compose.yml

• docker: docker 빌드를 위한 dockerfile, env 및 requirements.txt 파일 포함
• lib: git submodule로 추가한 관련 라이브러리 및 repository
• models: abnormal behavior detection 모델 class
• scripts: 데이터셋 및 모델 다운로드용 shell scripts
• tools: 테스트용 소스 및 툴
• utils: model, tools, lib 외 utility

Note

Expand

Object Detection(model comparison)

Name	Paper	Github
yolov4	YOLOv4: Optimal Speed and Accuracy of Object Detection	Github Link
yolov7	YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors	Github Link
yolov8	YOLOv8 Docs	Github Link
yolov9	YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information	Github Link

Object Tracking

Name	Paper	Github
ByteTrack	ByteTrack: Multi-Object Tracking by Associating Every Detection Box	Github Link
SORT	Simple Online and Realtime Tracking	Github Link

Pose Estimation

Name	Paper	Github
Alphapose	AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time	Github Link
MMPose	Papers Link	Github Link

Action Recognition

Name	Paper	Github
PoseC3D	Revisiting Skeleton-based Action Recognition	Github Link

• MMAction2

Abnormal Event Detection

Dataset

Video Anomaly Detection(VAD)

Type	Name	Metric	Link	Dataset Path	Downloaded
Eval	CUHK-Avenue	AUC	Link	mlsun/nfs_shared/abd/eval/CUHK-Avenue
Eval	ShanghaiTech	AUC	Link	mlsun/nfs_shared/abd/eval/ShanghaiTech
Eval	UBnormal	AUC	Link	mlsun/nfs_shared/abd/eval/UBnormal
Eval	UCF-Crime	AUC	Link	mlsun/nfs_shared/abd/eval/UCF_Crimes
Train	LAD2000		Link	mlsun/nfs_shared/abd/LAD2000
Train	NWPU-Campus		Link	mlsun/nfs_shared/abd/NWPU_Campus
Train	StreetScene		Link	mlsun/nfs_shared/abd/StreetScene
Eval	XD-Violence	AP	Link	mldisk2/nfs_shared/abd/XD-Violence

Fall

Type	Name	Metric	Link	Dataset Path	Downloaded

Wander

Type	Name	Metric	Link	Dataset Path	Downloaded

References

Method	Paper	Github	Feature	Framework	CUHK-Avenue	ShanghaiTech	UCF-Crime	UBnormal
BODS	Link	-	I3D	AE	-	-	68.2	-
GODS	Link	-	I3D	AE	-	-	69.4	-
VEC	Link	Github Link	OD	AE(FPM)	90.2	74.8	-	-
CAC	Link	-	A3D	Encoder	87.0	79.3	-	-
HF2	Link	Github Link	OD	AE(FPM)	91.1	76.2	-	-
BAF	Link	Github Link	OD	AE	92.3	82.7	-	59.3
BDPN	Link	-	OD	AE(FPM)	90.0	78.1	-	-
GCL	Link	-	R3D	GAN	-	79.6	74.2	-
SSL	Link	Github Link	OD	Encoder	92.2	84.3	-	-
	Link	Github Link			-	76.1	65.2	-
FPDM	Link	Github Link	Image	DDIM	90.1	78.6	74.7	62.7

Framework

Type	Framework	Paper	Github
Unsupervised Learning	Future Frame Prediction Method(FPM)	Link	Github Link
Unsupervised Learning	MemAE	Link	Github Link
Unsupervised Learning	AnoGAN	Link	Github Link
Weakly Supervised Learning	Multiple Instance Learning(MIL)	Link	Github Link
Weakly Supervised Learning	Regularized Two-Stream Feature Matching(RTFM)	Link	Github Link
Weakly Supervised Learning	Clustering Assisted Weakly Supervised Learning(CLAWS)	Link	Github Link

OpticalFlow

• Awesome-Optical-Flow