README-Downloads.md

---

Home     |     Data format     |     Data splits     |     Data loader     |     Challenges     |     Leaderboards

---

Downloads

This dataset is publicly released under the Creative Commons licence CC-BY-NC-SA 4.0. This implies that:

• the dataset cannot be used for commercial purposes,
• the dataset can be transformed (additional annotations, etc.),
• the dataset can be redistributed as long as it is redistributed under - the same license with the obligation to cite the contributing work which led to the generation of the CholecT50 and CholecT40 datasets.

---

If you wish to have access to any of the CholecTriplet datasets, kindly fill the request form associated with it. When using the dataset, you are kindly requested to cite the associated publication in order to properly credit the authors and clinicians for their efforts in generating the dataset.

---

CholecT50

• Official release date: February 20, 2023
• Associated publication: Nwoye, et.al. 2022 [1]
• Download access: Request form
  More info:

  VIDEO DETAILS # videos 50 # frames 100.9K # videos with bbox 5 # videos with bbox - triplet matching 5

  LABEL STATISTICS Label Type # Category # Instances triplets binary 100 151.0K instruments binary 6 151.0K instruments bbox 6 13.0K verbs binary 10 151.0K targets binary 15 151.0K phases binary 7 100.9K

---

CholecT50 Challenge Validation set

• Official release date: June 1, 2022

• Associated publication: Nwoye, et.al. 2023 [3]

• Download access: Download now

  More info:

  VIDEO DETAILS # Clips (videos slices) 5 # frames 1.1K # Clips with bbox 5 # Clips with bbox - triplet matching 5

  LABEL STATISTICS Label Type # Category # Instances triplets binary 100 1.3K instruments binary 6 1.3K instruments bbox 6 1.3K verbs binary 10 1.3K targets binary 15 1.3K phases binary 7 1.1K

• Here, bbox labels are outsourced from m2cai16-tool-location [4] dataset.
  

---

CholecT45

• Official release date: April 12, 2022
• Associated publication: Nwoye, et.al. 2022 [1]
• Download access: Request form
  More info:

  VIDEO DETAILS # videos 45 # frames 90.5K

  LABEL STATISTICS Label Type # Category # Instances triplets binary 100 137.9K instruments binary 6 137.9K verbs binary 10 137.9K targets binary 15 137.9K phases binary 7 90.5K

---

CholecT40

• Official release date: N/A
• Associated publication: Nwoye, et.al. 2020 [2]
• Download access: Request form
  More info:

  VIDEO DETAILS # videos 40 # frames 83.2K

  LABEL STATISTICS Label Type # Category # Instances triplets binary 128 135K instruments binary 6 135K verbs binary 8 135K targets binary 19 135K

---

References

• [1] C.I. Nwoye, T. Yu, C. Gonzalez, B. Seeliger, P. Mascagni, D. Mutter, J. Marescaux, N. Padoy. Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos. Medical Image Analysis 2022.

  @article{nwoye2021rendezvous,
    title={Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos},
    author={Nwoye, Chinedu Innocent and Yu, Tong and Gonzalez, Cristians and Seeliger, Barbara and Mascagni, Pietro and Mutter, Didier and Marescaux, Jacques and Padoy, Nicolas},
    journal={Medical Image Analysis},
    volume={78},
    pages={102433},
    year={2022}
  }
  

  

  
  

• [2] C.I. Nwoye, T. Yu, C. Gonzalez, P. Mascagni, D. Mutter, J. Marescaux, N. Padoy. Recognition of instrument-tissue interactions in endoscopic videos via action triplets.International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2020.

  @inproceedings{nwoye2020recognition,
     title={Recognition of instrument-tissue interactions in endoscopic videos via action triplets},
     author={Nwoye, Chinedu Innocent and Gonzalez, Cristians and Yu, Tong and Mascagni, Pietro and Mutter, Didier and Marescaux, Jacques and Padoy, Nicolas},
     booktitle={International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
     pages={364--374},
     year={2020},
     organization={Springer}
  }
  

  

  
  

• [3] C.I. Nwoye, T. Yu, S. Sharma, A. Murali, D. Alapatt A. Vardazaryan, K. Yuan, ... , D. Mutter, N. Padoy. CholecTriplet2022: Show me a tool and tell me the triplet: an endoscopic vision challenge for surgical action triplet detection. arXiv PrePrint arXiv:2204.14746. 2023.

  @article{nwoye2023cholectriplet2022,
    title={CholecTriplet2022: Show me a tool and tell me the triplet: an endoscopic vision challenge for surgical action triplet detection.},
    author={Nwoye, Chinedu Innocent and Yu, Tong and Sharma, Saurav and Murali, Aditya and Alapatt, Deepak and Vardazaryan, Armine ... Gonzalez, Cristians and Padoy, Nicolas},
    journal={arXiv preprint arXiv:2204.14746},
    year={2023}
  }
  

  

  
  

• [4] A. Jin, S. Yeung, J. Jopling, J. Krause, D. Azagury, A. Milstein, L. Fei-Fei: Tool detection and operative skill assessment in surgical videos using region-based convolutional neural networks. In: WACV, pp. 691–699. 2018

  @inproceedings{jin2018tool,
     title={Tool detection and operative skill assessment in surgical videos using region-based convolutional neural networks},
     author={Jin, A., Yeung, S., Jopling, J., Krause, J., Azagury, D., Milstein, A., Fei-Fei, L.},
     booktitle={WACV},
     pages={691--699},
     year={2018}
  }