Evaluation, Reproducibility, Benchmarks Meeting 19

Minutes of meeting 19

Date: 28th September 2022

Present: Carole, Annika, Nicola, Keyvan, Michela

---

TOP 1: Metric implementation

• Highlight metrics in MONAI
• Carole did an implementations of all metrics from the framework
• They should be in a linked MONAI side repository
• Goal: Hackathon to test and break implementation (Nicola will ask people)
• Package gives warnings when things are done wrong

---

TOP 2: Data

• Which questions could be of interest for our WG?
  • How to split data?
  • How to store data?
  • Meta information
• Consider SIG webinar about data organization