|
| 1 | +# This CITATION.cff file was generated with cffinit. |
| 2 | +# Visit https://bit.ly/cffinit to generate yours today! |
| 3 | + |
| 4 | +cff-version: 1.2.0 |
| 5 | +title: >- |
| 6 | + SpaceHack 2.0: an expert in the loop consensus driven |
| 7 | + framework for spatially aware clustering |
| 8 | +message: >- |
| 9 | + If you use this software, please cite it using the |
| 10 | + metadata from this file. |
| 11 | +type: software |
| 12 | +authors: |
| 13 | + - name: SpaceHack 2.0. Participants |
| 14 | +repository-code: 'https://github.com/SpatialHackathon/SpaceHack2023' |
| 15 | +url: 'https://spatialhackathon.github.io/past.html' |
| 16 | +abstract: >- |
| 17 | + Spatial omics have transformed tissue architecture and |
| 18 | + cellular heterogeneity analysis by integrating molecular |
| 19 | + data with spatial localization. In spatially resolved |
| 20 | + transcriptomics, identifying spatial domains is critical |
| 21 | + for analysis of anatomical regions within heterogeneous |
| 22 | + datasets and understanding tissue function. Since 2020, |
| 23 | + more than 50 spatially aware clustering methods have been |
| 24 | + developed for this task. However, the reliability of |
| 25 | + existing benchmarks is undermined by their narrow focus on |
| 26 | + Visium and brain tissue datasets, as well as the |
| 27 | + dependence on questionable ground truth annotations. Here, |
| 28 | + we implemented a consensus framework that surpasses |
| 29 | + traditional benchmarking practices. |
| 30 | +
|
| 31 | +
|
| 32 | + Our framework comprises a community-driven benchmark-like |
| 33 | + platform that streamlines data formatting, method |
| 34 | + integration, and metric evaluation while accommodating new |
| 35 | + methods and datasets. Currently, the platform includes 22 |
| 36 | + spatially aware clustering methods across 15 datasets |
| 37 | + spanning 9 technologies and diverse tissue types. The |
| 38 | + benchmark approach uncovered significant limitations in |
| 39 | + generalizability and reproducibility where methods that |
| 40 | + perform well on healthy tissues often falter on cancer |
| 41 | + samples. We also found that anatomical labels commonly |
| 42 | + used as ground truths are often biased, potentially |
| 43 | + error-prone, and in some cases, unsuitable for |
| 44 | + benchmarking efforts. |
| 45 | +
|
| 46 | +
|
| 47 | + In light of these issues, we adopt a flexible |
| 48 | + expert-in-the-loop consensus-driven approach. This goes |
| 49 | + beyond traditional ensemble/consensus methods, and allows |
| 50 | + researchers to interact with intermediate results to |
| 51 | + determine which tools should be used to generate a |
| 52 | + consensus. We believe that the inclusion of an |
| 53 | + expert-in-the-loop is critical to ensure that the |
| 54 | + computational analysis matches the biological question at |
| 55 | + hand, and we believe that when the focus of the analysis |
| 56 | + is to un cover novel biological discoveries, tissue |
| 57 | + experts are accessible more often than not. |
| 58 | +license: MIT-0 |
0 commit comments