Skip to content

Issues: Lightning-AI/torchmetrics

Create gallery of realistic examples
#2438 opened Mar 7, 2024 by Borda
Open 1
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
26 Open 560 Closed
26 Open 560 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Multiclass accuracy with micro and top-k does not work as expected. bug / fix Something isn't working help wanted Extra attention is needed
#3068 opened Apr 17, 2025 by mmcdermott
4
meanIoU calculation error for 1.8.0.dev0 (build from source) bug / fix Something isn't working help wanted Extra attention is needed
#3047 opened Apr 7, 2025 by insomniaaac
3
Multi Label Precision numerical stability issues with MPS bug / fix Something isn't working duplicate This issue or pull request already exists help wanted Extra attention is needed v1.6.x
#2955 opened Feb 15, 2025 by dmnkf
3
GeneralizedDiceScore yields 0 scores when using per_class=True for samples where class is not present bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed v1.6.x v1.7.x
#2846 opened Nov 28, 2024 by nkaenzig
3
Reference Metric in multiclass pecision recall unittests provides wrong answer when ignore_index is specified with average = 'macro' bug / fix Something isn't working help wanted Extra attention is needed Priority Critical task/issue v1.5.x
#2828 opened Nov 5, 2024 by rittik9
3
[Bug] torchmetrics.functional.classification.binary_auroc gives wrong results when logits are large bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed v1.4.x v1.6.x v1.7.x
#2819 opened Nov 2, 2024 by zbingsong
2
BERT score: maximum at self-comparison, symmetry, invariance to additional items bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed v1.4.x
#2728 opened Sep 9, 2024 by GPPassos
4
Classification Report, maybe with the option to select even more metrics enhancement New feature or request help wanted Extra attention is needed
#2580 opened Jun 1, 2024 by rakro101
@rittik9
3
[Bug] No backend type associated with device type cpu bug / fix Something isn't working help wanted Extra attention is needed v1.3.x
#2477 opened Mar 27, 2024 by rballeba
@SkafteNicki
12
Metric not moved to device and invalids the cpu-gpu offloading when combining with DeepSpeed bug / fix Something isn't working help wanted Extra attention is needed Priority Critical task/issue v1.3.x
#2473 opened Mar 26, 2024 by qingquansong
@SkafteNicki
1
Create gallery of realistic examples documentation Improvements or additions to documentation enhancement New feature or request help wanted Extra attention is needed wontfix
#2438 opened Mar 7, 2024 by Borda
1
MPS uninitialized memory(?) causing errors in StatScores (which cascade to other locations) bug / fix Something isn't working help wanted Extra attention is needed Priority Critical task/issue v1.3.x
#2383 opened Feb 14, 2024 by spott
3
BinaryPrecisionRecallCurve computes wrong value if used with logits, even though the docstring says this is supported bug / fix Something isn't working help wanted Extra attention is needed v1.3.x wontfix
#2329 opened Jan 29, 2024 by NoahAtKintsugi
1
2
Inconsistent default values for average argument in classification metrics bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed question Further information is requested v1.3.x
#2320 opened Jan 22, 2024 by StefanoWoerner
2
@SkafteNicki
4
Calculations nDCG using GPU are 2x slower than CPU bug / fix Something isn't working help wanted Extra attention is needed v1.2.x wontfix
#2287 opened Dec 29, 2023 by donglihe-hub
6
Multiclass Accuracy, Precision, Recall, and F1Score the same (documentation issue?) help wanted Extra attention is needed question Further information is requested v1.2.x
#2280 opened Dec 22, 2023 by turian
@SkafteNicki
2
Refactored Accuracy metric no longer tolerate empty tensor help wanted Extra attention is needed question Further information is requested v1.2.x
#2279 opened Dec 22, 2023 by kasakun
@SkafteNicki
1
Conversion from logits to probabilities happens on a batch by batch basis bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed v1.0.x
#2195 opened Oct 31, 2023 by GabrielBianconi
1
7
AUROC reported wrong value when called differently bug / fix Something isn't working help wanted Extra attention is needed v1.0.x wontfix
#1989 opened Aug 9, 2023 by SinChee
1
3
Memory Leak in FrechetInceptionDistance if used in training_step bug / fix Something isn't working help wanted Extra attention is needed topic: Image v1.0.x
#1959 opened Aug 1, 2023 by nicoloesch v1.3.x
@SkafteNicki
1
Using Torchmetrics with torch.compile in Pytorch 2.0 bug / fix Something isn't working help wanted Extra attention is needed Priority Critical task/issue v0.11.x
#1780 opened May 13, 2023 by ductai199x future
6
binary_auroc has various bugs on MPS device bug / fix Something isn't working help wanted Extra attention is needed v0.11.x
#1727 opened Apr 23, 2023 by GabrielDamsholt future
7
BinaryAccuracy() sometimes gives incorrect answers due to non-deterministic sigmoiding bug / fix Something isn't working help wanted Extra attention is needed v1.1.x
#1604 opened Mar 9, 2023 by idc9 v1.3.x
1
2
Sigmoid function in PrecisionRecallCurve leads to information loss bug / fix Something isn't working help wanted Extra attention is needed v0.11.x
#1526 opened Feb 20, 2023 by djdameln
1
@SkafteNicki
3
Supporting mask enhancement New feature or request help wanted Extra attention is needed
#1282 opened Oct 20, 2022 by ZhaofengWu future
3
ProTip! Exclude everything labeled bug with -label:bug.