this post was submitted on 23 Mar 2025
92 points (88.3% liked)

Futurology

2397 readers
473 users here now

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] LeFrog@discuss.tchncs.de 11 points 1 week ago* (last edited 1 week ago) (2 children)

I am able to identify 100% of cancer: just say "It is cancer" to each picture.

~~The article does not mention any other metrics than detection rate. What about recall etc.? Without it, this news is basically worthless.~~

I stand corrected, see the comments below. While the article still lacks important context, accuracy is well defined for this topic.

[–] iii@mander.xyz 20 points 1 week ago* (last edited 1 week ago) (1 children)

Accuracy in a classification context is defined as (N correct classifications / total classifications). So classifying everything as cancer would, in a balanced dataset, give you ~50% accuracy.

This article is indeed badly written PR fluff. I linked the paper in a sister comment. Both the confusion matrix and the ROC curve look phenomenal. Train/test/validation split seems fine too, as do the training diagnostics, so I'm optimistic that it isn't a case of overfitting.

Ofcourse 3rd party replication would be welcome, and I can't speak to the medical relevanve of the dataset. But the computer vision side of things seems well executed.

[–] LeFrog@discuss.tchncs.de 5 points 1 week ago

Thx for the comment! I edited my post accordingly.

[–] stray@pawb.social 7 points 1 week ago (2 children)

with an impressive 99.26% accuracy.

I feel this would be a blatant lie if it included a bunch of false positives.

https://mander.xyz/comment/17810389

While keeping the FPR low, our model keeps the TPR high, showing that it can accurately find real cases while reducing false alarms.

I'm not educated enough to know what recall means in this context, but there's tables with percentages for it in the page. (Would love an explanation; I'm not sure what to search for to get the right definition.)

[–] iii@mander.xyz 3 points 1 week ago* (last edited 1 week ago)

I'm not educated enough to know what recall means in this context

This wiki describes the terminology for a binary classification. I always have to refer to that page too, as it's very confusing :)

[–] LeFrog@discuss.tchncs.de 2 points 1 week ago

Thx for the comment! I edited my post accordingly.