10  Discordance Analysis

11 Discordance Analysis

This section analyzes cases where there was a disagreement between the AI, the Pathologists, and the Reference Diagnosis (Research Diagnosis).

11.1 AI vs Reference Diagnosis

Total Discordant Cases (AI vs Gold): 20

11.1.1 Discordant Cases Table

Slide_Label Dx_Paige Dx_Research case_difficulty

11.2 Pathologist Discordance (No AI)

We analyze cases where pathologists disagreed with the Reference Diagnosis without AI assistance.

Error Rates without AI
Pathologist Error_Rate_NoAI
P1 0.826
P2 0.953
P3 0.947
P4 0.899

11.3 Impact of AI on Discordance

Did AI help correct these errors?

Number of Cases Corrected by AI
Pathologist Cases_Improved
P1 0
P2 0
P3 0
P4 0

11.4 Common Features of Discordant Cases

Are “Hard” cases more likely to be discordant?

Any Pathologist Error (No AI)
Total
FALSE TRUE
case_difficulty


    Difficult 0 (0%) 89 (100%) 89 (100%)
    Easy 598 (100%) 0 (0%) 598 (100%)
    Moderate 0 (0%) 136 (100%) 136 (100%)
Total 598 (73%) 225 (27%) 823 (100%)