Classification performance of the five-category pathological classification model in four cohorts
| Cohort | Histologic type | Prediction performance | |||||
|---|---|---|---|---|---|---|---|
| AUC (95% CI) | Sensitivity | Specificity | PPV | NPV | Accuracy | ||
| Training (n = 600) | IPMN | 0.95 (0.93–0.96) | 0.81 | 0.91 | 0.77 | 0.93 | 0.88 |
| MCN | 0.85 (0.80–0.88) | 0.48 | 0.91 | 0.54 | 0.89 | 0.83 | |
| SCN | 0.90 (0.87–0.93) | 0.73 | 0.86 | 0.71 | 0.86 | 0.81 | |
| NET | 0.97 (0.95–0.98) | 0.78 | 0.97 | 0.74 | 0.97 | 0.94 | |
| SPN | 0.99 (0.97–0.99) | 0.85 | 0.99 | 0.90 | 0.98 | 0.97 | |
| Mean | 0.92 (0.90–0.94) | 0.73 | 0.93 | 0.73 | 0.93 | 0.89 | |
| Internal validation (n = 258) | IPMN | 0.95 (0.93–0.97) | 0.79 | 0.92 | 0.79 | 0.92 | 0.88 |
| MCN | 0.87 (0.81–0.94) | 0.61 | 0.92 | 0.61 | 0.92 | 0.86 | |
| SCN | 0.90 (0.86–0.94) | 0.75 | 0.86 | 0.72 | 0.88 | 0.83 | |
| NET | 0.96 (0.88–0.99) | 0.76 | 0.98 | 0.81 | 0.97 | 0.95 | |
| SPN | 0.98 (0.95–1.00) | 0.82 | 0.98 | 0.85 | 0.98 | 0.97 | |
| Mean | 0.93 (0.90–0.95) | 0.75 | 0.93 | 0.76 | 0.93 | 0.90 | |
| Temporal validation (n = 244) | IPMN | 0.96 (0.93–0.98) | 0.90 | 0.90 | 0.80 | 0.95 | 0.90 |
| MCN | 0.91 (0.87–0.95) | 0.54 | 0.90 | 0.46 | 0.93 | 0.85 | |
| SCN | 0.90 (0.87–0.94) | 0.62 | 0.91 | 0.75 | 0.85 | 0.82 | |
| NET | 0.87 (0.78–0.95) | 0.50 | 0.94 | 0.39 | 0.96 | 0.91 | |
| SPN | 0.98 (0.95–0.99) | 0.73 | 0.98 | 0.88 | 0.95 | 0.94 | |
| Mean | 0.93 (0.91–0.95) | 0.66 | 0.93 | 0.66 | 0.93 | 0.88 | |
| Prospective validation (n = 58) | IPMN | — | 1.00 | 0.85 | 0.76 | 1.00 | 0.90 |
| MCN | — | 0.86 | 0.98 | 0.86 | 0.98 | 0.97 | |
| SCN | — | 0.65 | 0.97 | 0.93 | 0.84 | 0.86 | |
| NET | — | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | |
| SPN | — | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | |
| Mean | — | 0.90 | 0.96 | 0.91 | 0.96 | 0.86 | |
AUC, area under the receiver operating characteristic curve; CI, confidence interval; IPMN, intraductal papillary mucinous neoplasm; MCN, mucinous cystic neoplasm; SCN, serous cystic neoplasm; SPN, solid pseudopapillary neoplasm; NET, neuroendocrine tumor; NPV, negative predictive value; PPV, positive predictive value.