Abstract
Objective: Accurate preoperative identification of benign or malignant pancreatic cystic neoplasms (PCN) may help clinicians make better intervention choices and will be essential for individualized treatment.
Methods: Preoperative ultrasound and laboratory examination findings, and demographic characteristics were collected from patients. Multiple logistic regression was used to identify independent risk factors associated with malignant PCN, which were then included in the nomogram and validated with an external cohort. The Net Reclassification Index (NRI) and Integrated Discrimination Improvement (IDI) were calculated to evaluate the improvement in the predictive power of the new model with respect to that of a combined imaging and tumor marker prediction model.
Results: Malignant PCN were found in 83 (40.7%) and 33 (38.7%) of the model and validation cohorts, respectively. Multivariate analysis identified age, tumor location, imaging of tumor boundary, blood type, mean hemoglobin concentration, neutrophil-to-lymphocyte ratio, carbohydrate antigen 19-9, and carcinoembryonic antigen as independent risk factors for malignant PCN. The calibration curve indicated that the predictions based on the nomogram were in excellent agreement with the actual observations. A nomogram score cutoff of 192.5 classified patients as having low vs. high risk of malignant PCN. The model achieved good C-statistics of 0.929 (95% CI 0.890–0.968, P < 0.05) and 0.951 (95% CI 0.903–0.998, P < 0.05) in predicting malignancy in the development and validation cohorts, respectively. NRI = 0.268; IDI = 0.271 (P < 0.001 for improvement). The DCA curve indicated that our model yielded greater clinical benefits than the comparator model.
Conclusions: The nomogram showed excellent performance in predicting malignant PCN and may help surgeons select patients for detailed examination and surgery. The nomogram is freely available at https://wangjunjinnomogram.shinyapps.io/DynNomapp/.
keywords
Introduction
In recent years, with increasing development and application of imaging technology, and greater public health awareness, the detection rate of pancreatic cystic neoplasms (PCN) has been increasing annually1. The most common types of PCN are serous cystic neoplasms (SCN), mucinous cystic neoplasms (MCN), and intraductal papillary mucinous neoplasms (IPMN). These PCN are considered to develop from low-grade dysplasia to high-grade dysplasia, and then to invasive cancer2,3. After aggressive disease develops, the survival outcomes are similar to those of traditional pancreatic cancer. As the detection rate and the potential risk of malignant transformation increase each year, the diagnosis and treatment of PCN are receiving increasing attention from clinicians. Because surgery itself increases patients’ mortality and morbidity, optimal surveillance for patients with PCN is becoming an increasingly common clinical problem.
The primary goal of preoperative PCN diagnosis is to prevent malignancies and avoid unnecessary surgery. Clinicians are frequently challenged by differential diagnosis and subsequent management of the various types of lesions in the pancreas, thus potentially leading to overtreatment or delayed treatment. Therefore, careful diagnosis is required to determine whether a lesion is benign or malignant, or has malignant potential, and clinicians must assess whether patients are at high risk or low risk before surgery. At present, most physicians believe that resection of high-grade intraepithelial neoplastic tumors has important therapeutic value. They can choose minimally invasive and functional surgery, and avoid late chemotherapy and radiotherapy, thus greatly improving patient prognosis and quality of life. However, on the basis of analysis of postoperative pathological results, less than half of all patients who undergo pancreatectomy have high-risk pathology, thus suggesting that current methods for resection and evaluation of pancreatic cystic tumors are imperfect. Excessive surgical treatment may result, thus harming patients and consuming many medical resources.
Currently, the early detection of PCN is mainly incidental through ultrasound during physical examinations. Most patients undergo further investigation such as enhanced computed tomography (CT) and/or enhanced magnetic resonance imaging (MRI), endoscopic ultrasound-guided fine-needle aspiration biopsy, and surgical resection after a lesion is detected4. Imaging examinations can determine the location, shape, size, and number of tumors, as well as the presence of solid components, thus serving as an important tool to determine PCN benignity or malignancy preoperatively. However, most studies have shown that no single imaging test is sufficiently accurate to distinguish benign from malignant PCN. A systematic review has shown that the accuracy of CT and MRI in distinguishing benign from malignant PCN is 71%–80% and 55%–76%, respectively5. Although cystic fluid analysis for the diagnosis of MCN and IPMN provides high accuracy6, no guidelines recommend the use of these methods, and fine-needle aspiration of cystic fluid is theoretically associated with the risk of tumor implantation and relatively high financial pressure on patients; therefore, this method is controversial and is performed in only several centers.
Blood is rich in tumor-associated biomarkers, and each molecule in the blood has its own potential diagnostic, prognostic, and surveillance value for cancer. Some blood inflammatory indicators such as the neutrophil-to-lymphocyte ratio (NLR), platelet-to-lymphocyte ratio (PLR), and lymphocyte-to-monocyte ratio7–11 can be used as markers of the systemic inflammatory response and as independent predictors of prognosis in various malignancies including pancreatic cancer. Platelets can provide relevant information regarding cancer12. The non-O blood type is also considered a risk factor for malignant tumors13,14.
Abdominal ultrasound is simple and inexpensive, can detect cystic lesions of the pancreas and differentiate them from solid lesions, and is currently used as a primary screening tool for PCN in clinical practice. In this study, we sought to combine ultrasound imaging, laboratory examination, and patient demographic characteristics to develop and externally validate a new model. This model can accurately predict the risk of malignancy in PCN in an easy, safe, and economical manner, and may help clinicians select appropriate interventions at the time of the initial patient diagnosis.
Materials and methods
The study was approved by the Ethics Committee of the Tianjin Medical University Cancer Institute & Hospital (Approval No. bc2019063). All patients provided written informed consent approving the use of their data for research purposes.
Indications for surgery
Surgical resection was performed for patients who met the following indications. First, pathological biopsy suggesting cellular carcinoma, with invasive carcinoma or a clinically suspected malignant cystic tumor, was an absolute indication for surgical intervention. Second, patients with tumor-associated obstructive jaundice or recurrent episodes of acute pancreatitis as well as abdominal pain, abdominal distension, nausea, vomiting, or diarrhea were recommended to undergo surgical resection. Third, surgical resection was recommended for patients with excessive tumor size (> 3 cm), a rapid tumor growth rate (> 5 mm/year), imaging showing cysts communicating with the main pancreatic duct, main pancreatic duct dilatation ≥ 1 cm, and abnormally elevated tumor markers.
Patient selection
The data for patients admitted to Tianjin Medical University Cancer Institute & Hospital between June 2018 and June 2021 with pathology confirmed as PCN after surgery were retrospectively analyzed to form a development cohort. The main patient inclusion criteria were as follows: (1) primary patients with pathologically confirmed IPMN, MCN, or SCN after surgical treatment and (2) patients with complete clinical information, including past medical history, laboratory tests, imaging tests, and postoperative pathological examinations.
The exclusion criteria included (1) patients with malignant tumors other than pancreatic cancer, (2) patients who had undergone chemotherapy, radiotherapy, or other tumor-related treatments, (3) patients with other pancreatic diseases or who had undergone pancreatic-related surgeries, and (4) patients with incomplete clinical information.
The 86 patients with PCN diagnosed at the Affiliated Hospital of Qingdao University from 2018 to 2020 were included in the validation cohort.
SPN were not included in this study, because of the clear difference in imaging features and demographic characteristics with respect to those of the other 3 types, and the clear indication for surgery. MCN and IPMN are considered to form malignant cystic tumors more readily, whereas SCN are mostly benign tumors. However, SCN were included in our study because they have diverse imaging features and are prone to misdiagnosis as malignant tumors. According to the classification proposed by Kimura et al.15, SCN can be classified into 4 types: microcystic, macrocystic, mixed, and solid. Macrocystic SCN can sometimes appear unicystic without separation or oligocystic with little separation, which is indistinguishable from mucinous cystadenoma. Mixed type SCN usually show a small cyst in the middle and a large cyst at the periphery. The cysts of solid SCN are small and often appear solid on imaging, the small cystic structures inside are difficult to detect. More than 70% of SCN are microcystic in nature, and their typical imaging features include stellate central scarring and spoke-like microsegments with lobulated periphery, thin walls, numerous microcysts forming a honeycomb section inside, and no communication with the pancreatic duct. However, several microcystic SCN have atypical clinical and imaging manifestations, which may be accompanied by pancreatic duct and/or bile duct dilatation, pancreatic parenchymal atrophy, suspicion of vascular invasion, invasion of adjacent organs, communication with the pancreatic duct, and other atypical imaging features16,17.
Data collection
The clinical data collected mainly included baseline characteristics of patients, clinical manifestations, laboratory examinations, ultrasound imaging, and pathological diagnosis. Jaundice was defined by total serum bilirubin > 34.2 μmol/L, and a solid component was defined as a cystic area suggestive of a real component on preoperative ultrasound. Benign PCN were defined as cystic adenoma or low-/moderate-grade dysplasia (CIN I/II) confirmed by a pathological report in the postoperative histological section. Malignant PCN were defined as high-grade dysplasia (CIN III)/associated invasive carcinoma with PCN.
Statistical analysis
Tumor benignity and malignancy were used as dependent variables, and the cutoff values for continuous variables were determined with the pROC package. The clinical data for patients in the development cohort were analyzed with Best Subsets Regression (BSR), Lasso regression, and univariate logistic regression. The variables screened by Lasso regression and those with P < 0.15 in the univariate analysis were subjected to backward stepwise regressions. The variables screened by the 3 approaches were included in the multi-factor regression model based on the Akaike information criterion to select the combination of variables with the smallest AIC. The variables with P < 0.05 in multiple logistic regression were used to develop the nomogram.
The discrimination ability of the nomogram was identified by application of the concordance index (C-index). The calibration curve was plotted to reflect the consistency between the observed results and the predicted probabilities. The score of each patient in the nomogram was calculated. A receiver operating characteristic (ROC) curve was plotted, and the area under the curve was calculated to assess the predictive efficacy of the model, and the optimal cutoff value was determined on the basis of the Youden index. To assess the utility of the model, we compared the nomogram with the common clinical imaging features assessed in combination with tumor markers; NRI and IDI were calculated; and decision curve analysis (DCA) was used to determine the clinical utility of the nomogram by quantifying the net benefit at different threshold probabilities. Finally, clinical data from the validation cohort were used to assess the accuracy, sensitivity, and specificity of the predictive model. All statistical analyses were performed in SPSS version 26.0 (IBM) and R version 4.1.0 (http://www.r-project.org/).
Results
Demographics
A total of 204 patients with PCN were included in the development cohort, including 88 cases of IPMN (43.1%), 30 cases of MCN (14.7%), and 86 cases of SCN (42.2%). The average age of the included patients was 56.5 years, ranging from 20 to 76 years of age. Among them, 122 cases were in women, and 82 cases were in men. The pathological types included 121 cystadenomas/CIN I/II and 83 cases of CIN III/invasive carcinoma associated with PCN. The validation cohort consisted of 86 patients diagnosed with PCN at the Affiliated Hospital of Qingdao University from 2018 to 2020, including 27 cases of SCN (31.4%), 28 cases of MCN (32.6%), and 31 cases of IPMN (36.0%). The mean age of the validation cohort was 60 years. The pathological types included 53 cystadenomas/CIN I/II and 33 cases of CIN III/invasive carcinoma associated with PCN.
Univariate regression analysis
Table 1 presents the results of univariate regression of variables in the model cohort. BSR, Lasso regression, and multiple-factor backward stepwise regression were performed to screen variables in the model cohort, and the results are displayed in Figure 1. Multivariate analysis identified age, location, boundary, blood type, MCHC, NLR, CA19-9, and CEA as independent predictors of malignant PCN (Figure 2A).
The above independent risk factors did not significantly differ between the development cohort and the external validation cohort (Table 2).
Development of the nomogram
The 8 independent predictors described above were integrated into a malignant PCN risk nomogram (Figure 2B). To facilitate use, the nomogram is also provided as a calculator online (https://wangjunjinnomogram.shinyapps.io/DynNomapp/). The sensitivity, specificity, and accuracy of prediction of malignant PCN in the development cohort were 84.3%, 89.3%, and 87.3%, respectively. The C-index for the nomogram in the development cohort was 0.929 (95% CI 0.890–0.968), and the Hosmer–Lemeshow goodness of fit test indicated that the model had a good fit (P = 0.20). The bootstrap method was used to resample the development cohort 1000 times and plot the calibration curve. The calibration curve indicated excellent agreement between the predicted risk of malignant PCN and the actual observations (Figure 3A). The total score for each patient was calculated on the basis of the nomogram, and the optimal cutoff value for the total score in the model cohort, on the basis of pROC, was determined to be 192.5.
In the external validation cohort, the C-index for the nomogram was 0.951 (95% CI 0.903–0.998), and the sensitivity, specificity, and accuracy of predicting malignant PCN were 93.9%, 84.9%, and 88.4%, respectively; the calibration curve also showed good agreement (Figure 3B).
Diagnostic value according to the nomogram cutoff for malignancy
After reclassification with the nomogram, the NRI for the model group was 0.268 (P < 0.001), and the IDI was 0.271 (P for improvement < 0.001) (Table 3). To use the nomogram for treatment decision-making, we performed DCA (Figure 4). The DCA indicated the net clinical benefit of risk stratification for patients with the model. When the risk threshold probability of the model is > 0.1, the utilization of the model yields more benefits than all-treatment and no-intervention. In our study, treatment refers to other diagnostic examinations and surgery. Surgery is recommended for all patients with substantial symptoms and high suspicion of malignant PCN, whereas patients in whom the nature of PCN cannot be determined and no clinical symptoms are present can be considered for further treatment options after prediction with this model.
Discussion
In this study, the preoperative testing results and demographic characteristics of the model cohort were analyzed in conjunction with postoperative pathological data, and 8 factors—increased CA19-9, increased CEA, increased NLR, increased MCHC, non-O blood group, age > 55 years, cyst located in the head or neck of the pancreas, and unclear cyst imaging border—were finally identified as independent predictors of malignant PCN. A predictive model was developed accordingly, and the area under the ROC curve was calculated to be 0.929 (95% CI 0.890–0.968); the calibration curve showed approximate agreement with the ideal diagnostic curve. The risk prediction model based on the above independent risk factors performed well in the validation group, with a diagnostic accuracy of 88.4%. We also applied the model to 4 newly admitted patients who were not included in the developmental cohort for preoperative scoring to predict their malignant risk and validated the results with their postoperative pathological results. The information on the patients and the predicted results are shown in Supplementary Figures S1–S4. In addition, this model included basic clinical data, imaging information, and laboratory examinations of patients, thus enabling better understanding and providing greater reliability than the current guidelines and recommendations, as well as better discriminatory power. When the above risk factors are present simultaneously, the model indicates a higher risk of malignancy of this tumor, and surgery can be considered. However, the number of samples included in this study was small, and the possibility that the accuracy was elevated because of selection bias cannot be excluded. In future studies, we plan to subsequently include more specimens for model development and prospective validation against this model.
Currently, 3 guidelines provide recommendations on PCN surveillance and surgical resection based on symptoms and known risk of malignancy: the 2015 American Gastroenterological Association (AGA)18,19, the International Association of Pancreatology (IAP)20, and the European Study Group on Cystic Tumours of the Pancreas (European)21. The IAP20 and the European21 guidelines were revised in 2017 and 2018, respectively. The decision to surgically remove PCN depends on an accurate diagnosis. Current guidelines for predicting the risk of malignancy in pancreatic cysts require expensive imaging and invasive examinations. Cystic fluid analysis is used to supplement the information obtained from imaging. Although cyst classification based on tissue biopsy and cystic fluid analysis is more accurate, it may carry some risks and complications, owing to the invasive character of the procedure. In addition, single-site biopsies cannot interpret the entire lesion, thus increasing the probability of missed diagnosis. Using imaging for classification is noninvasive. CT and MRI have equivalent accuracy, but CT is associated with a risk of repeated exposure to radiation, whereas MRI is the recommended modality for diagnosis and surveillance of PCN, owing to its high resolution and ability to discriminate the main pancreatic duct. Unfortunately, these imaging techniques are expensive and have limited accuracy in distinguishing malignant from benign cysts.
In a study with a 5-year follow-up, the baseline weighted prevalence of pancreatic cysts was 49.1% among 1,077 observed participants. In the 367 participants who received 5-year follow-up without cysts at baseline, the incidence of pancreatic cysts was 12.9% (2.6% per year)1, and a significant association was observed between prevalence and age. Older people had a higher prevalence of PCN. Although screening and intervention for patients with PCN, a group with high pancreatic cancer risk, is necessary, the prevalence of PCN leads to thousands of unnecessary medical and surgical interventions every year. These procedures are associated with substantial risks and comorbidities, particularly for older people. Even in patients who do not require surgery, substantial time and resources are needed to monitor patients for several years after initial detection. This surveillance includes expensive imaging techniques and invasive examinations, such as repeat endoscopic ultrasound-guided fine-needle aspiration biopsy, and eventual resection, thus increasing the financial burden on the health care system. In recent years, with the development of imaging, the accurate localization of abdominal ultrasound has become important for the diagnosis of pancreatic cancer, because it has the advantages of easy operation, higher accuracy, low cost, non-invasiveness, and wide applicability to the population. Simultaneously, abdominal ultrasound is the preferred imaging modality for almost all patients during outpatient visits or physical examinations. In addition, choosing ultrasound does not require abandoning other examinations. Ultrasound was used only as a screening index in our model; if the ultrasound findings were contrary to the predicted results of the model, we recommended that patients undergo further examinations22. In addition, although cyst size and solid components of the cyst were not included in the model in the results of this study, we believe that these factors remain important in the preoperative assessment of benignity and malignancy, because SCN and MCN are rich in cystic fluid and appear as large cystic foci, but have a low malignant tendency; therefore, tumor diameter is often not an accurate predictor of PCN benignity or malignancy. In a meta-analysis including 1058 patients, the ratio (OR) of IPMN with a diameter > 3 cm to potential malignancy was 62.4 (30.8–126.3) and was found to be the strongest predictor.
In this study, we combined abdominal ultrasound, routine blood tests, serum tumor markers, and demographic characteristics of patients to develop a new preoperative stratified prediction model for PCN, which can be used for the first consultation and long-term monitoring of patients with high accuracy and safety, thus providing economic benefits.
A meta-analysis investigating the ability of serum CA19-9 and CEA to identify invasive and malignant IPMN has found that CA19-9 has a sensitivity of 52% and 40% and a specificity of 88% and 89%, whereas CEA has a sensitivity of 18% and a specificity of 95% and 93% for invasive and malignant IPMN23. CA19-9 is commonly used for clinical monitoring of PDAC progression and assessment after surgical resection, and CEA has been used as a biomarker for various gastrointestinal malignancies24.
SCN often appears in the pancreatic body and tail, mostly in middle-aged women. In contrast, IPMN occurs mostly in the pancreatic head of older male patients, and MCN occurs mostly in older women. IPMN has been found to have a relatively higher malignant potential25,26. In our results, sex could not be considered a predictive factor for malignant PCN, but the location of the cyst in the pancreatic head and neck was an independent risk factor, in agreement with the cystic characteristics described above. One study has reported that patients with malignant cysts are significantly older than those with benign cysts27. This result is also consistent with our finding that age is associated with malignant PCN.
Inflammation plays a key role in cancer occurrence and progression28. Recently, extensive evidence has indicated that inflammatory indicators also play an important role in predicting benign and malignant PCN29. Our study provided another demonstration that NLR is an independent factor influencing malignant PCN; the threshold value selected for NLR was 1.79, in general agreement with the previous literature29. The significant correlation between increased NLR and malignant PCN may be based on the ability of neutrophils to recruit and activate inflammatory cells through the production of cytokines and chemokines, which in turn act on the tumor microenvironment.
One study30 has shown that non-O blood types have a higher risk of pancreatic cancer than O blood types (OR = 1.44, 95% CI 1.144-1.82), and individuals with A and B blood types have a significantly higher frequency of PDAC than those with O blood types. Patients with O blood types more often have well-differentiated PDAC than do those with non-O blood types, whereas patients with AB blood types more often exhibit poorly differentiated tumors. These findings are consistent with the results of the present study. The relationship between blood group and malignancy has been partially explored. The ABO gene is located on chromosome 9, and a genomic study of pancreatic cancer and normal populations has found a significant association between ABO genetic locus variants on chromosome 9q34 and pancreatic cancer (P < 0.001)31. The ABO gene does not directly encode ABO antigen but encodes a glycosyltransferase that mediates mucin-type glycosylation. Aberrant mucin-type glycosylation (hereafter O-glycosylation) is a typical feature of the malignant transformation of epithelial cells. Tumor-associated aberrant O-glycans (Tn and T antigens) are detected in most PDACs and are structurally associated with blood group A and B glycans32. The presence of base deletions in the O allele results in a loss of glycosyltransferase activity in the end product33. ABO blood group IgM lectins are associated with PDACs, and O-GalNAc modifications in PDACs are associated with the presence of O-glycans. O-GalNAc-modified glycoproteins in PDAC may influence cancer pathogenesis. ABO blood group antigens can alter the host inflammatory response, thereby leading to malignant tumor progression and spread34; they can also alter intercellular and cell-extracellular matrix interactions, thereby promoting tumor development35. MCH, MCV, MCHC, Hb, and HCT are the most widely and commonly used markers reflecting nutritional and anemia conditions; among these, MCH, MCV, and MCHC are commonly used to rapidly evaluate anemia type. Mean corpuscular hemoglobin concentration (MCHC), an indicator of the average hemoglobin concentration per red blood cell, is sensitive to the assessment of tumor progression, angiogenesis, and metastasis of neoplastic cells. Studies36,37 have shown that in patients with hepatorenal syndrome in decompensated cirrhosis, increased MCHC indicates poor prognosis. MCHC is closely associated with tumor size and prognosis, and in oral tumors, MCHC increases significantly with tumor enlargement. MCH and MCHC reflect rapid compensatory regeneration of the bone marrow caused by hemolysis and anemia. Male patients with high MCHC have a significantly higher risk of developing prostate cancerr38, in agreement with our findings that high MCHC is an independent risk factor for malignant PCN. The mechanisms involved in the pathological elevation of MCHC and tumorigenesis are not well understood, but may possibly be a consequence of the long-term effects of iron-dependent oxidative stress on erythrocyte structure and cancer pathogenesis39. In addition, in some types of cancer, such as renal cancer, hepatocellular carcinoma, or ovarian cancer, a non-compensatory increase in erythropoietin due to tumors can also lead to increased MCHC.
This research has several limitations. First, it was a retrospective analysis including only cases with postoperative pathology suggestive of PCN, thus potentially leading to selection bias. In the future, we plan to use the model in prospective clinical studies to further validate its efficacy. In addition, the sample was limited in this study, and only one center was selected for external validation; consequently, the sample representativeness is relatively low, and more samples must be included for model validation.
Conclusions
In conclusion, this study provides clinicians with a simple, effective, and non-invasive predictive model for benign and malignant PCN, which facilitates the consultation, management, and treatment of patients with PCN. Studies on PCN are increasing, and preoperative risk factors for predicting malignant PCN are a major area of research. For clinicians, a comprehensive preoperative analysis of various risk factors, accurate weighing of surgical risks and malignancy risks, precise determination of surgical indications, and the development of intervention plans that minimize invasion and maximize efficacy according to the specific conditions of different patients will bring the greatest benefit to patients with PCN.
Supporting Information
Grant support
This work was supported by the National Natural Science Foundation of China (Grant Nos. 82030092, 81720108028, and 81802433) and the Key Program of Prevention and Treatment of Chronic Diseases of Tianjin (Grant No. 17ZXMFSY00010).
Conflict of interest statement
No potential conflicts of interest are disclosed.
Author contributions
Conceived and designed the analysis: Xiuchao Wang, Junjin Wang, Chuntao Gao, Song Gao, Tiansuo Zhao, Jian Wang, Weidong Ma.
Collected the data: Junjin Wang, Xiao Hu, Xi Wei, Lihui Zhao, Bo Ni, Zekun Li.
Contributed data or analysis tools: Xi Wei, Junjin Wang, Xiao Hu, Lihui Zhao.
Performed the analysis: Junjin Wang, Bo Ni, Zekun Li.
Wrote the paper: Xiuchao Wang, Junjin Wang.
Footnotes
↵*These authors contributed equally to this work.
- Received May 9, 2022.
- Accepted July 8, 2022.
- Copyright: © 2022, Cancer Biology & Medicine
This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY) 4.0, which permits unrestricted use, distribution and reproduction in any medium, provided the original author and source are credited.