- Open Access
Development and validation of prognostic nomograms for patients with colon neuroendocrine neoplasms
World Journal of Surgical Oncology volume 19, Article number: 233 (2021)
Colon neuroendocrine neoplasms (NENs) have one of the poorest median overall survival (OS) rates among all NENs. The American Joint Committee on Cancer (AJCC) tumor–node–metastasis (TNM) staging system—currently the most commonly used prediction model—has limited prediction accuracy because it does not include parameters such as age, sex, and treatment. The aim of this study was to construct nomograms containing various clinically important parameters to predict the prognosis of patients with colon NENs more accurately.
Using the Surveillance, Epidemiology, and End Results (SEER) database, we performed a retrospective analysis of colon NENs diagnosed from 1975 to 2016. Data were collected from 1196 patients; almost half were female (617/1196, 51.6%), and the average age was 61.94 ± 13.05 years. Based on the age triple cut-off values, there were 396 (33.1%), 408 (34.1%), and 392 (32.8%) patients in age groups 0–55 years, 55–67 years, and ≥ 68 years, respectively. Patients were randomized into training and validation cohorts (3:1). Independent prognostic factors were used for construction of nomograms to precisely predict OS and cancer-specific survival (CSS) in patients with colon NENs.
Multivariate analysis showed that age ≥ 68 years, sex, tumor size, grade, chemotherapy, N stage, and M stage were independent predictors of OS. In the validation cohort, the Concordance index (C-index) values of the OS and CSS nomograms were 0.8345 (95% confidence interval [CI], 0.8044–0.8646) and 0.8209 (95% CI, 0.7808–0.861), respectively. C-index also indicated superior performance of both nomograms (C-index 0.8347 for OS and 0.8668 for CSS) compared with the AJCC TNM classification (C-index 0.7159 for OS and 0.7366 for CSS).
We established and validated new nomograms for more precise prediction of OS and CSS in patients with colon NENs to facilitate individualized clinical decisions.
Neuroendocrine neoplasms (NENs) are a heterogeneous group of rare tumors derived from peptidergic neurons and neuroendocrine cells of the diffuse neuroendocrine system. According to tumor differentiation, NENs include well or moderately differentiated neuroendocrine tumor (NET), poorly differentiated neuroendocrine carcinoma (NEC), and mixed neuroendocrine non-neuroendocrine neoplasm (MiNEN). Biological behavior of NET is relatively benign compared with NEC or mixed adeno-neuroendocrine carcinoma (MANEC) . A population-based study from nationally representative data from the Surveillance, Epidemiology, and End Results (SEER) program showed that the incidence of NENs has increased from 1.09/100,000 in 1973 to 6.98/100,000 in 2012 . The gastroenteropancreatic tract is the most common site of extrapulmonary NENs. Among them, NENs originating from the cecum to the sigmoid colon account for 4–8% of all NENs [2,3,4,5,6]. Although colon and rectal NENs are often described as a single disease, recent evidence has indicated that depending on tumor grade, the median overall survival (OS) of colon NENs is poor compared with most gastrointestinal NENs, and the prognosis is much worse than that of rectal NENs [2, 3]. Compared with rectal NENs, colon NENs have larger size, higher T stage, higher grade, and more frequent lymph nodes and lymphovascular invasion positivity. The 5-year disease-specific survival is also significantly different, and treatment options are very limited, which leads to worse outcomes [1, 7, 8].
The American Joint Committee on Cancer (AJCC) and the World Health Organization (WHO) have proposed systems to predict the prognosis of colon NENs [9, 10]. The AJCC tumor–node–metastasis (TNM) staging system includes T stage, N stage, and M stage, whereas the WHO classification includes the mitotic count and Ki-67 proliferation index. Currently, these systems are the most commonly used prediction models for colon NENs, but they contain only two to three parameters and do not incorporate certain relevant parameters, such as age, sex, and treatment , which are equally important for the prognosis of patients with colon NENs. Therefore, there is an urgent need for a usable decision tool that can integrate additional parameters to assist with clinical practice, decision-making, and accurate prediction in patients with colon NENs.
Nomograms-graphical calculations or algorithms with continuous scales to calculate the probability of a particular outcome-have recently been shown to be a more effective method for predicting the prognosis of various cancers than traditional staging systems [12,13,14,15]. However, no studies have established a prognostic nomogram to predict the outcomes of patients with colon NENs.
To the best of our knowledge, this study is the first attempt to develop nomograms for colon NENs based on a retrospective study of the SEER database that incorporates additional clinical parameters to predict survival more accurately.
Materials and methods
Data retrieved from the SEER database
Specific clinicopathological data and prognostic outcomes of patients with colon NENs were retrieved from the SEER database submitted in November 2018 . This study did not require a local ethics approval or statement because all the data were publicly available. The International Classification of Diseases for Oncology (ICD-O-3) was used to identify cases of colon NENs. The primary site codes (C18.0, C-18.2-C18.9, colon) and the following ICD-O-3 codes for histological type were used to identify cases with colon NENs: large cell neuroendocrine carcinoma (8013), small cell carcinoma (8041), carcinoid tumor (8240), enterochromaffin cell carcinoid (8241), neuroendocrine carcinoma (8244), mixed adeno-neuroendocrine carcinoma (MANEC) (8246), and atypical carcinoid tumor (8249). The inclusion criteria were as follows: (I) complete TNM stage information available; (II) only one primary tumor lesion; (III) all data classified using the new 8th Edition the AJCC staging system; (IV) complete survival data available; (V) no missing data in the SEER other cause of death classification; (VI) known tumor size; and (VII) known grade. The exclusion criteria were as follows: (I) the presence of other tumors at the same time; (II) unknown stage; and (III) incomplete clinical data (e.g., tumor size, treatment, grade). These eligible patients with colon NENs were subsequently randomly assigned into a training cohort and a validation cohort. In addition, the patients were grouped based on age into three categories (0–55 years, 56–67 years, and ≥ 68 years); they were also grouped based on the size of the tumor into < 35 mm and ≥ 35 mm groups.
We retrieved the following demographic or clinical variables from the SEER database: age, sex, tumor grade, tumor site, tumor size, AJCC TNM stage, surgery and chemotherapy, SEER other cause of death classification, and survival-related information. The stage classification was in accordance with the criteria of the 8th AJCC TNM staging system. The primary end point was OS, whereas the secondary end point was cancer-specific survival (CSS).
Construction and validation of nomogram model
The entire sample was randomized into two groups: 896 (approximately 75%) cases were included in the training cohort, and 300 (approximately 25%) in the validation cohort. At diagnosis, patient age (years) and survival time (months) are expressed as mean ± SD or median (25th–75th percentile) depending on the data distribution. The Mann–Whitney U test was used for the analysis of continuous variables, and the chi-square test was used for comparison of categorical variables between groups of patients who survived or those who did not. Univariate and multivariate Cox proportional-risk regression analyses were used to assess factors associated with OS and CSS. By using univariate Cox analysis to determine the potential prognostic factors associated with OS and CSS of colon NENs, variables with P < 0.05 were included in the final multivariate analysis and construction of the nomogram. The receiver operating characteristic (ROC) curves were analyzed by measuring the performance of the constructed nomogram. The accuracy of the nomogram was analyzed using the Harrell C-index and the area under the time-dependent ROC curve (AUC). A larger C-index is associated with better predictive ability of the nomogram . Calibration curves were plotted to assess the agreement between the nomogram-predicted survival rate and the observed survival rate. Furthermore, C-index of the nomogram was compared with C-index of the TNM stage. In summary, the nomograms were constructed to predict the survival of colon NENs patients. All analyses were performed using the statistical package R (http://www.r-project.org) and Empower Stats software (http://www.empowerstats.com, X&Y Solutions, Inc., Boston, MA). Statistical significance was set at 0.05.
Baseline characteristics of the patients
A total of 1196 patients with colon NENs from the SEER database were included in the study, with 896 patients in the training cohort and 300 patients in the validation cohort. The proportions of female and male patients were 51.6% and 48.4%, respectively. Grades G1, G2, G3, and G4 accounted for 39.8%, 16%, 29.1%, and 15.1% of cases, respectively. The primary site was in the right hemicolon in 76.5% of cases, while in 23.5% of cases the tumor was located in the left hemicolon. The median tumor size was 41.0 mm. Other characteristics are presented in Table 1. Overall, patients in the training and validation cohorts were comparable in terms of demographic and clinicopathological features (Table 1).
Univariate and multivariate analyses of prognostic factors in the training cohort
The predictors of OS and CSS identified from univariate and multivariate analysis of the training cohort are shown in Tables 2 and 3.
Univariate analysis indicated that age, sex, tumor size, grade, surgery, chemotherapy, AJCC TNM stage (8th), N stage, and M stage were significantly associated with the OS rate (Table 2). In multivariable survival analysis, age ≥ 68 years (P < 0.001), sex (P < 0.05), tumor size (P < 0.05), grade (P < 0.001), chemotherapy (P < 0.05), N stage (P < 0.001), and M stage (P < 0.001) were identified as independent prognostic factors associated with the OS rate. Moreover, age, sex, tumor size, laterality, grade, chemotherapy, AJCC TNM stage (8th), N stage, and M stage were identified as predictors of CSS by univariate analysis. However, only age ≥ 68 years (P < 0.05), sex (P < 0.05), laterality (P < 0.05), tumor size (P < 0.05), grade (P < 0.001), chemotherapy (P < 0.001), N stage (P < 0.001), and M stage (P < 0.001) were significant factors identified in multivariate analysis and were further used to develop a CSS nomogram (Table 3, Fig. 1B).
Construction and validation of nomograms
OS and CSS nomograms were constructed based on independent prognostic factors identified by multivariable analysis (Fig. 1). By summing the scores for each selected variable, the probability of a patient’s survival can be easily obtained from the nomogram.
We compared the predictive accuracy of our nomograms with that of the 8th AJCC TNM classification in the training cohort. The C-index of the OS nomogram was 0.8347 (95% confidence interval [CI], 0.8171–0.8523), which was higher than the C-index of the 8th AJCC TNM staging system (0.7159; 95% CI, 0.6762–0.7557). The C-index of our CSS nomogram was 0.8668 (95% CI, 0.0.8506–0.883), which was also superior to that of the 8th AJCC TNM staging system (0.7366; 95% CI, 0.6955–0.7776). These results demonstrated that our nomograms had superior survival predictive ability compared with the AJCC TNM staging system. To confirm the predictive power of the nomograms, further applications were made in the validation cohort, yielding a C-index of 0.8345 (95% CI, 0.8044–0.8646) and 0.8209 (95% CI, 0.7808–0.861) for the OS nomogram and CSS nomogram, respectively. The calibration curve revealed the agreement between the predicted and actual survival (Fig. 2). In addition, the area under the ROC curve (AUC) was high for both the training and validation cohorts (Fig. 3).
With widespread use of gastrointestinal endoscopy for cancer screening and increased public health awareness, the incidence of neuroendocrine tumors has been increasing in recent years . The SEER study in the USA showed an age-adjusted incidence rate of gastroenteropancreatic neuroendocrine tumors of 3.56 per 100,000 inhabitants (2000–2012) . It is well known that the primary site of NENs is an important prognostic factor for survival . However, most previous studies have analyzed rectal NENs and colon NENs as if they originate from the same primary site [18, 19]. Nevertheless, it has become clear that colon NENs are a different disease from rectal NENs. Rectal NENs are commonly (but not exclusively) small and generally of low to intermediate grade (grades 1 [G1] or 2 [G2]), whereas colon NENs are often aggressive, poorly differentiated, and of higher grade (G3) . Additionally, the OS rate of patients with colon NENs is significantly lower than that of patients with rectal NENs . Therefore, it is necessary to perform separate statistical analysis for colon NENs.
Colon NENs are extremely rare, constituting only 1% of all colon neoplasms and < 11% of gastrointestinal NENs . There are few studies related to colon NENs. According to Smith et al. , high-grade colorectal NECs are very aggressive tumors with poor prognosis. Patients have a slightly better prognosis if they do not have metastatic disease, if they have an adenocarcinoma component within the tumor, or if they respond to chemotherapy . Unlike patients with non-colorectal non-neuroendocrine liver metastases [24,25,26], surgery, especially in the presence of metastatic disease, may not provide any survival benefit for most patients . Fields et al.  demonstrated that the total number of positive lymph nodes was an independent predictor of survival in patients with colon NENs. Namely, the prognosis differed between patients with no positive lymph nodes, 1 positive lymph node, 2 to 9 positive lymph nodes, and 10 or more positive lymph nodes .
The most commonly used predictive system for colon NENs is the AJCC TNM classification, which includes three clinical parameters: tumor size (T), lymph node status (N), and distant metastasis (M). Studies have shown that for other types of solid tumors, multiple factors affect the prognosis of tumors [28, 29], but the TNM staging system has the most important prognostic value. However, for GEP-NENS, tumor differentiation is the most important prognostic indicator for disease course and progression .
In the present study, we developed and validated new nomogram models for predicting the OS and CSS in patients with colon NENs using the SEER public database, which includes the largest sample size of colon NENs to date. The nomogram incorporated independent prognostic factors associated with OS and CSS, which had been identified in the multivariable analysis, including age, sex, tumor size, grade, chemotherapy, N stage, and M stage.
According to our nomogram, an age ≥ 68 years and tumor size ≥ 35 mm were significantly associated with poor survival, and patients with lymph node metastasis and distant metastasis had a shorter survival time than those without metastasis. Furthermore, the classical T stage did not show independent prognostic significance in the nomogram model; instead, tumor grade showed a dramatic impact on prognosis. These results clarify the difference between prognosis predicted using the AJCC TNM staging system and prognosis based on tumor grade status of NENs.
In addition, this study included chemotherapy as a treatment strategy in the analysis. Thus, clinicians can use the total score provided by the nomograms constructed in this study to individualize treatment for patients with colon NENs and distinguish subgroups of patients at different levels of risk, thereby avoiding overtreatment in lower-risk patients and pursuing more aggressive treatment and close follow-up in higher-risk patients. In this study, chemotherapy was administered mainly in patients with high grade or late TNM staging (Supplement 1), with the potential to improve OS and CSS rates. Chemotherapy is recommended in patients with high tumor grade and advanced disease, who tolerate the side effects of chemotherapy. The nomogram can predict the prognosis of patients with colon NENs more accurately and provide clinicians with more useful information for developing targeted treatments.
The present study still had some limitations. First, neuroendocrine biomarkers, such as chromogranin A (CgA), synaptophysin (Syn), and CD56, were not available in the SEER database. Therefore, it was impossible to evaluate these parameters and integrate them into the nomogram. Moreover, in the SEER database, Ki-67 index was classified as well differentiated, moderately differentiated, and poorly differentiated/undifferentiated, which is why it was used as a categorical variable in the nomogram; however, Ki-67 is a continuous variable in clinical practice. Therefore, the use of a continuous Ki-67 index variable may be more useful in developing nomograms and predicting outcomes more accurately. Second, the SEER database did not contain detailed data regarding chemotherapy regimens, which restricted us from further evaluating the impact of different drug treatments on the survival of patients with colon NENs. Third, for the validation of nomograms, both internal and external validation cohorts are recommended. Due to the rarity of colon NENs, the number of cases collected in our center in Jiangsu province from 2010 to 2019 was too small to perform external validation, and that is why only internal validation could be performed in this study. Moreover, it was difficult to achieve no difference in every indicator because of the large sample size. Over time, we plan to collect more patients and variables to further refine the nomogram. Despite these inherent limitations, our prognostic model still provides a helpful tool for clinicians to ensure better decision making and prognosis estimation.
In conclusion, we identified seven independent prognostic factors of survival, including age, sex, tumor size, grade, chemotherapy, N stage, and M stage, and developed new nomograms to predict OS and CSS in patients with colon NENs using the SEER data. Our nomograms demonstrated a better survival predictive ability than the 8th AJCC TNM staging system, and thus they can be valuable tools for individualized clinical decisions.
Availability of data and materials
The datasets supporting the conclusions of this article are available in the SEER database at https://seer.cancer.gov/seerstat/.
Mixed neuroendocrine non-neuroendocrine neoplasm
Mixed adeno-neuroendocrine carcinoma
American Joint Committee on Cancer
Surveillance, Epidemiology, and End Results
World Health Organization
International Classification of Diseases for Oncology, Third Edition
Receiver operating characteristic
Area under the time-dependent ROC curve
Shen C, Yin Y, Chen H, Tang S, Yin X, Zhou Z, et al. Neuroendocrine tumors of colon and rectum: validation of clinical and prognostic values of the World Health Organization 2010 grading classifications and European Neuroendocrine Tumor Society staging systems. Oncotarget. 2017;8(13):22123–34.
Dasari A, Shen C, Halperin D, Zhao B, Zhou S, Xu Y, et al. Trends in the incidence, prevalence, and survival outcomes in patients with neuroendocrine tumors in the united states. JAMA Oncol. 2017;3(10):1335–42.
Yao JC, Hassan M, Phan A, Dagohoy C, Leary C, Mares JE, et al. One hundred years after “carcinoid”: epidemiology of and prognostic factors for neuroendocrine tumors in 35,825 cases in the United States. J Clin Oncol. 2008;26(18):3063–72.
Fang C, Wang W, Zhang Y, Feng X, Sun J, Zeng Y, et al. Clinicopathologic characteristics and prognosis of gastroenteropancreatic neuroendocrine neoplasms: a multicenter study in South China. Chin J Cancer. 2017;36(1):51.
Wang YH, Lin Y, Xue L, Wang JH, Chen MH, Chen J. Relationship between clinical characteristics and survival of gastroenteropancreatic neuroendocrine neoplasms: A single-institution analysis (1995–2012) in South China. BMC Endocr Disord. 2012;12:30.
Fan JH, Zhang YQ, Shi SS, Chen YJ, Yuan XH, Jiang LM, et al. A nation-wide retrospective epidemiological study of gastroenteropancreatic neuroendocrine neoplasms in china. Oncotarget. 2017;8(42):71699–708.
Lin HH, Lin JK, Jiang JK, Lin CC, Lan YT, Yang SH, et al. Clinicopathological analysis of colorectal carcinoid tumors and patient outcomes. World J Surg Oncol. 2014;12:366.
Broecker JS, Ethun CG, Postlewait LM, Le N, McInnis M, Russell MC, et al. Colon and rectal neuroendocrine tumors: are they really one disease? a single-institution experience over 15 years. Am Surg. 2018;84(5):717–26.
Amin MB, Creene FL, Edge SB, et al. AJCC cancer staging manual. 8th ed. New York: Springer; 2016.
Ricardo V. Lloyd, Robert Y. Osamura, Günter Klöppel, Juan Rosai. 2017 WHO Classification of Tumours of Endocrine Organs (4th ed). Lyon: international agency for research on cancer (IARC)
Greene FL, Sobin LH. The staging of cancer: a retrospective and prospective appraisal. CA Cancer J Clin. 2008;58(3):180–90.
Karakiewicz PI, Briganti A, Chun FK, Trinh QD, Perrotte P, Ficarra V, et al. Multi-institutional validation of a new renal cancer-specific survival nomogram. J Clin Oncol. 2007;25(11):1316–22.
Wierda WG, O’Brien S, Wang X, Faderl S, Ferrajoli A, Do KA, et al. Prognostic nomogram and index for overall survival in previously untreated patients with chronic lymphocytic leukemia. Blood. 2007;109(11):4679–85.
Mariani L, Miceli R, Kattan MW, Brennan MF, Colecchia M, Fiore M, et al. Validation and adaptation of a nomogram for predicting the survival of patients with extremity soft tissue sarcoma using a three-grade system. Cancer. 2005;103(2):402–8.
Wang L, Hricak H, Kattan MW, Chen HN, Scardino PT, Kuroiwa K. Prediction of organ-confined prostate cancer: incremental value of MR imaging and MR spectroscopic imaging to staging nomograms. Radiology. 2006;238(2):597–603.
National cancer institution. Surveillance, Epidemiology, and End Results (SEER) Research Database (1975–2016). https://seer.cancer.gov. Accessed 1 Apr 2019.
Huitzil-Melendez FD, Capanu M, O’Reilly EM, et al. Advanced hepatocellular carcinoma: which staging systems best predict prognosis? J Clin Oncol. 2010;28(17):2889–95.
Lin HH, Lin JK, Jiang JK, et al. Clinicopathological analysis of colorectal carcinoid tumors and patient outcomes. World J Surg Onc. 2014;12:366.
Tokumaru Y, Matsuhashi N, Takahashi T, et al. Rectal neuroendocrine tumor developing lateral lymph node metastasis after curative resection: a case report. World J Surg Onc. 2020;18:74.
Ramage JK, De Herder WW, Delle Fave G, Ferolla P, Ferone D, Ito T, Ruszniewski P, et al. ENETS Consensus Guidelines Update for Colorectal Neuroendocrine Neoplasms. Neuroendocrinology. 2016;103(2):139–43.
Man D, Wu J, Shen Z, Zhu X. Prognosis of patients with neuroendocrine tumor: a SEER database analysis. Cancer Manag Res. 2018;10:5629–38.
Maggard MA, O’Connell JB, Ko CY. Updated population-based review of carcinoid tumors. Ann Surg. 2004;240(1):117–22.
Smith JD, Reidy DL, Goodman KA, Shia J, Nash GM. A retrospective review of 126 high-grade neuroendocrine carcinomas of the colon and rectum. Ann Surg Oncol. 2014;21(9):2956–62.
Bohlok A, Lucidi V, Bouazza F, et al. The lack of selection criteria for surgery in patients with non-colorectal non-neuroendocrine liver metastases. World J Surg Onc. 2020;18:106.
Aghayan DL, Kalinowski P, Kazaryan AM, et al. Laparoscopic liver resection for non-colorectal non-neuroendocrine metastases: perioperative and oncologic outcomes. World J Surg Onc. 2019;17:156.
Račkauskas R, Baušys A, Sokolovas V, et al. Short- and long-term outcomes of surgery for colorectal and non-colorectal liver metastasis: a report from a single center in the Baltic country. World J Surg Onc. 2020;18:164.
Fields AC, McCarty JC, Lu P, Vierra BM, Pak LM, Irani J, et al. Colon neuroendocrine tumors: a new lymph node staging classification. Ann Surg Oncol. 2019;26(7):2028–36.
Cai R, Lu Q, Wang D. Construction and prognostic analysis of miRNA-mRNA regulatory network in liver metastasis from colorectal cancer. World J Surg Onc. 2021;19:7.
Chen Y, Liu F, Meng Q, et al. Is neuroendocrine differentiation a prognostic factor in poorly differentiated colorectal cancer? World J Surg Onc. 2017;15:71.
Gatta G, Ciccolallo L, Kunkler I, Capocaccia R, Berrino F, Coleman MP, et al. Survival from rare cancer in adults: a population-based study. Lancet Oncol. 2006;7(2):132–40.
We thank LetPub (www.letpub.com) for its linguistic assistance and scientific consultation during the preparation of this manuscript.
The study was supported by the Medical Key Talents Project of Jiangsu Province (Grant No. ZDRCA2016008) and the 333 Project of Jiangsu Province (Grant No. BRA2017535).
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1. Supplement 1.
Characteristics of histological differentiation and TNM staging (8th edition) in colon NENs patients receiving chemotherapy.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Xu, R., Zhou, B., Hu, P. et al. Development and validation of prognostic nomograms for patients with colon neuroendocrine neoplasms. World J Surg Onc 19, 233 (2021). https://doi.org/10.1186/s12957-021-02338-8
- Colon neuroendocrine neoplasm