- Open Access
The change of health-related quality of life after minimally invasive esophagectomy for esophageal cancer: a meta-analysis
World Journal of Surgical Oncology volume 16, Article number: 97 (2018)
Short- and long-term health-related quality of life (HRQL) was severely affected after surgery. This study aimed to assess the direction and duration of HRQL from 3- to 24-month follow-ups after minimally invasive esophagectomy (MIE) for esophageal cancer.
A systematic literature search in MEDLINE, EMBASE, and the Cochrane database was performed for all potentially relevant studies published until February 2017. Studies were included if they addressed the question of HRQL with OERTC-QLQ-C30 and OES18. Primary outcomes were HRQL change at 3-month follow-up. Secondary outcomes were HRQL change from 3-, 6- (short-term) to 12- (mid-term), and/or 24-month (long-term) follow-ups.
Six articles were included to estimate the change in 24 HRQL outcomes after MIE. Most of the patients’ HRQL outcomes deteriorated at short-term follow-up and some lasted to mid- or long-term after MIE. Patients’ physical function and global QOL deteriorated from short- to long-term follow-ups, and emotional function had no change. The directions of dyspnea, pain, fatigue, insomnia, constipation, diarrhea, cough, and speech problems were increased. The deterioration in global function lasted 6 months, the increase in constipation and speech problems lasted 12 months, and insomnia increased more than 12 months after MIE.
The emotional function had no change after MIE. The global QOL become worse during early postoperative period; the symptoms of constipation, speech problems, and insomnia increased for a long time after MIE.
Esophageal cancer is one of the most common malignant tumors of the digestive system with a poor prognosis with overall 5-year survival rates only 15–50%, and the incidence of esophageal cancer has risen steadily during recent decades [1,2,3]. Esophagectomy with lymphadenectomy is regarded as the only curative option for patients with resectable esophageal cancer [4,5,6].
The traditional open esophagectomy (OE) is a relatively high invasive surgery, which may lead to several morbidities or prominent mortality . Minimally invasive surgery is assumed to reduce surgical injury and improve patients’ prognosis. With the developing skills and increasing experiences in laparoscopy and thoracoscopy in thoracic and stomach surgery, minimally invasive esophagectomy (MIE) has become the recommended approach, popularized in centers with experienced surgeons .
A lot of longitudinal and meta-analysis studies have been performed to compare the outcomes of OE with MIE, which conclude that MIE is a safe alternation or better choice for esophageal cancer to OE because patients undergoing MIE may benefit from shorter hospital stay, lower complications, less morbidity, and overall survival [9,10,11,12]. Studies that investigate health-related quality of life (HRQL) after surgery for esophageal cancer show that patients will experience an impaired quality of life post operation, and MIE had an overall benefit on quality of life (QOL) for the patients compared with open surgery [13,14,15,16,17,18,19,20]. However, few studies focus on assessing the impact of MIE for esophageal cancer on HRQL and the change of HRQL after surgery [13, 18]. On this basis, the aim of this meta-analysis is to analyze the change of short- to long-term QOL after MIE for esophageal cancer.
A MEDLINE, EMBASE, and Cochrane database search was performed by two authors on all relevant clinical studies published until February 2017, analyzing quality of life after minimally invasive esophagectomy for esophageal cancer. The following keywords and medical subject headings were used: esophageal neoplasms, esophageal cancer, esophagus cancer, esophagus carcinoma, oesophageal cancer, esophageal carcinoma, oesophageal carcinoma, cancer of esophagus, carcinoma of esophagus, esophagectomy, resection of esophagus, minimally invasive surgical procedures, minimally invasive surgery, video-assisted thoracic surgery, thoracoscopic, thoracoscopy, laparoscopic, laparoscopy, quality of life, life quality, living quality, and quality of lives. Only studies on humans and written in English were considered for inclusion. The related-articles function was used to expand the search from each identified relevant study. A manual cross-reference search from articles was also performed. All citations and abstracts identified were thoroughly reviewed. The latest date for this search was 20 February 2017. Data quoted as unpublished or data from abstracts were not used. Any disagreements regarding which studies should be included that existed in two researchers were resolved through discussion.
Inclusion and exclusion criteria
Studies were selected if they reported on a series of patients who underwent minimally invasive esophagectomy because of esophageal cancer. Procedures of minimally invasive esophagectomy included thoracoscopy combined with laparotomy or laparoscopy.
All studies included in this meta-analysis also required to present detailed information used to assess quality of life and on when the questionnaire was administered. Only those were selected when all patients filled out the questionnaires before operation and at the follow-up (3, 6, 12, and/or 24 months after operation) by letter visit or out-patient consultant. Questionnaires that were used to analyze HRQL included, but not limited to, European Organization for Research and Treatment of Cancer (EORTC) QLQ C30 and OES18. Those that only presented their results graphically were excluded. When studies were discovered to report (partially) similar patient data, only the most recent and complete data sets were included.
Data was extracted independently by two reviewers (XM Yang and YF Duan) from each study: study characteristics (first author, year of publication, study design, study aim, timing of follow-up and HRQL data gathering, and type of questionnaire used), population characteristics (number of patients included, demographics, cancer histologic type, cancer stage, cancer site, and neoadjuvant therapy), item, and total results.
We contacted the first or corresponding author of each article by e-mail if not all descriptive outcome data was reported. If necessary, we used reported 95% confidence intervals (95% CIs), standard errors, to transform missing SD data .
The primary outcome of this study was HRQL change at 3-month follow-up. The second outcome was HRQL change from 3-, 6- (short-term) to 12- (mid-term), and/or 24-month (long-term) follow-ups.
The studies were included when both the following validated quality of life instruments were used: the EORTC-QLQ-C30 and the EORTC-QLQ-OES18. The QLQ-C30 questionnaire was developed by the Quality of Life Division of EORTC. It explored the generic quality of life of patients affected by oncologic diseases and includes a global health status scale, five functional scales (physical, role, emotional, cognitive, and social), three symptom scales (fatigue, nausea and vomiting, and pain), and six single items (dyspnea, insomnia, anorexia, constipation, diarrhea, and financial difficulties) . The QLQ OES-18 assessed symptoms specific to esophageal cancer and was composed of four symptom scales (dysphagia, eating, reflux, and esophageal pain) and six single items (swallowing saliva, choking when swallowing, dry mouth, taste problem, coughing, and speech problem) . Each item had four response alternatives: “not at all” (scored as 1), “a little” (scored as 2), “quite a bit” (scored as 3), and “very much” (scored as 4), except for the global QOL scale which ranges from “very poor” (scored as 1) to “excellent” (scored as 7). All QLQ-C30 and QLQ-OES18 responses were transformed linearly to scores ranging from 0 to 100.
Review Manager Version 5.3 (Copenhagen: the Nordic Cochrane Centre, The Cochrane Collaboration, 2014) was used to perform meta-analysis. The data can be synthesized only when the number of studies exceeds two. Measurement data reported as mean SD/SE were adopted. The results were presented as weighted mean differences [95% confidence interval (CI)]. Heterogeneity was assessed by χ2 and I2. An I2<30% represented low heterogeneity, 30–50% moderate, 50–75% substantial, and 75–100% considerable heterogeneity [7, 22]. The statistical results used fixed-effect models for low and moderate heterogeneity, random-effect models for substantial and considerable heterogeneity. The study design and risk of bias are shown in Table 1. The definitions of direction, clinical relevance, and duration of HRQL change were same as those described by Jacobs et al. .
A flowchart of the literature screening process is shown in Fig. 1. The initial search yielded 1337 articles, of which 1306 were excluded based on their titles. Fifteen duplicated articles were then manually excluded on the basis of their titles. Three articles were excluded because of not being written in English. Eight articles were further excluded on the basis of their abstracts or full texts, of which two were conference abstracts [23, 24]; one was comment , one was systematic review , two presented their results only in graphical formats [26, 27], one presented their results only in percent of patients , one was related to the reliability and validity of the questionnaire , and one article was included based on the cross-reference search . Six articles finally met the criteria of inclusion [15,16,17,18,19,20], and two reported data form the same hospital by the same first author [15, 19]. Although they reported the same dataset, two studies from Zhongshan Hospital were included in the analysis because one analyzed more aspects of HRQL [15, 19]. However, all the patients included in these studies were counted only once, and only the most recent and complete data sets were selected.
Characteristics of studies and patients
The selected trials included a total of six studies that were published between 2010 and 2016 (Table 2), of which two were retrospective studies [15, 19], three were prospective ones [16,17,18], and only one was a randomized controlled trial (RCT) . One study was done in Australia , one in Belgium , two in China [15, 19], one in the UK , and the last one in the Netherlands . Five studies used both EORTC QLQ C30 and the disease-specific OES18 questionnaires. One study was performed not only using EORTC QLQ C30 and the disease-specific OES18, but also SF36. The HRQL was the primary outcome for all studies. Patients were all enrolled consecutively. The measure times of HRQL were preoperation (baseline), 3-, 6-, 12-, and/or 24-month postoperation. One study aimed to assess HRQL after MIE , and five studies aimed to compare HRQL in patients after MIE and open esophagectomy [15, 17,18,19,20].
The number of patients included in the selected trials was 1034, of which 848 were males. The range of mean ages reported by different papers was 56 to 67 years. The indication for surgery was esophageal adenocarcinoma in 442 patients, squamous cell carcinoma in 576 patients, and others in 16 patients. The pathological TNM stages were stage 0 and stage I in 279 cases, stage II in 444 cases, stage III in 262 cases, and stage IV in 36 cases. All patients received neoadjuvant chemo- or chemoradiotherapy in one study ; no patients received in two studies [15, 18]; and partial patients received in three studies [16, 17, 19]. All patients received a combination of general and epidural anesthesia during the operation. In the first 3–5 days after surgery, patients received epidural or intravenous analgesia. The follow-up duration after esophagectomy, as reported in the articles, was between 6 and 72 months. The characteristics of the patients included in each study are described in Table 3.
Twenty-four HRQL outcomes were included in our meta-analysis. Mean difference with 95% confidence intervals are reported in Table 4, which also reflects the average HRQL change.
The direction and clinical relevance of HRQL change at 3-month follow-up are shown in Table 5. Patients’ physical function, role function, and global QOL deteriorated. All symptoms in QLQ-C30 and dry mouth, cough problem, and speech problem in QLQ-OES18 increased. However, the direction for other outcomes (three functional scales in QLQ-C30, four symptom scales, and two single items in QLQ-OES18) at 3-month follow-up were too heterogeneous to interpret.
The global QOL, insomnia, financial problem, and speech problem changes were small, which showed clinical relevance at 3-month follow-up. However, other HRQL outcomes (five functional scales, three general symptom scales and four single items in QLQ-C30, and four symptom scales and four single items in QLQ-OES 18) did not show clinical relevance.
The direction and duration of HRQL change at 3-, 6-, 12-, and/or 24-month follow-ups are reported in Table 5. The directions of patients’ physical function and global QOL deteriorated, and emotional function had no change. The directions of dyspnea, pain, fatigue, insomnia, constipation, diarrhea, cough problem, and speech problem were increased. However, the direction for other outcomes (three functional scales and two single items in QLQ-C30 and four symptom scales and three single items in QLQ-OES 18) at 3-, 6-, 12-, and/or 24-month follow-ups were too heterogeneous to interpret.
The deterioration in global function lasted 6 months after surgery. The increase in constipation and speech problem lasted 12 months after surgery. And, symptoms of insomnia increased more than 12 months after surgery. However, the duration for other outcomes (four functional scales, three general symptom scales and three single items in QLQ-C30, and four symptom scales and four single items in QLQ-OES 18) were too heterogeneous to interpret.
Several studies had shown that open esophagectomy has a negative impact on almost all aspects of HRQL, and it would take 9–12 months to return to levels before operation [29,30,31]. Others reported that HRQL recovered more quickly after MIE than OE [15, 17,18,19,20].
This is the first meta-analysis to estimate the clinical relevance and duration of change for 24 HRQL outcomes from short- to long-term after MIE. After MIE, patients’ emotional function has no change from short- to mid-term follow-up; global QOL deteriorated only at short-term follow-up. Symptoms of constipation and speech problem increased from short- to mid-term follow-up, and insomnia increased up to long-term follow-up. In addition, global QOL, most functional scales, and most symptoms have negative change at short-term follow-up and keep the trend to mid- and/or long-term follow-up. However, the clinical relevance and the duration of most change cannot be interpreted because of huge heterogeneity.
The clinical heterogeneity of the studies focusing on HRQL after esophagectomy has been presented in many studies. Levenstein et al.  assessed HRQL by an international comparison. The study showed that HRQL varied from one country to another because of differences in social, cultural, medical systems, race, family structure, and/or economic determinants with relevance to the patient-physician relationship, patient education, and therapeutic decision making, and other factors. Comorbidity, tumors located in the middle or upper esophagus, SCC histology, tumors in stages III and IV have been reported to be associated with worse HRQL. And, patients with early disease stages had better HRQL than those with more locally advanced disease [33, 34].
It is still controversial whether patients receiving neoadjuvant chemotherapy or chemoradiotherapy had worse HRQL than those who underwent esophagectomy alone. Blazeby et al.  reported that patients who received palliative treatment had significantly worse pain, fatigue, appetite loss, constipation, and dysphagia. Other studies had shown that preoperative chemotherapy or chemoradiotherapy had a temporarily negative impact on HRQL, which returned to baseline levels before surgery, and recovery of HRQL after esophagectomy was not impaired by neoadjuvant treatment [29, 36]. In contrast, Ariga et al.  observed that patients with squamous cell carcinoma who underwent definitive chemoradiation had similar general HRQL scores and lower diarrhea, appetite loss, and eating problem scores than those who had undergone surgery alone.
The surgical approach (MIE vs. OE) and the length of the postoperative time period have been presented that had a positive impact on patients’ postoperative QOL (global QOL, physical function, fatigue symptoms, pain symptoms, and dyspnea symptoms) . And conservative, non-definitive treatments such as endoscopic treatment may cause more fear of recurrence than esophagectomy, which may have negative effect on HRQL .
It is impossible, up to now, to get enough homogeneous studies to analyze HRQL after MIE [13, 14]. In other words, the heterogeneities of studies included in our meta-analysis were unavoidable. Studies from five different countries were included. The tumor histology and tumor stage were different from one study to another. Whether neoadjuvant treatments were performed varied among the included studies.
Our study has some limitations. First, we selected more retrospective studies, and only one randomized controlled trial. Only one study aimed to assess the impact of MIE on HRQL, others aimed to compare HRQL between MIE an OE. Second, there were not enough studies available to investigate the influence of MIE on HRQL . Third, we chose studies reported in English, but omitted non-English studies . All these might lead to bias. Therefore, more randomized controlled trials are needed to validate HRQL after MIE.
This meta-analysis shows that the emotional function had no change after operation. The global function became worse during the early postoperative period; the symptoms of constipation, speech problem, and insomnia increased for a long time after operation.
European Organization for Research and Treatment of Cancer
Health-related quality of life
Minimally invasive esophagectomy
- OE :
Quality of life questionnaire
Rutegard M, Charonis K, Lu Y, Lagergren P, Lagergren J, Rouvelas I. Population-based esophageal cancer survival after resection without neoadjuvant therapy: an update. Surgery. 2012;152:903–10.
van Hagen P, Hulshof MC, van Lanschot JJ, Steyerberg EW, van Berge Henegouwen MI, Wijnhoven BP, Richel DJ, Nieuwenhuijzen GA, Hospers GA, Bonenkamp JJ, et al. Preoperative chemoradiotherapy for esophageal or junctional cancer. N Engl J Med. 2012;366:2074–84.
Miller KD, Siegel RL, Lin CC, Mariotto AB, Kramer JL, Rowland JH, Stein KD, Alteri R, Jemal A. Cancer treatment and survivorship statistics, 2016. CA Cancer J Clin. 2016;66:271–89.
Enzinger PC, Mayer RJ. Esophageal cancer. N Engl J Med. 2003;349:2241–52.
Wu PC, Posner MC. The role of surgery in the management of oesophageal cancer. Lancet Oncol. 2003;4:481–8.
Sjoquist KM, Burmeister BH, Smithers BM, Zalcberg JR, Simes RJ, Barbour A, Gebski V, Australasian Gastro-Intestinal Trials G. Survival after neoadjuvant chemotherapy or chemoradiotherapy for resectable oesophageal carcinoma: an updated meta-analysis. Lancet Oncol. 2011;12:681–92.
Jamieson GG, Mathew G, Ludemann R, Wayman J, Myers JC, Devitt PG. Postoperative mortality following oesophagectomy and problems in reporting its rate. Br J Surg. 2004;91:943–7.
Luketich JD, Pennathur A, Awais O, Levy RM, Keeley S, Shende M, Christie NA, Weksler B, Landreneau RJ, Abbas G, et al. Outcomes after minimally invasive esophagectomy: review of over 1000 patients. Ann Surg. 2012;256:95–103.
Yerokun BA, Sun Z, Jeffrey Yang CF, Gulack BC, Speicher PJ, Adam MA, D'Amico TA, Onaitis MW, Harpole DH, Berry MF, Hartwig MG. Minimally Invasive Versus Open Esophagectomy for Esophageal Cancer: A Population-Based Analysis. Ann Thorac Surg. 2016;102:416–23.
Sihag S, Kosinski AS, Gaissert HA, Wright CD, Schipper PH. Minimally Invasive Versus Open Esophagectomy for Esophageal Cancer: A Comparison of Early Surgical Outcomes From The Society of Thoracic Surgeons National Database. Ann Thorac Surg. 2016;101:1281–8. discussion 1288-1289
Yibulayin W, Abulizi S, Lv H, Sun W. Minimally invasive oesophagectomy versus open esophagectomy for resectable esophageal cancer: a meta-analysis. World J Surg Oncol. 2016;14:304.
Zhou C, Zhang L, Wang H, Ma XX, Shi BH, Chen WK, He JJ, Wang K, Liu PJ, Ren Y. Superiority of Minimally Invasive Oesophagectomy in Reducing In-Hospital Mortality of Patients with Resectable Oesophageal Cancer: A Meta-Analysis. PLoS One. 2015;10
Jacobs M, Macefield RC, Elbers RG, Sitnikova K, Korfage IJ, Smets EM, Henselmans I, van Berge Henegouwen MI, de Haes JC, Blazeby JM, Sprangers MA. Meta-analysis shows clinically relevant and long-lasting deterioration in health-related quality of life after esophageal cancer surgery. Qual Life Res. 2014;23:1097–115.
Scarpa M, Valente S, Alfieri R, Cagol M, Diamantis G, Ancona E, Castoro C. Systematic review of health-related quality of life after esophagectomy for esophageal cancer. World J Gastroenterol. 2011;17:4660–74.
Wang H, Feng M, Tan L, Wang Q. Comparison of the short-term quality of life in patients with esophageal cancer after subtotal esophagectomy via video-assisted thoracoscopic or open surgery. Dis Esophagus. 2010;23:408–14.
Parameswaran R, Blazeby JM, Hughes R, Mitchell K, Berrisford RG, Wajed SA. Health-related quality of life after minimally invasive oesophagectomy. Br J Surg. 2010;97:525–31.
Barbour AP, Mc Cormack OM, Baker PJ, Hirst J, Krause L, Brosda S, Thomas JM, Blazeby JM, Thomson IG, Gotley DC, Smithers BM. Long-Term Health-related Quality of Life Following Esophagectomy: A Nonrandomized Comparison of Thoracoscopically Assisted and Open Surgery. Ann Surg. 2016;
Nafteux P, Moons J, Coosemans W, Decaluwe H, Decker G, De Leyn P, Van Raemdonck D, Lerut T. Minimally invasive oesophagectomy: a valuable alternative to open oesophagectomy for the treatment of early oesophageal and gastro-oesophageal junction carcinoma. Eur J Cardiothorac Surg. 2011;40:1455–63. discussion 1463-1454
Wang H, Shen Y, Feng M, Zhang Y, Jiang W, Xu S, Tan L, Wang Q. Outcomes, quality of life, and survival after esophagectomy for squamous cell carcinoma: A propensity score-matched comparison of operative approaches. J Thorac Cardiovasc Surg. 2015;149:1006–14. discussion 1014-1005.e1004
Maas KW, Cuesta MA, van Berge Henegouwen MI, Roig J, Bonavina L, Rosman C, Gisbertz SS, Biere SS, van der Peet DL, Klinkenbijl JH, et al. Quality of Life and Late Complications After Minimally Invasive Compared to Open Esophagectomy: Results of a Randomized Trial. World J Surg. 2015;39:1986–93.
Higgins JP, Green S. Cochrane Handbook for Sys-tematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from www.cochrane-handbook.org. Accessed 27 Aug 2012.
Castoro C, Scarpa M, Cavallin F, Saadeh L, Pinto E, Alfieri R, Cagol M, Da Roit A, Pizzolato E, Noaro G, Pozza G. Impact of hybrid minimally invasive esophagectomy for cancer on quality of life. Surg Endosc Other Interv Tech. 2016;30:S133.
Cormack OM, Barbour A, Baker P, Hirst J, Thomas J, Blazeby J, Thomson I, Gotley D, Smithers B. Long-term health related quality of life outcomes following esophagectomy: A comparison between thorascopically assisted and open esophagectomy. Dis Esophagus. 2014;27:75A.
Lundell L. Quality of Life after Minimally Invasive Versus Open Esophagectomy. World J Surg. 2015;39:2109–10.
Zeng J, Liu JS. Quality of life after three kinds of esophagectomy for cancer. World J Gastroenterol. 2012;18:5106–13.
Shen H, Wang J, Li W, Yi W, Wang W. Assessment of health-related quality of life of patients with esophageal squamous cell carcinoma following esophagectomy using EORTC quality of life questionnaires. Mol Clin Oncol. 2015;3:133–8.
Sundaram A, Geronimo JC, Willer BL, Hoshino M, Torgersen Z, Juhasz A, Lee TH, Mittal SK. Survival and quality of life after minimally invasive esophagectomy: a single-surgeon experience. Surg Endosc. 2012;26:168–76.
Fujita T, Okada N, Sato T, Mayanagi S, Kanamori J, Daiko H. Translation, validation of the EORTC esophageal cancer quality-of-life questionnaire for Japanese with esophageal squamous cell carcinoma: analysis in thoraco-laparoscopic esophagectomy versus open esophagectomy. Jpn J Clin Oncol. 2016;46:615–21.
Reynolds JV, McLaughlin R, Moore J, Rowley S, Ravi N, Byrne PJ. Prospective evaluation of quality of life in patients with localized oesophageal cancer treated by multimodality therapy or surgery alone. Br J Surg. 2006;93:1084–90.
Blazeby JM, Farndon JR, Donovan J, Alderson D. A prospective longitudinal study examining the quality of life of patients with esophageal carcinoma. Cancer. 2000;88:1781–7.
de Boer AG, van Lanschot JJ, van Sandick JW, Hulscher JB, Stalmeier PF, de Haes JC, Tilanus HW, Obertop H, Sprangers MA. Quality of life after transhiatal compared with extended transthoracic resection for adenocarcinoma of the esophagus. J Clin Oncol. 2004;22:4202–8.
Levenstein S, Li Z, Almer S, Barbosa A, Marquis P, Moser G, Sperber A, Toner B, Drossman DA. Cross-cultural variation in disease-related concerns among patients with inflammatory bowel disease. Am J Gastroenterol. 2001;96:1822–30.
Viklund P, Lindblad M, Lagergren J. Influence of surgery-related factors on quality of life after esophageal or cardia cancer resection. World J Surg. 2005;29:841–8.
Djarv T, Lagergren J, Blazeby JM, Lagergren P. Long-term health-related quality of life following surgery for oesophageal cancer. Br J Surg. 2008;95:1121–6.
Blazeby JM, Williams MH, Brookes ST, Alderson D, Farndon JR. Quality of life measurement in patients with oesophageal cancer. Gut. 1995;37:505–8.
Blazeby JM, Sanford E, Falk SJ, Alderson D, Donovan JL. Health-related quality of life during neoadjuvant treatment and surgery for localized esophageal carcinoma. Cancer. 2005;103:1791–9.
Ariga H, Nemoto K, Miyazaki S, Yoshioka T, Ogawa Y, Sakayauchi T, Jingu K, Miyata G, Onodera K, Ichikawa H, et al. Prospective comparison of surgery alone and chemoradiotherapy with selective surgery in resectable squamous cell carcinoma of the esophagus. Int J Radiat Oncol Biol Phys. 2009;75:348–56.
Rosmolen WD, Boer KR, de Leeuw RJ, Gamel CJ, van Berge Henegouwen MI, Bergman JJ, Sprangers MA. Quality of life and fear of cancer recurrence after endoscopic and surgical treatment for early neoplasia in Barrett's esophagus. Endoscopy. 2010;42:525–31.
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to meta-analysis. Chichester: Wiley; 2009.
Moher D, Pham B, Lawson ML, Klassen TP. The inclusion of reports of randomised trials published in languages other than English in systematic reviews. Health Technol Assess. 2003;7:1–90.
We thank Hai-rong He for her help on the study design and data analysis. We also thank Zhengwang Wu (Department of Radiology, University of North Carolina), Shaoyi Du, Yiting Xu, Wenting Cui, and Teng Wan (Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University) for their language edit.
This work was supported by the Fundamental Research Funds for the Central University of China [No.08143004] in the design of the study and collection, analysis, and interpretation of data, by the Funds for Science and Technology Project of Shaanxi Province of China [No. 2014 K11-02-03-07] in writing the manuscript.
Availability of data and materials
The datasets generated during and/or analyzed during the current study are available in the MEDLINE, EMBASE, and Cochrane databases.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.