Examining the false-negative results of meta-analyses of Cochrane urology group using trial sequential analysis_Chinese Journal of Evidence-Based Medicine

Authors：

WENG Hong ¹ , LI Xiaodong ² , YIN Xiaohong ¹ , NING Xianghui ³ , ZHAO Yuhang ⁴ ,  ZENG Xiantao ^1,5

1. Center for Evidence-Based and Transitional Medicine, Zhongnan Hospital of Wuhan University; Center for Evidence-Based and Transitional Medicine, Wuhan University; Department of Evidence-Based Medicine and Clinical Epidemiology, The Second Clinical Medical College of Wuhan University, Wuhan, 430071, P.R.China;
2. Department of Urology, Management Office of Scientific Research and Postgraduate Affairs, Huaihe Hospital of Henan University, Kaifeng, 475000, P.R.China;
3. Department of Urology, First Hospital of Peking University, Beijing, 100034, P.R.China;
4. Department of Neurosurgery, Zhongnan Hospital of Wuhan University, Wuhan, 430071, P.R.China;
5. Department of Urology, Zhongnan Hospital of Wuhan University, Wuhan, 430071, P.R.China;

Corresponding author：

ZENG Xiantao, Email: zengxiantao1128@163.com

Keywords：

Trial sequential analysis; Meta-analysis; False-negative result; Cochrane review

DOI：

10.7507/1672-2531.201608028

Video：

Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables Video References Cited by

Objective To detect the false-negative results of cumulative meta-analyses of Cochrane Urology Group with the trial sequential analysis (TSA). Methods The Urology Group of The Cochrane Library (Issue 6, 2016) was searched to collect meta-analyses with negative results. Two researchers independently screened literature and extracted data of included meta-analyses. Then, TSA was performed using TSA software version 0.9 beta. Results A total of 11 papers involving 12 meta-analyses were included. The results of TSA showed that, four (33%) out of 12 meta-analyses were potentially false-negative results for failing to surpass the trial sequential monitoring boundary and to reach the required information size. Conclusion Some of the negative results of systematic reviews from Cochrane Urology Group was false-negative. TSA can help researchers to identify the false-negative results of meta-analyses.

Citation： WENG Hong, LI Xiaodong, YIN Xiaohong, NING Xianghui, ZHAO Yuhang, ZENG Xiantao. Examining the false-negative results of meta-analyses of Cochrane urology group using trial sequential analysis. Chinese Journal of Evidence-Based Medicine, 2017, 17(5): 593-597. doi: 10.7507/1672-2531.201608028 Copy

1.	Pogue JM, Yusuf S. Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials, 1997, 18(6): 580-593.
2.	Wetterslev J, Thorlund K, Brok J, et al. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol, 2008, 61(1): 64-75.
3.	Brok J, Thorlund K, Gluud C, et al. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol, 2008, 61(8): 763-769.
4.	Thorlund K, Devereaux PJ, Wetterslev J, et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol, 2009, 38(1): 276-286.
5.	翁鸿, 武珊珊, 张永刚, 等. 序贯 Meta 分析方法学简介. 中国循证医学杂志, 2016, 16(10): 1216-1220.
6.	翁鸿, 郭成城, 吕军, 等. 试验序贯分析之信息量的计算. 中国循证医学杂志, 2016, 17(1): 113-116.
7.	翁鸿, 王朝阳, 贺大林, 等. 试验序贯分析检验累积 Meta 分析假阳性结果的研究. 中国循证医学杂志, 2017, 17(4):458-462.
8.	Wetterslev J, Thorlund K, Brok J, et al. Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol, 2009, 9(1): 1-12.
9.	Thorlund K, Engstrøm J, Wetterslev J, et al. User manual for trial sequential analysis (TSA). Copenhagen Trial Unit, Center for Clinical Intervention Research, Copenhagen, Denmark. 2011. Available at: .
10.	翁鸿, 李胜, 曾宪涛, 等. 试验序贯分析软件在 Meta 分析中的应用. 中国循证医学杂志, 2016, 16(5): 604-611.
11.	Schmitt B, Bennett C, Seidenfeld J, et al. Maximal androgen blockade for advanced prostate cancer. Cochrane Database Syst Rev, 1999, (4): CD001526.
12.	Wilt TJ, Nair B, MacDonald R, et al. Early versus deferred androgen suppression in the treatment of advanced prostatic cancer. Cochrane Database Syst Rev, 2001, (4): CD003506.
13.	Sze WM, Shelley M, Held I, et al. Palliation of metastatic bone pain: single fraction versus multifraction radiotherapy. Cochrane Database Syst Rev, 2002, (1): CD004721.
14.	Advanced bladder cancer meta-analysis collaboration. Neo-adjuvant chemotherapy for invasive bladder cancer. Cochrane Database Syst Rev, 2004, (1): CD005246.
15.	Vale CL. Advanced bladder cancer meta-analysis collaboration. Adjuvant chemotherapy for invasive bladder cancer (individual patient data). Cochrane Database Syst Rev, 2006, (2): CD006018.
16.	Wilt TJ, MacDonald R, Hagerty K, et al. 5-alpha-reductase inhibitors for prostate cancer prevention. Cochrane Database Syst Rev, 2008, (2): CD007091.
17.	Zani EL, Clark OA, Rodrigues Netto N Jr. Antibiotic prophylaxis for transrectal prostate biopsy. Cochrane Database Syst Rev, 2011(5): CD006576.
18.	Hoffman RM, Monga M, Elliott SP, et al. Microwave thermotherapy for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2012, (9): CD004135.
19.	Tacklind J, Fink HA, Macdonald R, et al. Finasteride for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2010, (10): CD006015.
20.	Tacklind J, MacDonald R, Rutks I, et al. Serenoa repens for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2012, (12): CD001423.
21.	Ilic D, Neuberger MM, Djulbegovic M, et al. Screening for prostate cancer. Cochrane Database Syst Rev, 2013, (1): CD004720.

1. Pogue JM, Yusuf S. Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials, 1997, 18(6): 580-593.
2. Wetterslev J, Thorlund K, Brok J, et al. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol, 2008, 61(1): 64-75.
3. Brok J, Thorlund K, Gluud C, et al. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol, 2008, 61(8): 763-769.
4. Thorlund K, Devereaux PJ, Wetterslev J, et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol, 2009, 38(1): 276-286.
5. 翁鸿, 武珊珊, 张永刚, 等. 序贯 Meta 分析方法学简介. 中国循证医学杂志, 2016, 16(10): 1216-1220.
6. 翁鸿, 郭成城, 吕军, 等. 试验序贯分析之信息量的计算. 中国循证医学杂志, 2016, 17(1): 113-116.
7. 翁鸿, 王朝阳, 贺大林, 等. 试验序贯分析检验累积 Meta 分析假阳性结果的研究. 中国循证医学杂志, 2017, 17(4):458-462.
8. Wetterslev J, Thorlund K, Brok J, et al. Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol, 2009, 9(1): 1-12.
9. Thorlund K, Engstrøm J, Wetterslev J, et al. User manual for trial sequential analysis (TSA). Copenhagen Trial Unit, Center for Clinical Intervention Research, Copenhagen, Denmark. 2011. Available at: .
10. 翁鸿, 李胜, 曾宪涛, 等. 试验序贯分析软件在 Meta 分析中的应用. 中国循证医学杂志, 2016, 16(5): 604-611.
11. Schmitt B, Bennett C, Seidenfeld J, et al. Maximal androgen blockade for advanced prostate cancer. Cochrane Database Syst Rev, 1999, (4): CD001526.
12. Wilt TJ, Nair B, MacDonald R, et al. Early versus deferred androgen suppression in the treatment of advanced prostatic cancer. Cochrane Database Syst Rev, 2001, (4): CD003506.
13. Sze WM, Shelley M, Held I, et al. Palliation of metastatic bone pain: single fraction versus multifraction radiotherapy. Cochrane Database Syst Rev, 2002, (1): CD004721.
14. Advanced bladder cancer meta-analysis collaboration. Neo-adjuvant chemotherapy for invasive bladder cancer. Cochrane Database Syst Rev, 2004, (1): CD005246.
15. Vale CL. Advanced bladder cancer meta-analysis collaboration. Adjuvant chemotherapy for invasive bladder cancer (individual patient data). Cochrane Database Syst Rev, 2006, (2): CD006018.
16. Wilt TJ, MacDonald R, Hagerty K, et al. 5-alpha-reductase inhibitors for prostate cancer prevention. Cochrane Database Syst Rev, 2008, (2): CD007091.
17. Zani EL, Clark OA, Rodrigues Netto N Jr. Antibiotic prophylaxis for transrectal prostate biopsy. Cochrane Database Syst Rev, 2011(5): CD006576.
18. Hoffman RM, Monga M, Elliott SP, et al. Microwave thermotherapy for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2012, (9): CD004135.
19. Tacklind J, Fink HA, Macdonald R, et al. Finasteride for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2010, (10): CD006015.
20. Tacklind J, MacDonald R, Rutks I, et al. Serenoa repens for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2012, (12): CD001423.
21. Ilic D, Neuberger MM, Djulbegovic M, et al. Screening for prostate cancer. Cochrane Database Syst Rev, 2013, (1): CD004720.

Chinese Journal of Evidence-Based Medicine

Examining the false-negative results of meta-analyses of Cochrane urology group using trial sequential analysis

Abstract Full text Figures/Tables Video References Cited by

Previous Article

Next Article

Format

Content