Research of generating real-world evidence using real world data has attracted considerable attention globally. Outcome research of treatment based on existing health and medical data or registries has become one of the most important topics. However, there exists certain confusions in this line of research on how to design and implement appropriate statistical analysis. Therefore, in the fourth chapter of the series technical guidance to develop real world evidence by China REal world data and studies Alliance (ChinaREAL), we aim to provide an guidance on statistical analysis in the study to assess therapeutic outcomes based on existing health and medical data or registries.In this chapter, we first emphasize the significance of pre-specified statistical analysis plan, recommending key components of the statistical analysis plan. We then summarize the issue of sample size calculation in this content and clarify the interpretation of statistical p-value. Secondly, we recommend procedures to be considered to tackle the issue related to the selection bias, information bias and most importantly, confounding bias. We discuss the multivariable regression analysis as well as the popular causal inference models. We also suggest that careful consideration should be made to deal with missing data in real-world databases. Finally, we list core content of the statistical report.
The utilisation of statistical analysis plan (SAP) has the potential to enhance the reliability, transparency, and impartiality of statistical analysis procedures in the context of clinical studies. These plans are primarily designed for late phase clinical studies, namely phase Ⅱ and phase Ⅲ randomised controlled trials. The extended SAP reporting guidelines for early phase clinical studies, i.e., phase Ⅰ clinical studies and phase Ⅱ non-randomised controlled trials, have been expanded from the original reporting guidelines in six key areas: trial purpose, design, Bayesian statistics, data simulation, sample size, and the application of ICH E9 (R1). The expanded reporting guidelines facilitate the standardisation of SAP for early phase clinical trials, enhance the transparency and reproducibility of early phase clinical studies, and thereby improve the quality of early phase clinical studies. This, in turn, plays a pivotal role in later phase clinical studies.