ObjectivesTo explore the characteristics of the international clinical studies using objective performance criteria (OPC) and provide a reference to design clinical trials and determine external controls.MethodsPubMed, The Cochrane Library and EMbase databases were searched for all clinical studies which used OPC. Two reviewers independently screened literature, extracted data and descriptive analysis was then performed.ResultsA total of 51 English language articles were included. Merely one was published in 2001, and others were published between 2010 and 2018. Twenty-seven articles (27/51, 52.9%) were published between 2017 and 2018, with accumulated impact factors of 411. In the article referring to the reasons for using the objective performance criteria, reasons for using OPC study was primarily the difficulties of randomization and comparison (8/11, 72.7%). Articles with cardiovascular disease and peripheral vascular disease accounted for 86%, and articles on the effectiveness or safety of medical devices accounted for 76.5%. Single-arm trial (40), randomized controlled trials (2), case-control studies (2), case series (5) and diagnostic tests (2) were included. OPCs were mostly derived from the data of clinical trials of other similar products, national standards, specialist association standard and meta-analysis of multiple clinical studies. A total of 27 articles (27/51, 52.9%) used hypothesis testing to compare research results with objective performance goal, and 24 articles (24/51, 47.1%) used the confidence interval method.ConclusionsOPC studies are primarily used for safety intervention and effect evaluation. OPC studies are developing very rapidly, especially in the field of cardiovascular studies. Methodological details are reported reasonably sufficient. Reasons for using OPC study are primarily the difficulties of randomization and comparison. Factors such as source of the OPC, sample size, and comparison method should be taken into account. The application of the OPC can not only solve the difficulties of the implementation of numerous clinical research, but also provide new insights for solving the practical difficulties of clinical research in the real-world.
Objective To understand the feasibility of application of objective performance criteria single arm trial in clinical efficacy evaluation of traditional Chinese medicine, and put forward theoretical countermeasures for the difficulties in application, so as to provide references for promoting the application of objective performance criteria single arm trial in clinical efficacy evaluation of traditional Chinese medicine in the future. Methods Semi-structured qualitative interviews were conducted among clinical experts and methodologists who were involved in objective performance criteria single arm trials using purposive sampling combined with snowball sampling and a preset interview outline. To explore the application situations, influencing factors and difficulties in the application process of objective performance criteria single arm trial in the clinical efficacy evaluation of traditional Chinese medicine, and put forward theoretical countermeasures. Results A total of 12 respondents were interviewed, including 7 clinical experts and 5 methodologists. The interview content was summarized and formed into 216 codes. After category analysis, 5 categories were formed, including the applicable situations, advantages, limitations, difficulties in the application process and theoretical countermeasures. The respondents believed that objective performance criteria single arm trial could be used as an alternative plan when controlled trials could not be carried out, or as a preliminary exploration or evidence supplement. It had the advantages of reducing sample size, good patient compliance, saving resource input, and relatively rigorous design. However, its application was limited due to low awareness and unclear level of evidence. The application difficulties included the setting of objective performance criteria, sample size calculation, quality control and statistical analysis. It was suggested to form a standard to promote its application in the efficacy evaluation of traditional Chinese medicine. Conclusion The design of objective performance criteria single arm trial is consistent with the characteristics of clinical research of traditional Chinese medicine. However, because there is no control group, the validity of objective performance criteria single arm trial is challenged, which hinders its further application in the clinical efficacy evaluation of traditional Chinese medicine. By standardizing the selection of objective performance criteria, calculation of sample size, statistical analysis methods and research implementation steps, the strength of its demonstration and the recognition can be improved to a certain extent, but attention should be paid to avoid its misuse. In the future, the objective performance criteria single arm trial may be used as a basis to further explore the new direction of scientific research methods for clinical efficacy evaluation of traditional Chinese medicine.