The QUADAS-2, QUIPS, and PROBAST tools are not specific for prognostic accuracy studies and the use of these tools to assess the risk of bias in prognostic accuracy studies is prone to bias. Therefore, QUAPAS, a risk of bias assessment tool for prognostic accuracy studies, has recently been developed. The tool combines QUADAS-2, QUIPS, and PROBAST, and consists of 5 domains, 18 signaling questions, 5 risk of bias questions, and 4 applicability questions. This paper will introduce the content and usage of QUAPAS to provide inspiration and references for domestic researchers.
The COSMIN community updated the COSMIN-RoB checklist on reliability and measurement error in 2021. The updated checklist can be applied to the assessment of all types of outcome measurement studies, including clinician-reported outcome measures (ClinPOMs), performance-basd outcome measurement instruments (PerFOMs), and laboratory values. In order to help readers better understand and apply the updated COSMIN-RoB checklist and provide methodological references for conducting systematic reviews of ClinPOMs, PerFOMs and laboratory values, this paper aimed to interpret the updated COSMIN-RoB checklist on reliability and measurement error studies.
Nonrandomized studies are an important method for evaluating the effects of exposures (including environmental, occupational, and behavioral exposures) on human health. Risk of bias in nonrandomized studies of exposures (ROBINS-E) is used to evaluate the risk of bias in natural or occupational exposure observational studies. This paper introduces the main contents of ROBINS-E 2022, including backgrounds, seven domains, signal questions and the operation process.
ObjectiveTo evaluate whether and to what extent the new risk of bias (ROB) tool has been used in Cochrane systematic reviews (CSRs) on acupuncture. MethodsWe searched the Cochrane Database of Systematic Review (CDSR) in issue 12, 2011. Two reviewers independently selected CSRs which primarily focused on acupuncture and moxibustion. Then the data involving in essential information, the information about ROB (sequence generation, allocation concealment, blindness, incomplete outcome data, selective reporting and other potential sources of bias) and GRADE were extracted and statistically analyzed. ResultsIn total, 41CSRs were identified, of which 19 CSRs were updated reviews. Thirty-three were published between 2009 and 2011. 60.98% reviews used the Cochrane Handbook as their ROB assessment tool. Most CSRs gave information about sequence generation, allocation concealment, blindness, and incomplete outcome data, however, half of them (54.55%, 8/69) showed selective reporting or other potential sources of bias. Conclusion"Risk of bias" tools have been used in most CSRs on acupuncture since 2009. However, the lack of evaluation items still remains.
ObjectivesTo comprehensively evaluate the methodological quality and applicability of the results of systematic reviews on acupuncture treatment for primary depression.MethodsWeb of Science, EMbase, PubMed, The Cochrane Library, CNKI, CBM, WanFang Data and VIP databases were electronically searched to collect systematic reviews/meta-analyses on acupuncture treatment for primary depression from inception to December 5th, 2018. Two researchers independently screened and extracted data by using tools of AMSTAR 2 to evaluate the methodological quality, using ROBIS to assess risk of bias, and using CASP-S.R to evaluate the applicability of the results.ResultsA total of 18 systematic reviews/meta-analyses were included, and all focused on acupuncture intervention, including 2 primary outcome indicators. According to AMSTAR 2 evaluation results, there were 4 high quality studies, 12 medium quality studies and 2 low quality studies; ROBIS results found 10 high bias risk studies, 7 low bias risk studies and 1 unclear; CASP-S.R showed only 4 design studies applicable to local individuals, and there were no studies on the relationship between design benefits, hazards and costs.ConclusionsThe quality of systematic reviews/meta-analyses for acupuncture treatment of primary depression is moderate, however with a certain bias. Most studies may not directly benefit local individuals. All studies have no relationship with cost hazards. It is expected for further reviewers to strictly follow systematic evaluation method to improve research quality and reduce bias, while the applicability of the systematic review to individuals from different regions should be considered as well as the relationship between the benefit and cost hazard. In addition, more valid RCTs are required to provide higher quality evidence and explore correlated and comprehensive mechanism.
The COSMIN-RoB checklist includes three sections with a total of 10 boxes, which is used to evaluate risk of bias of studies on content validity, internal structure, and other measurement properties. COSMIN classifies reliability, measurement error, criteria validity, hypothesis testing for construct validity, and responsiveness as other measurement properties, which primarily focus on the quality of the (sub)scale as a whole, rather than on the item level. Among the five measurement properties, reliability, measurement error and criteria validity are the most widely used in the studies. Therefore, this paper aims to interpret COSMIN-RoB checklist with examples to guide researchers to evaluate the risk of bias of the studies on reliability, measurement error and criteria validity of PROMs.
This paper summarizes the methodological quality assessment tools of artificial intelligence-based diagnostic test accuracy studies, and introduces QUADAS-AI and modified QUADAS-2. Moreover, this paper summarizes reporting guidelines of these studies as well, and then introduces specific reporting standards in AI-centred research, and checklist for AI in dental research.
This study aims to introduce how to use the PROBAST (prediction model risk of bias assessment tool) to evaluate risk of bias and applicability of the study of diagnostic or prognostic predictive models, including the introduction of the background, the scope of application and use of the tool. This tool mainly involves the four areas of participants, predictors, outcomes and analyses. The risk of bias in the research is evaluated through the four areas, while the applicability is evaluated in the first three. PROBAST provides a standardized approach to evaluate the critical appraisal of the study of diagnostic or prognostic predictive models, which screens qualified literature for data analysis and helps to establish a scientific basis for clinical decision-making.
This paper introduces the main contents of ROB-ME (Risk Of Bias due to Missing Evidence), including backgrounds, scope of the tool, signal questions and the operation process. The ROB-ME tool has the advantages of clear logic, complete details, simple operation and good applicability. The ROB-ME tool offers considerable advantages for assessing the risk of non-reporting biases and will be useful to researchers, thus being worth popularizing and applying.
The risk of bias assessment tool 2.0 (RoB 2.0) for analyzing cluster randomized trials and crossover trials (revised version 2021) has been updated. The current paper briefly delineates the history of the RoB 2.0 tool and includes an explanation and interpretation of the updated contents and software operation process for use with cluster randomized trials and crossover trials. Compared with the previous versions, the updated RoB 2.0 tool (revised version 2021) has the advantage of precise language and is easily understood. Thus, the updated RoB 2.0 tool merits popularization and further general application.