YANG Nan 1,2,3,4,5 , ZOU Kun 2,3,4,5 , HE Siyi 1,2,3,4,5 , ZENG Linan 2,3,4,5 , LI Hailong 2,3,4,5 , HUANG Liang 2,3,4,5 , YI Qiusha 2,3,4,5 , ZHANG Mingyue 6 , HUANG Chao 7 , WANG Qiang 7 , ZHANG Lingli 2,3,4,5,8
  • 1. West China School of Pharmacy, Sichuan University, Chengdu 610041, P. R. China;
  • 2. Department of Pharmacy, West China Second University Hospital, Sichuan University, Chengdu 610041, P. R. China;
  • 3. Evidence-based Pharmacy Center, West China Second University Hospital, Sichuan University, Chengdu 610041, P. R. China;
  • 4. NMPA Key Laboratory for Technical Research on Drug Products in vitro and in vivo Correlation, Chengdu 610041, P. R. China;
  • 5. Key Laboratory of Birth Defects and Related Diseases of Women and Children, Ministry of Education, Chengdu 610041, P. R. China;
  • 6. School of Stomatology, Chinese Medical University, Shenyang 110002, P. R. China;
  • 7. Medical Management Service Guidance Center, National Health Commission of the People’s Republic of China, Beijing 100044, P. R. China;
  • 8. Chinese Evidence-based Medicine Center, West China Hospital, Sichuan University, Chengdu 610041, P. R. China;
WANG Qiang, Email: jason2019@sina.cn; ZHANG Lingli, Email: zhanglingli@scu.edu.cn
Guidelines implementation effect evaluation tool; Reliability; Validity
10.7507/1672-2531.202308066
Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables References Cited by

Objective To evaluate the reliability and validity of the guideline implementation effect evaluation tool. Methods With the guideline for the prevention and treatment of type 2 diabetes mellitus in China (2020 edition) as the target guideline, health care providers and patients from different hospitals across the country were investigated by questionnaire using the guideline implementation effect evaluation tool. Spearman-Brown coefficient and Cronbach's α coefficient were used to evaluate the split-half reliability and internal consistency reliability, while the structural validity, convergent validity and discriminant validity were investigated by confirmatory factor analysis based on structural equation. Results The internal consistency reliability and split half reliability coefficients of the whole tool and each dimension ranged from 0.650 to 0.986. The scale-level content validity index (S-CVI/Ave) of content validity was 0.846. Confirmatory factor analysis showed that, the χ2/df of two sections of the tool were 8.695 and 6.123, respectively. The root mean square residual (RMR), the standard root mean square residual (SRMR) and the root mean square error of approximation (RMSEA) were under or almost under the threshold. Besides, the goodness-of-fit index (GFI) of them were 0.901 and 0.822, the adjusted goodness-of-fit index (AGFI) were 0.836 and 0.787, and the parsimonious normed fit index (PNFI) were 0.545 and 0.788, respectively. Conclusion The guideline implementation effect evaluation tool was proved to be valid and reliable, and it shows that it is necessary to optimize the items under the dimensions of maintenance and evaluation of diagnosis and treatment effect in the future.