Localization and Content Validation of the Organizational Readiness of Implementing Evidence-based Practices Scale

This study aimed to localize the workplace readiness questionnaire (WRQ) and validate its applicability for assessing readiness for implementation of evidence-based practices (EBP) in primary care settings in China. The localization of the instrument will provide a practical instrument for assessing organizational readiness for change (ORC).

The WRQ was translateed into Chinese version using the modified Brislin translation model, and its cross-cultural validity, content validity, and generalizability were evaluated by the Delphi method, and the expert feedback was evaluated using the item-level content validity index (I-CVI), scale-level content validity index (S-CVI), and corrected Kappa value. The index weights were evaluated by the analytic hierarchical process (AHP). The target users of the scale were invited to quantitatively evaluate its item importance score (IIS), and the surface validity was evaluated by combining the qualitative feedback from their cognitive interviews.

To clarify the purpose of the scale, we revised its name to the Organizational Readiness of Implementing Evidence-Based Practices (ORIEBP) Scale. The ORIEBP scale contained five dimensions, which were Change Context, Change Valence, Information Evaluation, Change Commitment, Change Efficiency, and 32 items. After two rounds of the Delphi method to refine the construction of three dimensions and expressions of 11 items, the I-CVI were from 0.73 to 1.00, the Kappa value were from 0.70 to 1.00, and the S-CVI was over 0.92. All evaluation matrices of the hierarchical analysis method met the requirement of consistency ratio (CR < 0.1), and the weights of five dimensions were 0.2083, 0.2022, 0.1907, 0.2193, and 0.1795, in sequence. Nine out of eleven experts identified that items were applicable to other readiness assessment scenarios. The IIS scores for the five dimensions and 32 items were ranged from 2.93 to 3.54, and 2.71 to 3.42, presenting good face validity. The cognitive interview results showed that professional expressions were complex to understand.

This study validated the ORIEBP scale and has good content validity and generalizability. The scale can be further improved by expanding its scope of use and validating its structure validity and reliability in different settings.