Dissertation
ASSESSING THE RELIABILITY OF SIMULATION EVALUATION INSTRUMENTS USED IN NURSING EDUCATION: A TEST OF CONCEPT STUDY
Doctor of Philosophy (PhD), Washington State University
01/2011
Handle:
https://hdl.handle.net/2376/118382
Abstract
Human patient simulation (HPS) provides experiential learning opportunities for student nurses and may be used as a supplement or alternative to traditional clinical education. The body of evidence supporting HPS as a teaching strategy is growing. However, challenges associated with measuring student learning and performance in HPS activities continue to be a barrier to building the evidence base supporting or contesting the efficacy of HPS in nursing education. This proof of concept study included the development and utilization of a database of leveled, video-archived HPS scenarios for assessing the reliability (inter-rater, inter-instrument, and intra-rater or test-retest) and internal consistency of data produced using the Lasater Clinical Judgment Rubric© (LCJR), the Seattle University Evaluation Tool© and the Creighton Simulation Evaluation Instrument TM (C-SEI). Twenty-nine nurse educators completed the six-week study procedures. Descriptive statistics and ANOVA comparisons of means supported the validity of the leveled, video-archived scenarios. The inter-rater reliability of data from the LCJR© was ICC (2,1) (95% CI) = .889, (.402, .984) the inter-rater reliability of data from the Seattle University Evaluation Tool© was ICC (2,1) (95% CI) = .858 (.286, .979) and the inter-rater reliability of data from the C-SEI TM was ICC (2,1) (95% CI) = .952 (.697, .993). Using ICC (3,1) (95% CI), the intra-rater reliability of data from the LCJR© was .908 (.125, .994), from the Seattle University Evaluation Tool© it was .907 (.120, .994), and from the C-SEI TM it was, .883 (-.001, .992). The internal consistencies of the LCJR©, Seattle University Evaluation Tool© and C-SEI TM using Cronbach's Alpha were α = .974, .965, and .979 respectively. These results provided valuable information for educators and researchers seeking to measure student learning outcomes from HPS activities. Further, the success of this study provided evidence for the feasibility of a novel method for rapid instrument assessment which is being used for ongoing national research.
Metrics
Details
- Title
- ASSESSING THE RELIABILITY OF SIMULATION EVALUATION INSTRUMENTS USED IN NURSING EDUCATION: A TEST OF CONCEPT STUDY
- Creators
- Katie Anne Adamson
- Contributors
- Suzan Kardong-Edgren (Advisor)Linda Eddy (Committee Member)Bob Short (Committee Member)
- Awarding Institution
- Washington State University
- Academic Unit
- Nursing, College of
- Theses and Dissertations
- Doctor of Philosophy (PhD), Washington State University
- Number of pages
- 134
- Identifiers
- 99900581861801842
- Language
- English
- Resource Type
- Dissertation