Evaluating the Effectiveness of a Transition to Practice Program for Critical Care New Nurses Using CIPP and Kirkpatrick Models

Abstract

This study assessed the effectiveness of a Transition to Practice (TTP) Program for novice critical care nurses across multiple hospitals. The objective was to evaluate program design, system operations, and quality management using the CIPP (Context, Input, Process, Product) and Kirkpatrick models. A mixed-methods approach was employed, integrating quantitative and qualitative analyses. Data were gathered from self-assessment reports submitted by participating hospitals. The evaluation framework encompassed four domains—context, input, process, and product—across 40 performance indicators. The product outcomes, aligned with the Kirkpatrick model, included measures of satisfaction, competency attainment, practical adaptation, and organizational integration. The majority of 52 hospitals effectively implemented the TTP program, meeting core criteria. However, challenges were identified in areas such as role delineation and resource allocation. Substantial variability in evaluation outcomes was observed, particularly in the application of pedagogical methods and feedback mechanisms. While 49 hospitals achieved high ratings for satisfaction, academic achievement assessments conducted in 52 hospitals revealed that 30 failed to disseminate their results, indicating the need for enhanced information-sharing practices. Furthermore, behavior evaluations yielded high ratings in 35 hospitals, but 17 hospitals were rated as "medium" or below, underscoring the necessity for continuous improvements in behavioral assessments. The TTP program shows significant promise in augmenting the competencies of new critical care nurses. However, ongoing refinements are required to optimize program outcomes, particularly in the domains of feedback dissemination and behavioral evaluation, to ensure consistent and effective implementation across all hospitals.

Save as a Favourite

Author Information
Heui-Kyeong Kwon, Seoul Nation University Hospital, South Korea
Wan-Hee Choi, Seoul Nation University Hospital, South Korea
Eun-Kyoung Bang, Seoul Nation University Hospital, South Korea
Eun-Young Park, Seoul National University Hospital, South Korea
Yu-Sun Jang, Seoul National University Hospital, South Korea
So-Young Lee, Seoul National University Hospital, South Korea

• Category: Adult, Lifelong & Distance Learning

Posted by James Alexander Gordon

All Posts