Objective: The study is aimed to develop and assess the quality of an evaluation form used to evaluate the nurse anesthetic trainees’ skills in undertaking a pre-use check of an anesthetic machine.
Material and Method: An evaluation form comprising 25 items was developed, informed by the guidelines published by national anesthesiologist societies and refined to reflect the anesthetic machine used in our institution. The item-checking included the cylinder supplies and medical gas pipelines, vaporizer back bar, ventilator, anesthetic breathing system, scavenging system and emergency back-up equipment. The authors sought the opinions of five experienced anesthetic trainers to judge the validity of the content. The authors measured its inter-rater reliability when used by two achievement scores evaluating the
performance of 36 nurse anesthetic trainees undertaking 15-minute anesthetic machine checks and test-retest the reliability correlation scores between the two performances in the seven days interval.
Results: The five experienced anesthesiologists agreed that the evaluation form accurately reflected the objectives of anesthetic machine checking, equating to an index of congruency of 1.00. The inter-rater reliability of the independent assessors scoring was 0.977 (p = 0.01) and the test-retest reliability was 0.883 (p = 0.01).
Conclusion: An evaluation form proved to be a reliable and effective tool for assessing the anesthetic nurse trainees’
checking of an anesthetic machine before the use. This evaluation form was brief, clear and practical to use, and should help to improve anesthetic nurse education and the patient safety.

Keywords: Medical device, Anesthetic machine, Anesthetic nurse, Training, Assessment, Evaluation tool