Abstract: Evaluation of a learning method not only identify its efficiency aspects but also leads to its improvement and modification. Expert choice evaluation is among various methods applied for evaluation of the learning methods. The present study was conducted to evaluate laparoscopic virtual reality simulator on the basis of expert choice evaluation.
Materials and methods: Our study design as a cross-sectional investigation .The research instrument used in this study was a questionnaire prepared by the authors containing 46 items in five aspects (educational planning, evaluation capability, user quality, technical structure, and overall evaluation). The output of this questionnaire was a score on the scale of 5. Through this evaluation, 20 experts from different fields 10 general surgeon(laparoscopic experts) and 10 experts person in educational simulation, medical educations, and artificial intelligence) were included in the study and trained using a virtual reality based surgery simulator (SINA Sim). Eventually, the information gathered from the users (experts) was imported to SPSS software Ver.20 in order to perform a statistical analysis.
Results: This research was conducted on 20 experts with an average age of 47.6 ± 8.4 years. The average evaluation score achieved by the experts(about these simulator ) in the educational aspect were as follows: concept transfer = 3.7, design quality of the educational scenario = 2.8, the accuracy of the anatomic design = 3.5, and 2.8 in total. In evaluation capability of the simulator, the gained scores were as: the scoring system of the simulator = 2.4, accurate estimation of users’ skill = 2.2, comparison capability of the user with other users = 2.2, and error analysis capability = 2.8. In working environment aspect, the gained scores were as: user interface experience = 2.3, ease of access and use of the simulator = 2.4, and user quality sum of the simulator = 2.82. Moreover, in the aspects including graphical quality of the simulator and reality of the software environment, the quality and physical behavior of the tissues, and accuracy of camera view, scores of 3.1, 2.6, and 2.6 were achieved, respectively. Finally, the total score evaluated using this simulator for realizing the educational level was 3.08 on the basis of experts choice.
Discussion: Similar to the previous studies, this study indicated that the virtual reality based simulation methods can mostly simulate the clinical scenarios for students and may possibly be an efficient method for skills improvement and error reduction. Furthermore, the results of the present research imply that the virtual reality-based laparoscopic simulative educational method can be effective in skill enhancement and experience gain of users such as residents, fellowships, or expert’s surgeon.