Category Oral Presentation
Author Richard Rathe, MD <rrathe@ufl.edu>
Affiliation University of Florida College of Medicine
Abstract We have over six years of experience with online testing and evaluation at the University of Florida College of Medicine. Our system has grown into a collection of integrated programs we call "EvalSuite." (See http://evalsuite.medinfo.ufl.edu/ for more info.) For the past three years we have used a 112 seat computerized testing center for more than 90% of our basic science quizzes and examinations (for an average of 28712 student/hours annually). Our performance-based assessment / standardized patient program has also been 100% paperless for several years. We created the current testing engine by modifying our original general purpose evaluation system. Due to this origin it has several weaknesses and vulnerabilities that we felt compelled to remedy. In late 2002 we developed the eXtensible Assessment Machine (XAM) to address our need for more sophisticated test delivery and control. Our design criteria lead to a system that: 1) integrates with the existing EvalSuite programs without modification; 2) secures test material based on date, time, location, network address, and student identity; 3) tracks individual questions based on the competencies defined by our curriculum committee; 4) provides a "heads up" display for exam proctors showing the real-time status of each student; 5) presents questions one at a time with a clean and efficient user interface; 6) allows long test forms to be broken up to give students ample time for breaks; and 7) has a robust disaster recovery capability for the inevitable computer crashes, fire drills, etc. We will make the transition to this new system in January 2003 and present our preliminary results at the April meeting. (Presentation Slides)