Implementation of the Virtual Certification Test for the Vascular Surgery Board

Introduction

Nearly every part of life has been significantly impacted in recent years by the global COVID-19 epidemic, including the procedure for surgical board certification. The Vascular Surgery Board (VSB) certification exam had to be canceled due to the established public health measures and travel restrictions (CE). Despite the difficulties of the pandemic, the VSB remained dedicated to advancing the certification process. They looked into other solutions for the CE as well as the qualifying exam, including a fully virtual format for the latter despite the security issues that would inevitably arise and the expanded information technology (IT) requirements. The American Board of Surgery (ABS) performed a number of virtual CEs (VCEs) as part of its pilot program for the general surgery certification process.

Methods

Examination Format

The main goals of the virtual format were to simulate the in-person experience and conduct a reliable psychometric test. As a result, every effort was made to maintain the in-person format. Three consecutive exams of 30 minutes each were given to the candidates, with four questions per session lasting a minute each. These predetermined subject areas encompassed the whole range of vascular surgical practice as outlined in the specialty's guide.

Virtual Format Modifications

to maintain the virtual format's fidelity and security, some alterations were made. Each candidate received a proctor who would conduct an immediate pre-examination security check and keep an eye on the candidate's desktop, surroundings, and behavior in order to spot any additional security-related problems. This involved scanning the room, asking the candidates to remove their belongings from their pockets, and watching them turn off their mobile devices. In order to prevent them from running any more apps, the candidates had to open their task manager and share their desktop with the proctor. Each primary room in the process contained three candidates, three proctors, three pairs of examiners, and a host who managed the movement of the candidates and examiners between the various testing "rooms" and acted as a point of contact for any IT problems. The proctor and the candidates were put in a "breakout room," and the examiner pairs alternated between the three breakout rooms. Six examiners in all examined each candidate. The examiners were given access to all the exam materials in an electronic format, including the questions and their supporting documentation, photographs, and scoresheets for marking, prior to the exam. They also had the chance to evaluate the questions and the images that went along with them.

Survey

After both virtual exams, the candidates, examiners, and proctors all filled out a survey. Using survey information and the results of the Vascular Surgery Board's first two virtual certification exams (VCEs), for the first two VCEs, the overall pass rates were on par with those using the in-person format. All parties involved in the process candidates, examiners, hosts, and proctors—were incredibly happy with it. The virtual format was favored by the candidates. The in-person format, however, was preferred by the examiners. The first two VCEs were tremendously successful and demonstrated to be psychometrically sound. Message to Remember: The findings of the current study demonstrated the psychometric validity and resounding success of the first two Vascular Surgery Board virtual certifying tests. 

Statistical Analysis

Using the c2 test for independence, which was deemed statistically significant, the passing rates for the two VCEs were compared to those of the in-person CE. Descriptive statistics were used to combine and analyse the closed-ended survey questions. The c2 test was used to compare the candidates' replies to those of the examiners and all non-candidates. The open-ended questions' replies were qualitatively examined to find recurring themes and any areas of concern. Due to the nature of the study, the University of Florida's institutional review board determined that it was exempt from review.

Study Limitations

Although the total response rate was relatively good, the present study contained the typical limitations associated with using survey data, such as the fact that not all of the possible participants had completed the survey. The VSB psychometricians have assessed the survey questions, although they could be biased. We have no reason to believe that the host’s and proctors' responses would have changed after the second exam because the procedure was comparable or enhanced, but they only completed the survey after the first VCE.

Journal Information

The Journal of Surgical Research is an academic, interdisciplinary journal that serves as a venue for the publication of scientific manuscripts based on innovative surgical interventions for the treatment and/or management of abdominal, cancer, vascular, head and neck, breast, colorectal, and other forms of surgery, or research advancements corresponding to the development of advanced medical tools and techniques, which in turn may help in completing challenging surgical procedures.

*The “Journal of Surgical Research”.

Publishes current research articles related to Surgery.

Manuscript Submission Link: https://www.pulsus.com/submissions/pulsus-surgical-research.html