Impact
Leveraging technology to provide high-quality remote interviewer training for national surveys
Large-scale national surveys in the U.S. have traditionally relied on in-person interviews with study participants. With the shift to virtual interviews due to the COVID-19 pandemic, health survey implementers needed to quickly develop new methods to remotely train a specialized workforce of clinical interviewers across the country without sacrificing quality or engagement.
As the lead for several national surveys during the COVID-19 pandemic, RTI developed and implemented a remote program to train clinical interviewers on the protocols for two health surveys conducted by the Substance Abuse and Mental Health Services Administration (SAMHSA): the Mental and Substance Use Disorders Prevalence Study (MDPS) and the Mental Illness Calibration Study (MICS; a sub-study of the National Survey on Drug Use and Health).
Our training program required all hired interviewers to have or be pursuing an advanced clinical degree and consisted of virtual pre-, live-, and post-training activities that culminated in a certification. The program was first implemented for MDPS, which began data collection in late 2020, followed by MICS, which began data collection in 2022. By the time MCIS is complete in 2024, our trained interviewers will have conducted over 10,000 virtual clinical interviews for these surveys, highlighting the effectiveness of high-quality remote training for this specialized workforce.
Preparing Future Clinical Interviewers for Training
After the hiring process was complete, interviewers were mailed pre-training materials including a study laptop and tablet, a clinical interviewing handbook, and an instrument user guide. In addition to reading all study materials, interviewers were required to watch a set of asynchronous video trainings and slide decks. Interviewers subsequently completed knowledge checks which were reviewed by RTI staff.
In addition to these required activities, study leaders coordinated with RTI technology experts to hold pre-training “office hours” to help interviewers navigate equipment set-up and troubleshoot any difficulties with laptop and tablet configuration. Together, these activities ensured that interviewers understood study protocols and equipment use, enabling them to engage more deeply and effectively with the material presented during live trainings. Pre-training activities also helped interviewers identify gaps in their knowledge, allowing live training sessions to be tailored to their specific needs.
Supporting Clinical Interviewers through Live-Training Activities
Live-training activities were conducted via Zoom and included didactic presentations and activities followed by live discussions led by RTI project staff. One of the most valuable components of the live-training activities was the use of Zoom breakout rooms. Breakout rooms provided interviewers with the opportunity to engage in small group discussion, practice interviewing skills via paired mock exercises, and receive real time feedback from RTI staff. During breakout sessions, experts moved in and out of breakout rooms, allowing interviewers to ask clarifying questions and giving experts the opportunity to observe exercises and provide individualized feedback.
Using small breakout rooms to facilitate one-on-one and small group interactions strengthened relationships between interviewers and RTI staff and fostered a sense of community that is often missed in larger virtual trainings.
Assessing the Effectiveness of Virtual Training through Post-Training Activities
Upon completion of the live training, interviewers were required to complete and pass a multiple-choice assessment, followed by a three-phase interview certification process. For the duration of the project, interviewers were assigned to a group of 6-8 clinical interviewers, led by a clinical supervisor. Initially, teams met on a weekly basis for “quality circle meetings” to review interview cases, answer questions, and complete additional group exercises to hone interviewing skills. The quality circle meetings promoted group cohesion and community. During these meetings, comprehensive feedback and training were provided, ensuring that each member received personalized guidance and support. In addition, a portion of all completed interviews underwent a full review by supervisors as part of the quality control process and ongoing supervision process.
Virtual Clinical Interviewer Training Promotes a Diverse Workforce
The high-quality interviews that resulted from our rigorous training program show that virtual clinical interviewer training and ongoing supervision are effective ways of educating this specialized workforce, eliminating the need for expensive travel costs and localized hiring. This flexibility is inclusive of geographically diverse interviewer backgrounds and a wide range of prior training experiences, both of which contribute to the collection of high-quality national health data to inform future policies and treatments.
