Assessments have important roles to play in shaping the future of many industries and sectors. They maintain standards and build trust, support transition and change, and are often instrumental in public protection. So, to gain deeper insights into the evolving landscape of testing, PSI recently conducted a comprehensive survey aimed at gaining the perspective of testing industry professionals.
The survey results shed light on significant developments and trends shaping the Future of Testing.i In this blog post, the first in a two-part series exploring our research findings, we share the results related to test delivery – including the hot topics of Artificial Intelligence (AI) and Diversity, Equity & Inclusion (DE&I) in testing.
Test delivery insights
While test center delivery remains popular, our findings indicate a significant shift towards online proctoring and multi-modal testing (i.e., both in test centers and online). An equal proportion of respondents use test centers or online proctoring (34%), with just under a third (32%) now offering multi-modal. It seems that giving test takers the choice and flexibility of in-person or remote testing is catching up with more traditional test delivery methods, a change reflected in PSI’s own testing data.
The move to multi-modal is supported by advancements in technology, with remote testing gaining traction as online proctoring security increases. Audio and video (AV) monitoring emerged as the most utilized technology for online proctoring, with nearly half (49%) of respondents using it. The use of AV monitoring is particularly popular with low-volume testing organizations, perhaps due to the time and resources it saves while continuing to maintain test security.
Browser lockdown software (43%) follows close behind AV monitoring and is particularly popular with high-volume testing organizations. The use of a lockdown browser certainly isn’t new, but the technology has come a long way since its inception. The PSI lockdown browser feature has been in use for many years, with numerous improvements and enhancements since then. For example, our data forensics and test security teams collaborate on an ongoing basis to modify the list of banned applications in the browser, as technology evolves and as people try to find new ways to circumvent the lockdown browser.
Future testing technologies
Our survey delved further into the technologies driving online proctoring in the future, asking which technologies respondents believe will help advance online proctoring. The ability to join active sessions with real time client monitoring emerged as the top technology favored by respondents (46%), signaling a demand for engagement and oversight during online proctoring.
When it comes to the potential of other technologies, respondents also expressed interest in video analytics (39%), biometric authentication (36%), and real-time data forensics (32%) to advance online proctoring. Interest in wearable technology and augmented reality was low across all sectors and sizes of organization, showing that while the testing industry is keen to adopt appropriate technologies, it’s not about jumping on the latest trend before its potential benefits and risks have been fully evaluated.
AI insights
A similar theme emerges when it comes to AI in testing. Our research showed clearly that many people in the testing industry believe AI has the potential to enhance the authenticity of test environments (46% agree or strongly agree). Additionally, many also believe AI will positively affect the validity and reliability of tests (40% agree or strongly agree). However, when asked about whether AI will reduce test anxiety, 47% disagreed or strongly disagreed.
Again, while testing organizations are keen to explore the potential of AI, they are understandably cautious about the impact on the test taker experience. This supports the PSI approach that the implementation and use of AI should be backed by human oversight. The negative reaction during the pandemic to fully automated online proctoring that relies solely on AI emphasizes this even further.
There are differing opinions about AI across sectors. High-volume testing organizations, for example, are more likely to explore innovations such as AI in their test delivery processes. And certain sectors are keener to embrace AI than others. For example IT is more supportive than industries such as healthcare and the government / public sector. This shows that high-risk and low volume testing organizations are understandably adopting a more cautious approach to AI in their testing strategies and waiting to see how the technology develops.
DE&I insights
Promoting inclusivity and accessibility in testing environments is essential and we know it is a priority in the testing industry. Our survey highlighted measures taken by organizations to ensure equal access to testing services, including language translation services and accessibility technology such as screen readers.
The top way testing organizations are ensuring their testing environments are inclusive and welcoming is to work with PSI or another testing vendor. Organizations are also continuing to monitor and review processes for DE&I. There is an acknowledgment from respondents that although they don’t have all the answers, there is always room for improvement, and we need to work together to find solutions in this important area.
Read our guide: Diversity, equity & inclusion across the assessment lifecycle.
The Future of Testing
Our commitment to understanding and navigating the evolving testing landscape, in partnership with our clients, is unwavering. As pioneers in testing, we recognize the transformative impact of emerging trends and technologies on test integrity and validity. At the same time, we work closely with clients to understand the testing technologies that are appropriate for their programs–fostering innovation while always ensuring tests remain valid, reliable, and equitable for all.
i Our survey attracted over 350 responses from professionals within the assessment industry. Respondents represented a diverse range of organizations, including professional bodies, government agencies, and educational institutions. They work in industries such as construction, healthcare, IT, and education, with testing volumes varying from under 100 to over 50,000.
