The COVID-19 crisis brought about the most sudden and dramatic shift in test delivery that we have ever witnessed. Many test owners that deliver high-stakes assessments, whether as part of critical certification or credentialing programs or in higher education, were forced with a binary choice of moving testing online or stop testing. Many organizations chose the former and moved with agility to adopt online proctoring in weeks, rather than the typical deliberations and roll out over months or years.
Online proctoring privacy concerns
The huge increase in the use of online proctoring has raised its profile dramatically and created a level of public debate not seen before. Commentators have drawn attention to specific cases where online exams have resulted in widespread malpractice, and data privacy advocates have questioned how much personal data is collected, how it used, and by whom.
Test takers themselves have expressed concern over issues such as the use of remote access to their devices used by some online proctoring systems to prevent use of prohibited apps and internet browsing during tests. There’s also the broader charge that online proctoring is invasive and creepy or that its use of AI is opaque and potentially unfair, including the use of eye tracking, gaze detection, room scan technology, audio recording, and various other data collection and identity verification practices.
Change inevitably brings uncertainty, and there are understandable anxieties here. So how can you, as the test owner, address these candidate concerns and uphold candidate’s privacy?
The critical need for communication and consent in online proctoring
With both live and record-and-review online proctoring, the aim is to replicate as closely as possible the experience and security achieved by having an onsite proctor present. This is for the benefit of both candidate and owner alike. Good communication with candidates well before the exam itself is key to reducing any privacy anxiety, as is easy-to-use technology that is minimally intrusive and easy to remove from a computer once the test is complete.
At the same time, there needs to be a balance between security and test taker experience so that any potential for dishonesty is minimized and every candidate gets the result they deserve. As the test owner, you will need to communicate with your candidates regarding the collection and use of the candidate’s personal information.
As stated by the Association Of Test Publishers (ATP), “It is equally important to remember that the concept of data minimization should be applied to the greatest extent possible; that is, personal information that is not absolutely required for online / remote proctoring should not be collected.”
At PSI, we never share candidates’ personal data. That’s why PSI delivers online proctoring separate to a test delivery system – it has always been our policy to never capture or store unnecessary personal data. As part of our agreement with you and individual candidates, we agree to only use the data collected during a proctored exam to ensure compliance with exam rules and test integrity. You decide how long we keep the encrypted data before it is automatically deleted.
Test integrity without compromising candidate privacy
Prior to the assessment beginning, the candidate’s identity will be checked and authenticated. At PSI, this process is conducted on a separate system where their ID is checked and verified by an online proctor or administrator before the candidate is allowed access to the test delivery system. The transition is seamless and secure, personal data is not shared, and privacy is maintained. We will only check the data that is necessary to confirm identity and address any privacy concerns from test takers.
This is where the industry has different approaches, dependent on the remote proctoring services on offer. For example, at PSI we always use a secure lock-down browser that will never require remote access to your computer. Some online proctoring solutions do require remote access so that a proctor can complete a security review, check what programs you have running on your computer, and if necessary, shut these programs down before the test begins. With this option, there exists the risk that an aberrant proctor will take sensitive information from a candidate’s computer during this security check. While the act may be rare, the fact that the risk exists creates an unnecessary unease during an exam.
The assessment will be recorded whether you use live or record-and-review proctoring. And this is as much for your protection as the security of the assessment. We understand this may feel intrusive to and we strive to minimize the impact on the test taker while still achieving the security of a traditional examination environment.
Our secure browser provides a fair testing environment where candidates are prevented from copying, pasting, taking screen grabs, using instant messaging or other applications, and accessing other websites. It’s downloadable in seconds and easy to delete from their system when a test is complete.
The benefits and limitations of AI in online proctoring services
When it comes to online proctoring, AI can be utilized throughout the process – either in partnership with a human, as we do at PSI, or on its own. During the check-in process for example, automated ID authentication increases accuracy to ensure a candidate is who they say they are. During an assessment, facial and voice recognition can also be used to identify another person in the room. Equally, object recognition will pick up anomalies in the test environment, such as a candidate referring to a mobile phone or other unauthorized materials. And AI integrated technology such as eye movement tracking will also detect movement patterns that might indicate malpractice.
The main benefit of AI enabled proctoring is that it can quickly help scale testing programs and help with maintaining integrity by quickly proctoring high volumes of tests. We believe determining whether an action constitutes cheating, requires human subjectivity.
For example, when AI detects that someone has entered the test-taker’s environment and starts talking with them during the test, we flag suspicious behavior, and use a human to assess whether the discussion was about the test (cheating), versus something less objectionable (a child asking a parent for a drink of water). Every candidate flagged should be checked by a trained professional to prevent innocent students from being punished.
Some AI systems are better than others, so in order to keep false reports of fraud in online learning low, make sure the technology behind AI has clear guidelines on what constitutes suspicious behavior. Perhaps more diligently, ensure that whatever program you choose uses AI in combination with a human proctor as part of your remote proctoring services.
How is online proctoring delivered?
There are a couple of ways online proctoring can be facilitated. One way involves a proctor watching a candidate in real time through a video connection (live online proctoring). The other way is when a test taker is recorded during the test administration and the video is later reviewed (record-and-review proctoring). It’s also possible for organizations to use a combination of both methods. Both methods were being used prior to the COVID-19 outbreak, but their use has quickly expanded to include many high-stakes tests. Just like an in-person proctor, a remote proctor (whether human or automated) supervises the integrity of the testing process and flags anomalies that could indicate cheating.
The Role and Status of Professional Proctors
Ensure you’re hiring and training proctors as a professional role. Training must be provided to all proctors to ensure the same level of scrutiny is applied to each test.
At PSI, proctors are required to train on the following topics:
- Security, privacy, and regulations pertaining to these
- Confidentiality and conflict of interest, with their agreement
- Overall duties and responsibilities
- System functionality
- Troubleshooting
- Client business rules and violations
Additionally, all remote proctors have required hours for job shadowing and nesting. Shadowing is where the new proctor watches an experienced proctor. Nesting is where the new proctor does the work under the guidance of a supervisor or experienced proctor and lasts for a minimum of five days.
All proctors obtain an initial certification that the original requirements have been met through an assessment. The certification must be maintained through recertification.
The security of the exam data, the candidate experience, and the quality of proctor are all vital to the confidence of the remote proctor modality. By providing a clear understanding of the expectations of the remote proctor, setting high standards for quality, and measuring these attributes regularly, you can find and correct causes of poor quality and continue to make improvements. These efforts are one of many quality processes in place to oversee the remote proctor efforts.
The online proctoring software systems and security in place are to preserve the integrity of the assessment. It is never to penalize all candidates, but rather to identify those few people who do try to break the rules. That’s why we utilize systems and technology that are as unobtrusive as possible.
At PSI, we have a unique and secure approach to online proctoring. We have successfully delivered over 130+ million assessments annually over the past 70 years. PSI-proctored assessments have run the gamut from basic history quizzes to exams that credential high-stakes professions, such as medical professionals. Regardless of how high the stakes are of the online exam that is being delivered, PSI proctoring technology ensures that the test taker experiences the convenience of taking an exam remotely without sacrificing any privacy.
Find out more about online proctoring with our Guide to online proctoring with PSI.
PSI powers world leading online proctoring tests. Delivered with trusted science and the very best test taker experience.
Speak to PSI about becoming a test partner or request a demo today.