June 2007

The Value of Online Testing

By David Foster, Ph.D.

The longer I work in the testing industry, the more excited I get about its possibilities. It all started for me in 1982, at the beginning of my testing career. I was impressed by the potential and promise of computer technology to a field where it seemed that the only recent change had been the introduction of the scanner for scanning and scoring answer sheets.

From those early days onward, it seems I have been constantly involved in numerous extensions of technology to testing-ranging from improving measurement through new item types and unique test designs, to faster methods for developing items and tests and detecting traditional and current security problems.

Most of the time, the innovations had successful outcomes and remained as features of the exams, eventually even becoming an acceptable and standard way exams are developed or administered. Over the years, because of those experiences, my faith in technology as a contributor to the testing industry has only been strengthened.

This leads me to Internet-based or online testing. I have often heard that online testing (testing delivered over the Internet) should be reserved for low-stakes testing such as practice tests, while high-stakes exams, require a traditional testing centre, whether that model is paper-based or computer-based.

The main concerns described in conjunction with Internet-based testing are (1) the lack of adequate security and (2) the performance or psychometric capability of the exams. But what if you could address these two issues and use the amazing power and convenience of the Internet for even the highest of high-stakes tests? What if those tests could be administered professionally and had a level of security that exceeds even today's testing centre models? Is it even possible?

The advantages of such innovation would lead to a true revolution in testing. Imagine high-quality, large-volume exams delivered to anywhere in the world where people work, learn and perhaps even where they live. With top-tier security measures in place, (such as those from Caveon Test Security), the results would be verifiable as representing those of the proper test taker. Cheating and other forms of test fraud would become very difficult.

So, what are the specific advantages of such an online testing model?

• Fewer security problems than in today's testing centre models, leading to more confidence in the results
• More and more convenient places to take high-stakes tests, leading to less time off work or school and increased examinee satisfaction
• Faster distribution of tests and test revisions, leading to more immediate use of tests in a rapidly changing world and the ability to change test content as needed
• Lower costs to publish and administer tests, leading to more funds available for test improvement, security, or examinee benefits
• More control of a testing program and the testing process, leading to greater satisfaction and less cost

These are the advantages of the Internet and new security measures being intelligently combined and effectively used for a strategic purpose. Just think about your experience with online banking for a moment. For a time, doubt and fear overshadowed the advantages. Now, online banking is a necessity as much as it is a convenience.

For the testing industry, it is not a big stretch to see how those advantages could be realised with the proper innovations and the will to put them in practice. So is online secured testing possible? Yes, it is and it's KRYTERION's goal to make it happen. We're all about progress.

Testing Connections

Here are just some of the things you should know about in the testing industry...

www.caveon.com/resources_news.htm

www.testpublishers.org/europe.htm

Newsletter Archive

• March 2007 Newsletter
• August 2007 Newsletter
• October 2007 Newsletter

Psychometric Corner

Q. How can I improve the security of my testing program?

A. A simple way to increase the security of your testing program is to require all test takers to enter a test use agreement prior to testing. This puts the test candidate on notice and clearly lays out the ground rules and consequences. This agreement may include topics such as:

• Identification of what constitutes inappropriate testing behaviour
• Acknowledgment of possible consequences of allegations of test fraud or theft
• Authorisation to collect biometric information for the purposes of personal identification
• Agreement to protect and keep test results confidential but a test use agreement alone is not enough. Yes, It is important that the examinees enter into the agreement, but you need to have the processes and technology in place to enforce what is included in the agreement. Technology, process and controls are crucial ingredients in your security mix. Should you be looking at your entire security plan - from start to finish?

How Can We Help You Achieve Your Assessment Goals?

Please send your questions or requests to: euonline@kryteriononline.com. A business development manager will contact you to answer your questions and provide additional information.

Visit our website at www.kryteriononline.com

Comments?

Please send us your comments or editorial ideas to Paul Walker at: euonline@kryteriononline.com

Send to a Friend

Click here to send to a friend