March 2007
Global Competitiveness, Compliance and the Growing Problem of Cheating. Secure Assessment is the Key.
By Paul Walker
For leaders in business, these three areas are becoming increasingly relevant in the quest of attracting, retaining and developing organisational talent.
To compete with and to beat the best in a rapidly expanding global business landscape, businesses need to know that their people and processes match those employed by 'best-in-class' rivals. If we do not comply with the increasingly regulated demands of global standards, we may find we are excluded from the contest or worse, not even allowed to compete in the first place. Once the standards are met, how do we maintain those standards over time and over extended communication channels?
Increasing global competitiveness has an impact at the individual level also. The scale of global business has greatly multiplied reward packages in some sectors, which has in turn raised the stakes for individuals vying for these roles. For some, 'win at all costs' is their creed, and the added financial incentive has meant that certain people will go to great lengths to beat the system to enhance their credentials. In some countries, the competition for scarce university places is so intense, students will invest substantial sums in technology aimed to help them cheat in exams. In July 2006, 20 students in Vietnam paid up to $3000 US to don elaborately wired wigs and shirts that enabled them to communicate outside the examination centres and call in test questions and receive answers. Considering that the average per capita GDP for Vietnam for 2005 was around $2500 US, this case emphasizes the extraordinary lengths people will go to beat the system.
Experts in the field of testing and examination administration admit that the advances in technology that can assist people determined to cheat has outstripped the advances in our ability to detect them. The problem with the existing testing models, is that the technology has not advanced much since the 1980's. It is expensive because of it's reliance on being centred in high value real estate locations, administratively laborious. It does not offer high security since test questions can be compromised due to the fact that they are stored on site and accessible to many individuals. Collusion can occur between test takers and question items are openly shared on the internet at 'brain dump' sites. It does not offer choice to the clients - it is a 'take it or leave it' model.
There are also doubts that established test centre businesses are keeping up with the latest technologies being used to subvert examination security.
Cheating is on the rise everywhere. Whether due to changing attitudes about what is right or wrong, or just growing complacency among those responsible for administering testing programs, examples of breaches of test security can easily be found. Caveon, the KRYTERION partner that provides test security services routinely uncovers 'Brain Dump' sites on the internet that provide exam questions to a test taking community. Sometimes, it is students just helping each other by sharing tips, but a more sinister version is where training centres give out actual test questions to enhance their result standings and attract more paying students.
KRYTERION offers solutions that can keep your corporate test audience up to speed with the latest business processes and compliant with required standards. For test program owners and examination stakeholders, KRYTERION promises to restore the legitimacy of your certification or qualification by defeating the security problems plaguing the global testing market. Through highly secure internet delivery, our vision is for tests to be delivered online anywhere in the world 24 hours a day/seven days a week for a fraction of the cost associated with established computer based test centres or traditional paper and pencil methods.
The advanced authentication and test monitoring technologies that the KRYTERION system embodies means that tests can be taken anywhere, without the need to travel to dedicated test centres or even have direct human supervision.
Some say it's impossible. We call it progress.
The New KRYTERION Solution
KRYTERION is an online secured test delivery and program management company offering a higher level of test security than has been available until now.
I think that testing and certification program managers and administrators could be the most creative individuals in our industry. I say could be, because in most cases this group usually has the least amount of potential creative time. But why be creative anyway? Being creative gives you an advantage. It allows you to switch from dealing with what's happening now (putting out fires), to finding ways of doing things differently (fire prevention). Move the 'C' in Reactive to the front and you have a new mindset. So which are you - Creative or Reactive?
"Our philosophy is inherently customer oriented," "We can assist virtually any organization to enhance the security of their current or future testing and certification programs, whether new and small or large and worldwide." William Dorman, Executive Chairman at KRYTERION.
Whether through its own resources or via its strategic partnerships KRYTERION offers a variety of services including:
- Test Delivery: Webassessor(TM):
Webassessor is a complete testing tool for all program management, Test Takers and other end users. Through a powerful, highly secure and easy-to-use interface, Webassessor allows program managers to take control of their testing and certification programs. For example, Webassessor users can enhance the security of their online tests with the exclusive use of Caveon Real Time Data Forensics(TM) technology. In addition, program managers can manage and make real-time updates to test items and test forms without incurring additional fees, deliver tests in multiple formats whether proctored or not, access their test and program data anywhere, anytime and create robust reports for detailed analysis.
Download pdf... - Test Development:
Through strategic partnerships, KRYTERION provides its clients with the tools and solutions they need to manage a wide spectrum of test development activities. These partnerships even assist KRYTERION clients with the challenges of marketing and promoting their testing programs.
Download pdf... - Testing Security:
Through our strategic partnerships with industry leading organisations, KRYTERION now offers enhanced security services including: Caveon Web Patrol(TM), Caveon Data Forensics(TM) and Caveon Security Audits(TM).
Download pdf...
Some Say it's Impossible. We Call it Progress.
Making Progress with Item Writing
By Leslie Thomas, Ph.D. and Cyndy Fitzgerald, Ph.D.
Innovative Item Writing Techniques That Save Time and Money
How much time does it take for you to create a new item pool? How much money are you spending on flying your item writers in for a workshop? The answer to both of these questions is too much! For many years, a three or four day, face-to-face meeting was the only way to conduct an item writing workshop. I remember, in a previous life, the standing joke was that we would lock the item writers in a room, feed them, and not let them out until their items were written. Unfortunately, that wasn't too far from the truth. Worse yet, our "item banking" system consisted of using word processing software like Microsoft Word.
For many years, a three or four day, face-to-face meeting was the only way to conduct an item writing workshop. I remember, in a previous life, the standing joke was that we would lock the item writers in a room, feed them, and not let them out until their items were written. Unfortunately, that wasn't too far from the truth. Worse yet, our "item banking" system consisted of using word processing software like Microsoft Word. Eventually people started using item banking systems that incorporated databases. Although the database system was a step above managing multiple word processing documents, it left much to be desired, as these database systems lacked formatting tools and other useful features available with word processors.
Well, luckily for everyone involved, those days are part of item development history. The advent of online item writing technologies has dramatically changed the way we write and maintain items. Now we can do all of the work remotely from the comfort of our homes or offices. In fact, many of our clients opt for virtual item writing workshops because it's much easier to recruit subject matter experts (SMEs) and they are significantly less expensive since travel is not required. In addition, virtual workshops are broken down into multiple, two-four hour blocks of time and are less taxing on the SMEs.
Another innovative approach enabled by online technologies is pairing a professional item writer with a SME. The professional item writer works one-on-one with the SME to transform the SME's expertise into a well-written item. Using online item writing technologies, the SMEs can view the items in real time as they are being created and revised to ensure that the items accurately measure their expertise. This approach greatly simplifies the process for the SMEs and optimizes the use of their time because they don't need to know how to write items.
Using tools like Webassessor, (KRYTERION's online, secured test delivery system), anyone with access to the Internet and the proper administrative rights can write, review, edit, move, copy, spell check, sort and search for items based on keywords, author, and numerous other fields. Regardless of your initial item writing approach, using online item writing and banking technologies makes your life much easier and greatly expedites the item development process.
Now that's progress
Newsletter Archive
Technology Spotlight
Q. As a Program Manager, I need to run frequent reports on my Test Taker activity. How can I streamline my reports to meet the needs of different audiences?
A. Webassessor's flexible reporting allows Program Managers to create specific, customised reports based on one of the eight pre-defined Reports template. You can save your customised reports to your reports library for quick access in the future.
The first step in creating a customised Report is selecting the applicable pre-defined Report Template. Access the Reports Templates from the Reporting, Self-Service tab. Name your Report and create a Report Title. Next, select how you'd like to group your report fields. You can then customise the report by selecting the Report Fields you'd like to include on the customised Report, change the order of the Report Fields, and change the appearance of Report Fields including labels and layout.
Once you have configured all Report Fields, use the Reports Criteria to define the specific data you'd like included on the Report. This is where as a Program Manager you can really get creative with your reports. Would you like to know all Test Takers who registered for a specific test during the last week of October, purchased using a MasterCard, have completed the test, live in London and have a last name that starts with the letter A? Simply select the Reports Criteria you'd like to use and the specific data you'd like to report on and you've got a real-time report with the exact information you need.
Want to Learn More?
Webassessor clients can learn more about flexible reporting by contacting the Technical Account Management Team or contact one of our Business Development Managers for a personal demo at euonline@kryteriononline.com
That's taking control. That's Webassessor.
How Can We Help You Achieve Your Assessment Goals?
Please send your questions or requests to:
euonline@kryteriononline.com. A business development manager will contact you to answer your questions and provide additional information.
Visit our website at www.kryteriononline.com
Comments?
Please send us your comments or editorial ideas to Paul Walker at: euonline@kryteriononline.com
Upcoming Events
Meet KRYTERION at the e-Assesment Question 2007 Conference and Exhibition 8th and 9th March 2007 Shaw Theater and Novotel Euston, London
Send to a Friend
Click here to send to a friend
For Additional InformationPaul Walker |
