Why ReviewNet : Our Partners : Contact us : About us 
ReviewNet Test Development Process
ReviewNet technical assessments are challenging, real-world, and rich in content. They are designed to evaluate practical work experience and hands on experience. ReviewNet assessments are driven by our KnowledgeBase of technology content covering the leading and evolving IT technologies used by industry today. ReviewNet's KnowledgeBase includes over 14,000 questions, with more being continually developed and refined by ReviewNet's Subject Matter Experts network.

Learn about the key elements of ReviewNet's proprietary test development process:

Tests measure skills related to the job
Subtopics evaluated within the assessment
Categorized Question Pool
Variety of Question Formats
On-line answers and explanations for questions
Alternate test engine modes matched to test format, delivery, and purpose
Subject Matter Expert Networks
Performance monitoring

Tests measure skills related to the job
ReviewNet IT skills assessments are job-based, and designed to provide an accurate evaluation of the technical skills required to do real-world jobs. Some tests are designed to measure all the features of a particular software package, such as some vendor-provided certification tests. Job-based tests focus on the specific combination of skills needed to accomplish a job and are particularly suited for job-related training and hiring uses.

Hiring decisions are aided by using tests that are job-based because test performance reflects skills actually needed by the candidate.

- Top -

Subtopics evaluated within the assessment
The jobs performed by IT professionals today involve many tasks and skills. There is no such thing as a "standard" network technician or programmer. In order to make informed IT personnel decisions, you need to measure the knowledge and skills of IT professionals a detailed level.

ReviewNet Standard assessments measure skills and knowledge in the various tasks and topics that make up the different aspects of a technology job. ReviewNet standard assessments, typically have between 6 and 12 Topics. Each Topic is further broken down into a number of subtopics. Each areas of focus allows individual strengths and weaknesses to be highlighted. Each subtopic has a pool of questions related to it, and the questions are of varying degrees of difficulty.

Performance on each Topic in the assessment is evaluated based on a number of factors, including the difficulty of the questions, the candidate performance, time taken in absolute terms and compared to performance of other IT professionals, and the number of questions asked. Additionally, the weighting and importance of each Topic is determined for each assessment by controlling the difficulty and number of questions related to each topic. Topics that are of higher importance have more questions devoted to them, to provide more statistical validity to the Topic evaluation.

- Top -

Categorized Question Pool
ReviewNet maintains a technical KnowledgeBase of over 14,000 questions that have been developed by Subject Matter Experts selected for their proficiency and experience. These questions are categorized according to subject area and difficulty level (over 300 different subject areas exist in the ReviewNet KnowledgeBase). There are multiple questions available for each category and difficulty level.

ReviewNet IT skills assessments are constructed by designating the category and difficulty level of questions to be used for each Topic in the test. This allows ReviewNet to use alternate questions interchangeably ("swapping") while still measuring the same knowledge domains. The use of a variable question set greatly improves the reliability of the assessment, while the test structure keeps the Topic mix and difficulty levels consistent. For customers desiring an identical test for every candidate, "swapping" can also be turned off by the customer, allowing a fixed set of default questions to be used for each test administered.

ReviewNet questions include an explanation of the various answer choices, which is made available to the recruiter or person reviewing the results on-line. The explanations are used by recruiters and hiring managers to further probe a candidate's answer during a phone screen or interview, without requiring the individual to have first-hand knowledge of the subject.

The organization and accessibility of the large question pool allows ReviewNet assessments to be both accurate and uncompromised.

- Top -

Variety of Question Formats
ReviewNet supports a wide variety of question formats including:

  • Multiple-choice questions: Multiple choice questions can have up to 8 alternate choices and allow for partial credit scoring.

  • Multiple Correct answer questions: Questions can have multiple correct answers, with different credit awards. Some Multiple Correct answer questions may require the candidate to select all correct parts of the question to receive credit.

  • Case-Study questions: Questions that have multiple pages or images of background information, which can be, displayed as linked windows to a specific question. Case-Study questions are great for evaluating senior level skills of software designers and consultants.

  • Open-ended and fill-in-the-blank questions: Open-ended questions provide input for technical interviewers to review prior to the interview. For questions requiring an exact answer, fill-in-the-blank questions can be used with up to eight possible answer choices. (This question type is not typically used in ReviewNet Standard Assessments.)

  • All questions may use embedded graphics or employ linked exhibits that can amplify question depth and coverage.

  • All questions are constructed according to detailed guidelines by highly qualified authors, and are reviewed by a Subject Matter Expert panel to insure job-relevance, accuracy, and correct leveling and categorization.

- Top -

On-line answers and explanations for questions
All ReviewNet questions have documented answers and explanations for each answer choice, available on-line to the recruiter. When used with the integrated ReviewNet on-line Interviewing feature, the answers and explanations help recruiters get a complete understanding of a candidate's technical abilities. Some recruiters even use the explanations to conduct self-training in new technology areas in which they are recruiting, to improve baseline understanding and conversational familiarity.

- Top -

Alternate test engine modes matched to test format, delivery, and purpose
ReviewNet provides multiple test engine modes to match the skill test design: (1) "Fixed Mode" which delivers a pre-configured set of questions, (2) "Weighted Topic mode" which delivers questions from a pool of relevant questions in the proportion defined by the mix and difficulty levels established for the assessment.

Fixed mode tests are simple to construct, and are generally used for low volume assessments, or for custom tests developed directly by the customer. The order of the questions can be pre-set or randomized. Fixed mode tests are also used for surveys that can be incorporated into a ReviewNet session either before or after the selected assessment questions.

Weighted Topic mode delivers an assessment that measures a combination of Topics in a pre-set proportion and difficulty level, but with different questions chosen from the Categorized Question Pool. Each candidate will be administered a test session that measures essentially the same knowledge domains, but with different questions to preserve test integrity. Weighted Topic mode assessments provide an easily understandable and verifiable method of comparing one candidate to another. Topic Weighted assessments perform well for assessments with topics of unequal importance and difficulty levels.

- Top -

Subject Matter Experts Network
ReviewNet maintains a network of hundreds of Subject Matter Experts (SMEs) who have deep hands-on experience in their technical field of specialty. These SMEs make up the teams that use the ReviewNet online test publishing process to develop rigorous, content-validated assessments. They are chosen for their practical experience and ability to author real-world questions and assessments. They also serve as the validation and peer review team to ensure appropriate question leveling, consistency, accuracy, and job-relatedness of the assessments.
Click here to learn more about our Subject Matter Experts.

- Top -

Performance Monitoring
Skills Assessments undergo continual review to ensure that they are accurate and performing to expectations. New assessments undergo a "beta" period during which percentiles are developed and question performance is extensively monitored. After the "beta" period, performance is continually monitored. Discrepancies are referred to the author and validation team for review and follow-up if necessary. This monitoring process continues on an ongoing basis throughout the life of a ReviewNet IT skills assessment.

Home | Products & Services | Meet the Experts | How to Buy | Client Support | Take a Demo | Find Your Test 
Why ReviewNet | Our Partners | Contact Us | About Us
IT Skills Assessments | Office, Clerical & Non-IT | Behavioral & Aptitude | Interviewing
  Terms of Use and Disclaimer · Sitemap © 2008 ReviewNet Corporation, All rights reserved