When criterion related validity is used the scores on the test are compared to?
|
Discover 21 more articles on this topic Show
To measure the criterion validity of a test, researchers must calibrate it against a known standard or against itself. Comparing the test with an established measure is known as concurrent validity; testing it over a period of time is known as predictive validity. It is not necessary to use both of these methods, and one is regarded as sufficient if the experimental design is strong. One of the simplest ways to assess criterion related validity is to compare it to a known standard. A new intelligence test, for example, could be statistically analyzed against a standard IQ test; if there is a high correlation between the two data sets, then the criterion validity is high. This is a good example of concurrent validity, but this type of analysis can be much more subtle. An Example of Criterion Validity in ActionA poll company devises a test that they believe locates people on the political scale, based upon a set of questions that establishes whether people are left wing or right wing. With this test, they hope to predict how people are likely to vote. To assess the criterion validity of the test, they do a pilot study, selecting only members of left wing and right wing political parties. If the test has high concurrent validity, the members of the leftist party should receive scores that reflect their left leaning ideology. Likewise, members of the right wing party should receive scores indicating that they lie to the right. If this does not happen, then the test is flawed and needs a redesign. If it does work, then the researchers can assume that their test has a firm basis, and the criterion related validity is high. Most pollsters would not leave it there and in a few months, when the votes from the election were counted, they would ask the subjects how they actually voted. This predictive validity allows them to double check their test, with a high correlation again indicating that they have developed a solid test of political ideology.  Criterion Validity in Real Life - The Million Dollar QuestionThis political test is a fairly simple linear relationship, and the criterion validity is easy to judge. For complex constructs, with many inter-related elements, evaluating the criterion related validity can be a much more difficult process. Insurance companies have to measure a construct called 'overall health,' made up of lifestyle factors, socio-economic background, age, genetic predispositions and a whole range of other factors. Maintaining high criterion related validity is difficult, with all of these factors, but getting it wrong can bankrupt the business. Coca-Cola - The Cost of Neglecting Criterion ValidityFor market researchers, criterion validity is crucial, and can make or break a product. One famous example is when Coca-Cola decided to change the flavor of their trademark drink. Diligently, they researched whether people liked the new flavor, performing taste tests and giving out questionnaires. People loved the new flavor, so Coca-Cola rushed New Coke into production, where it was a titanic flop. The mistake that Coke made was that they forgot about criterion validity, and omitted one important question from the survey. People were not asked if they preferred the new flavor to the old, a failure to establish concurrent validity. The Old Coke, known to be popular, was the perfect benchmark, but it was never used. A simple blind taste test, asking people which flavor they preferred out of the two, would have saved Coca Cola millions of dollars. Ultimately, the predictive validity was also poor, because their good results did not correlate with the poor sales. By then, it was too late! Recommended textbook solutionsHDEV56th EditionSpencer A. Rathus 380 solutions Myers' Psychology for the AP Course3rd EditionC. Nathan DeWall, David G Myers 955 solutions Myers' Psychology for AP2nd EditionDavid G Myers 900 solutions Social Psychology10th EditionElliot Aronson, Robin M. Akert, Samuel R. Sommers, Timothy D. Wilson 525 solutions When criterionWhen criterion-related validity is used, the scores on the selection test are compared to: A) scores on the pre-test.
What is criterionCriterion validity (or criterion-related validity) evaluates how accurately a test measures the outcome it was designed to measure. An outcome can be a disease, behavior, or performance. Concurrent validity measures tests and criterion variables in the present, while predictive validity measures those in the future.
Which type of validity is considered a criterion7. Criterion-related validity. Criterion-related validity (also called instrumental validity) is a measure of the quality of your measurement methods. The accuracy of a measure is demonstrated by comparing it with a measure that is already known to be valid.
Which type of validity is determined by comparing scores on a new test to scores on known tests?Comparing the test with an established measure is known as concurrent validity; testing it over a period of time is known as predictive validity. It is not necessary to use both of these methods, and one is regarded as sufficient if the experimental design is strong.
|
