What does concurrent validity indicate quizlet?
|
Show Home Subjects Expert solutions Create Log in Sign up Upgrade to remove ads Only SGD 41.99/year
Terms in this set (144)An index, usually expressed as a proportion, of the extent to which a particular trait, characteristic, behavior, or attribute exists in a population. Base rate A factor inherent within a test that systemically prevents accurate, impartial measurements. Bias A type of rating error wherein the rater exhibits a general reluctance to issue ratings at either the positive or negative extreme and so all or most ratings cluster in the middle of the rating continuum. Central Tendency Error A form of criterion-related validity that is an index of the degree to which a test score is related to some criterion measure obtained at the same time. Concurrent Validity An informed, scientific idea developed or generated to describe or explain behavior. Construct A judgement of the appropriateness of inferences drawn from test scores regarding individual standings on a variable called a construct. Construct Validity Describes a judgment of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample. Content Validity When the scores on a test undergoing construct validation tend to correlate highly in the predicted direction with scores on older, more established, and already validated tests designed to measure the same (or a similar) construct. Convergent Validity The standard against which a test score is evaluated. Criterion A judgement regarding how adequately a score or index on a test or other tool of measurement can be used to infer an individual's most probable standing on some measure of interest Criterion-Related Validity When the scores on a test undergoing construct validation tend not to correlate with variables that are assumed not to be related to the construct the test is measuring. Discriminant Evidence A judgement regarding how well a test measures what it is supposed to measure that is based solely on appearances such as the content of the test's items. Face Validity A class of mathematical procedures, frequently employed as data reduction methods, designed to identify variables on which people may differ. Factor Analysis The extent to which a test is used in an impartial, just, and equitable way. Fairness A specific type of miss characterized by a tool of assessment indicating that the test-taker does not process or exhibit a particular trait, ability, behavior, or attribute, when, in fact, the test-taker does. False Negative An error in measurement characterized by a tool of assessment indicating that the test-taker possesses or exhibits a particular trait, ability, behavior, or attribute when, in fact, the test-taker does not. False Positive AKA leniency error, a less than accurate rating or evaluation by a rater due to the rater's general tendency to be lenient or insufficiently critical. Generosity Error A type of rating error wherein the rater views the object of rating with extreme favor and tends to bestow ratings inflated in a positive direction. Halo Effect The proportion of people who are accurately identified as possessing or not possessing a particular trait, behavior, or attribute based on test scores. Hit rate The degree to which a test measures a single trait. Homogeneity An index of the explanatory power of additional predictors over and above the predictors already in use. Incremental Validity A logical result or deduction in the reasoning process. Inference See "Generosity Error";a less than accurate rating or evaluation by a rater due to the rater's general tendency to be lenient or insufficiently critical. Leniency Error The proportion of people a test or measurement fails to identify accurately as possessing or not possessing a particular trait, behavior, or attribute based on test scores. Miss Rate A form of criterion-related validity that is an index of the degree to which a test score predicts some criterion measure. Predictive Validity The ordinal ordering of persons or variables into relative positions of degree of value. Rankings A judgement that results from the intentional or unintentional misuse of a rating scale. Rating Error A system of ordered verbal or numerical descriptors on which judgements about presence/absence or magnitude of a particular variable are indicated. Rating Scale A numerical or verbal judgement that places a person or attribute along a continuum identified by a scale of numerical or word descriptors called a rating scale. Rating Less than accurate rating or error in evaluation due to the rater's tendency to be over critical Severity Error The process of gathering and evaluating validity evidence. Validation Research that entails gathering evidence relevant to how well a test measures what it is supposed to measure for the purpose of evaluating the validity of a test or other measurement. Validation Studies Referring to a judgement regarding how well a test or other measurement tool measures what it is supposed to measure. Validity A correlation coefficient that provides a measure of the relationship between test scores and scores on a criterion measure. Validity Coefficient 1. Ecological validity refers to a judgement regarding how well a test measures what it purports to measure at the time and place that the variable being measured is actually emitted. 2. A study of the ecological validity of a test is likely to be conducted in an environment which is similar to that in which the targeted behavior will typically occur. 3. On Twitter, the tweets of die-hard fans of Justin Bieber after a Bieber performance can be expected to reflect a ________ error. both leniency and generosity 4. Gonsalvez and Crowe (2014) concluded that psychotherapy supervisors' judgments of supervisees' competence is typically compromised by leniency errors. 5. To further improve raters' judgments of competency, Gonsalvez and Crowe (2014) recommended that specific competencies be evaluated. 6. Prior to the development of the CUWQ, research on worry had shown
that the act of worrying can lead to both positive outcomes and negative outcomes. 7. A review of existing measures of individual differences in worry suggested to the authors of the CUWQ that none of the measures were made to distinguish people's tendency to worry constructively versus unconstructively. 8. The reason the CUWQ was developed was knowing how and why someone is worrying has diagnostic and therapeutic value. 9. The first step in developing the CUWQ was the creation of an item pool 10. To ensure the CUWQ had acceptable content validity, the items would need to adequately sample the variety of characteristics of worry 11. The initial version of the CUWQ contained __ items, and each of these items was checked to ensure that they were ____ and concise. 40; unique 12. In the development of the CUWQ, after a review of the preliminary items, a total of ___ items remained in the final form of the test. 18 13. In the development of the CUWQ, the test authors hypothesized that the tendency to worry _________ would be positively related to trait-anxiety. unconstructively 14. In the development of the CUWQ, the test authors hypothesized that the tendency to worry _________ would be negatively related to one's tendency to be punctual. unconstructively 15. In the
development of the CUWQ, the subjects in one of the preliminary studies were 998 Australian residents of wildfire-prone areas. 16. In the development
of the CUWQ, which research tool was used to assist the test developers in selecting the final form of the test? factor analysis 17. In the development of the CUWQ, the variable "amount of worry" was quantified using both the Worry Domains Questionnaire and the Penn State Worry Questionnaire. 18. In their call for future research on the validity of the CUWQ, the developers of this test suggested that studies be conducted using a population of pathological worriers 19. Each of the three approaches to validity assessment in the trinitarian model should BEST be thought of as one type of evidence that, with others, contributes to a judgment concerning the validity of a test. 20. The validation of a test is a process ... 21. Comedian Rodney Dangerfield was cited in the text to illustrate a point about how which of the following is viewed? face validity 22. "It's a measure of validity that arrived at by a comprehensive analysis of how scores on the test relate to other test scores." This statement is a reference to: construct validity 23. Messick is to unitarian as __________ is to trinitarian. Landy 24. In Chapter 6 of your text, Adam Shoemaker, the featured professional in Meet an Assessment Professional, described the use of a test with little criterion validity. Dr. Shoemaker recalled that this test was used for the purpose of providing a "job preview" of sorts to assessees. 25. Criterion-related validity is to predictive validity as criterion-related validity is to concurrent validity. 26. Test blueprinting is applied in the design of All of these 27. In order to remain consistent with a test's blueprint, a test administered on a regular basis is likely to require item pool management 28. An expectancy chart is a graphic representation of an expectancy table. 29. "The effect of instituting
this remedy for adverse impact is to make equivalent all scores that fall within a particular range." Here, the "remedy for adverse impact" is more technically referred to as banding. 30. "How can group differences on cognitive ability tests be reduced while retaining existing high levels of reliability and
criterion-related validity?" According to Gottfredson, the answer to this question will not come from measurement-related research. 31. A test is
considered valid when the test measures what it purports to measure 32. Which is NOT a method of evaluating the validity of a test? evaluating the percentage of passing and failing grades on the test 33. Predictive and concurrent validity can be subsumed under criterion-related validity 34. Relating scores obtained on a test to other test scores or data from other assessment procedures is typically done in an effort to establish the __________ validity of a test. criterion-related 35.
Face validity refers to the appearance of relevancy of the test items. 36. Face validity All of these 37. Which assessment technique is the BEST example of a face valid method? administering a word processing test to a person applying to be a word processor 38. In an undergraduate measurement course, an instructor announces that the first examination will cover the topics of reliability and validity. One
student in the class, Jamarr, publicly predicts that only questions on reliability will be posed. As it turns out, true to Jamarr's prediction, all of the test questions are only on the topic of reliability. Given this background, which of the following is the most reasonable conclusion that Jamarr's fellow students could draw? The first examination lacked content validity. 39. It has to do with the degree to which an additional predictor explains something about the criterion measure that is not explained by predictors already in use. It is incremental validity 40. Before constructing a comprehensive final examination that covers everything you have studied since Day 1 of your course, your instructor reviews the objectives of the course, the textbook, and all lecture notes. Your instructor is clearly making a diligent effort to maximize the __________ validity of the final examination. content 41. If a test developer has only a "fuzzy" vision of the construct being measured, then All of these 42.
A team of consumer psychologists is interested in conducting research to test the palatability of Papa John's Pizza (PJP). A PJP Palatability Test is developed on the basis of the opinions of a sample of death row prison inmates. These same inmates are then used to validate a paper-and-pencil "PJP Palatability Survey." What error has been committed by the researchers? The test validation was invalid due to criterion contamination 43. A standard against which a test or test score is evaluated is known as a criterion. 44. Which of the following is BEST be viewed as varieties of criterion-related validity? concurrent validity and predictive validity 45. The form of criterion-related validity that reflects the degree to which a test score is correlated with a criterion measure obtained at the same time that the test score was obtained is known as concurrent validity. 46. The form of criterion-related validity that
reflects the degree to which a test score correlates with a criterion measure that was obtained some time subsequent to the test score is known as predictive validity. 47. A key difference between concurrent and predictive validity has to do with the time frame during which data on the criterion measure is collected. 48. Which is an example of a criterion? All of these 49. Criterion contamination occurs when the criterion measure is influenced by the predictor measure 50. Which BEST represents an unobtrusive measure of marital adjustment? the number of years a couple has been married 51. According to the text, face validity may ultimately be more of an issue regarding __________ than ________. public relations; psychometric soundness 52. An investigation of a test's construct validity may yield evidence that All of these 53. What type of validity evidence BEST sheds light on how a shorter and less expensive test compares with a longer and more expensive one? concurrent criterion-related validity 54. What type of
validity evidence BEST sheds light on whether a college admissions test is valid for selecting students who will complete the program within 4 years? predictive criterion-related validity 55. Blueprinting is BEST associated with content validity 56. The magnitude of a validity coefficient may be affected by All of these 57. Which magnitude of validity coefficient is typically
acceptable to conclude that a test is valid? None of these 58. A coefficient of correlation is calculated between Henry's score on a test of sociopathy and a clinician's rating of Henry on the variable of sociopathy. This coefficient of correlation might also be referred to as a validity coefficient. 59. Employment test data suggests that an individual applicant is incapable of successfully performing a particular job. However, in reality, this individual would be very successful at the job. Such a scenario exemplifies what is meant by a false negative 60. Which is an example of a false positive? A test identifies a client as schizophrenic when the client is not. 61. If you were a psychologist working in the field of human resources, which claim for a new personnel selection test by a test publisher would be MOST compelling and persuasive? The test improves the hit rate. 62. A construct is All of these 63. Which qualifies as a construct? All of these 64. All validity evidence can be interpreted as ________ validity. construct 65. Evidence of the homogeneity of a test can be found in the Both correlation between test items and total test scores and correlation between subtest scores and total scores 66. Which statistic is appropriate for use to estimate the heterogeneity of a test composed of multiple-choice items? coefficient alpha 67. Test scores may be affected in pre- and post-testing by All of these 68. If a test is a valid measure of a particular construct, we would expect that
groups of people who differ with respect to the construct will obtain different test scores. 69. A significant,
positive relationship exists between scores on a new test of intelligence and scores on the fourth edition of the Stanford-Binet intelligence scale. These data may be viewed as supportive of which type of validity evidence for the new test? convergent evidence of construct validity 70. A statistically insignificant correlation exists between scores on a new test of depression and a well-established measure of satisfaction with life. These data may be construed as which type of validity evidence with regard to the test of depression? discriminant evidence of construct validity 71. The names attributed to different factor loadings in a factor analysis are typically dependent on the researcher's judgment. 72. In the context of test bias, a biased test may be used either fairly or unfairly 73. A test is considered to biased if a factor inherent in the test systematically prevents accurate measurement. 74. Which is TRUE regarding a rating? It refers to either a numerical or a verbal judgment that places a person or an attribute along a continuum 75. Which term is used to refer to the tendency of a rater to
evaluate ratees higher than they objectively deserve because of the rater's inability to discriminate between aspects of the ratee's behavior? halo effect 76. Rating errors All of these 77. A supervisor unintentionally rates his supervisees less favorably than they really deserve. Which type of error has been made? severity error 78. Which type of error has occurred when a music critic's review of Lady GaGa's latest album is more positive than most
person on the planet believe was warranted? halo effect 79. A rater systematically assigns ratings in the middle range, thus avoiding extremely positive and negative ratings. Which type of error BEST characterizes this rater's ratings? central tendency error 80. Issues of "fairness" as applied to tests are rooted in moral and philosophical issues 81. Quotas may be
viewed as one type of remedy for previously unfair practices. 82. Which of the following is TRUE of test bias as compared to test fairness? Test bias is dependent on statistical analyses while test fairness relates to values 83. Any definition of test fairness as used in a psychometric context would be likely to include reference to the degree to which a test is used in an impartial, just and equitable way. 84. If new predictors explain something about a predicted score that was not already explained by existing predictors,
the new predictor might be praised for its incremental validity. 85. In psychological testing and assessment, bias BEST refers to systematic variation in test performance that is unrelated to the construct that the test is intended to be measured 86. Which of the following is the BEST way to minimize test bias? have a panel of experts review the test items at various stages during the test's development.
87. A new test designed to gauge competence to stand trial is found to lack face validity. Which is the MOST likely consequence of this fact? impression management will be less of a factor in the test results 88. Which BEST describes the concept of validity as applied to tests? It refers to how well a test measures what the test authors intend it to measure. 89. A psychologist wants to determine the criterion-related validity of an intelligence test by determining how well it predicts a student's placement in a special class. If the psychologist used the intelligence test for both diagnosis and special class placement, that criterion would be said to be contaminated 90. A test developer compares a student's performance on a newly developed math achievement test to the same student's performance on a well established math achievement test for the purpose of exploring the ________ validity of the new test. concurrent, criterion-related 91. Comparing SAT scores earned in high school with the first semester college GPA of that same student is a process related to establishing the ________ validity of the SAT. predictive criterion-related 92. The results of a predictive validity study of a test will likely be affected most by the characteristics of the sample tested, such as attrition and self-selection. 93. Which is an example of convergent evidence for the construct validity of a test measuring fear of cats? Both a high correlation between the test and an existing validated test measuring fear of cats and a high correlation with an existing validated test measuring more-generalized fear 94.
In contrast to a trinitarian view of validity, a unitary view of validity takes into account all three elements of the trinitarian view plus additional factors such as cultural values 95. If a newly developed test designed to measure happiness correlates with other tests of happiness but not with tests of sadness, this is referred to as __________________ and _________________ evidence of validity, respectively. convergent; discriminant 96. Which is TRUE regarding the concept of test fairness? Fairness often involves moral; ethical issues 97. Which is TRUE regarding the adjustment of test scores as a function of group membership?
All of these 98. "Unequal levels of difficulty between two groups" characterizes the
definition of a biased test that would MOST probably be a quote from a court. 99. Which of the following is NOT included in the traditional "trinitarian" conceptualization of validity? face validity 100. A test reviewer comes to the conclusion that a certain test is "a valid test." This means that the reviewed test has been shown to be valid for a particular use with a particular population at a particular time. 101. Studies that indicate that Attention Deficit Disorder occurs in approximately 2% of the population. Here, 2% is the __________ for the disorder. base rate 102.
Which of the following is the BEST definition of hit rate? the proportion of people the test correctly identifies as possessing a particular trait, behavior, characteristic, or attribute 103. The extent to which a particular factor contributes to a test score is referred to as a factor loading 104.
According to your textbook, factor analysis is a data reduction technique 105. Using a test that measures a low base rate trait will likely result in more incorrect than correct classifications 106. This Child Abuse Potential (CAP) Inventory boasts an accuracy rate of approximately 90%. Properly interpreted, this means that in groups with a 50% base rate, 90% of those who abuse children are correctly identified. 107. If the rate of a particular disorder occurring in the population is low, what impact does this have on the classification of individuals based on the results of a psychological test? More individuals will be incorrectly classified as having the disorder. 108. Each of the three approaches to validity assessment in the trinitarian model should BEST be thought of as one type of evidence that, with others, contributes to a judgment concerning the validity of a test. 109. In legal terminology, a valid contract is a contract that has been executed with the proper formalities. 110. As the term is applied to a test, validity is a judgment or estimate of how well a test measures what it purports to measure in a particular context. Students also viewedAssessment Final138 terms amv4444 Chapter 6 test81 terms brittney_works6 PSYC Chapter 7129 terms digilitbooks Utilleligence146 terms katrizz Sets found in the same foldertest 2 multiple choice165 terms xyzwtuiv test 1 psychological tests118 terms sydnilawrence1 Utilleligence146 terms katrizz Final Exam Review152 terms ribar_j Other sets by this creatorTorts II Midterm139 terms xyzwtuiv Final143 terms xyzwtuiv Final Exam145 terms xyzwtuiv test 270 terms xyzwtuiv Verified questionspsychology Which of the following illustrates a heuristic? a. Calculating the area of a rectangle by multiplying the length times the width. b. Using three dramatic news reports of corporate fraud to estimate how often business fraud occurs. c. Looking in each room of your home to find your sleeping cat. d. Following a new recipe to bake a cake for your friend. e. Trying every key on your mom's key ring until you find the one that unlocks the seldom-used storeroom in the basement. Verified answer psychology Who identified secure and insecure attachment? a. Sigmund Freud. b. Konrad Lorenz. c. Jean Piaget. d. Mary Ainsworth. e. Jerome Kagan. Verified answer
psychology Which division of the nervous system enables a person to move the muscles necessary to walk down the street? a. Central nervous system. b. Sympathetic. c. Parasympathetic. d. Somatic e. Endocrine. Verified answer psychology Gustavo has been rated highly on each of the following traits: • Openness • Agreeableness • Extraversion Provide an example of n behavior for each of the three traits that would indicate that he was correctl rated. Verified answer Recommended textbook solutions HDEV56th EditionSpencer A. Rathus 380 solutions
Myers' Psychology for AP2nd EditionDavid G Myers 900 solutions Consumer Behavior: Buying, Having, Being13th EditionMichael R Solomon 449 solutions Learning and Behavior7th EditionPaul Chance 260 solutions Other Quizlet setsPharmacy contract14 terms Kezla #6Diarreia e Mal-absorção, obstipação cronica, des…22 terms carolinasilva0801 sosc 302 final57 terms sarah_roberts28 pharmocodynamics wk3 bsn22510 terms Jennifer_Goodlet What does concurrent validity indicate?Concurrent validity shows you the extent of the agreement between two measures or assessments taken at the same time. It compares a new assessment with one that has already been tested and proven to be valid.
What is meant by concurrent validity in psychology?Concurrent validity (criterion oriented validation))—the degree to which scores on the measure are associated with scores on another measure taken at the same time. From: A Clinical Introduction to Psychosis, 2020.
What is concurrent validity and example?Concurrent means “as the same time”, so you would perform both tests at about the same interval: you could test depression level on one day with your test, and on the next day with the established test. A statistically significant result would mean that you have achieved concurrent validity.
Which of the following is an example of concurrent validity quizlet?Concurrent validity: Scores on the measure are related to a criterion measured at the same time (concurrently). Example: If two groups of participants were given the measures, and they differed in predictable ways, (therapy for anxiety and therapy for depression) this would be evidence of concurrent validity.
|
