Wikiversity

Validity

Pre-requisites

edit
Main resources: Educations/Courses/Prerequisites and Prerequisites

Before reading this section, make sure you understand:

Psychometric validity

edit

Validity, in the context of psychometrics, refers to the extent to which a psychological test measures what it is purported to measure. Validity is commonly discussed in terms of there being three main types:

  1. Content validity
  2. Construct validity
  3. Criterion validity

In classical test theory, validity is limited by reliability - see also reliability and validity for more information.

Content validity

edit
Main resources: Validity/Contents and Content validity

Content validity is the degree to which the content of the test matches the content domain of the target construct.

For example, a test of ability to add two-digit numbers should cover the full range of combinations of digits (10 to 99). A test with only one-digit numbers, or only even numbers, would not have good coverage of the content domain.

Content validity evidence typically involves subject matter experts evaluating test items against the test specifications. Such expert-based testing of content validity is distinguished from the simpler notion of face validity.

Criterion validity

edit
Main resources: Validity/Criteria and Criterion validity

Criterion validity involves the correlation between the test and a criterion variable (or variables) which are taken as representative of the construct.

There are two types of criterion validity:

  1. Concurrent validity: Test data and criterion data are collected at the same time, e.g.,
    • Self-report and observer measures collected at the same time
  2. Predictive validity: Test data is collected first in order to predict criterion data collected at a later point in time, e.g.,
    • Employee selection tests are often validated against measures of job performance.
    • Measures of risk of recidivism among those convicted of a crime can be validated against measures of recidivism.

Construct validity

edit
Main resources: Validity/Constructs and Construct validity

Construct validity refers to the totality of evidence about whether a particular operationalisation of a construct adequately represents what is intended by the theoretical account of the construct being measured.

Construct validity includes empirical and theoretical support for the interpretation of the construct. Lines of evidence include statistical analyses of the internal structure of the test (including factor analysis and internal consistency) and correspondence between the test measure and the target construct as judged by experts (content validity).

Construct validity is not distinct from the support for the substantive theory of the construct that the test is designed to measure. There are two main approaches to construct validity:

  1. Convergent validity: Degree to which a measure is correlated with other measures that it is theoretically predicted to correlate with.
  2. Discriminant validity: Degree to which the operationalisation does not correlate with other operationalisations that it theoretically should not correlate with.

Theoretical validity

edit

Def. a "quality of a measurement indicating the degree to which the measure reflects the underlying construct, that is, whether it measures what it purports to measure"[1] is called validity.

Reliability

edit
Main resource: Reliability

Def.

  1. "the ability to measure the same thing consistently"[2] or
  2. "(of a measurement indicating the degree to which the measure is consistent); that is, repeated measurements would give the same result"[3]

is called reliability.

See also

edit

References

edit
  1. ↑ 71.120.192.94 (17 March 2006). validity. San Francisco, California: Wikimedia Foundation, Inc. https://en.wiktionary.org/wiki/validity. Retrieved 2016-02-12. 
  2. ↑ reliability. San Francisco, California: Wikimedia Foundation, Inc. 9 December 2015. https://en.wiktionary.org/wiki/reliability. Retrieved 2016-02-12. 
  3. ↑ 71.120.192.94 (17 March 2006). reliability. San Francisco, California: Wikimedia Foundation, Inc. https://en.wiktionary.org/w/index.php?title=reliability&oldid=908951. Retrieved 2016-02-12. 
edit
Retrieved from "https://en.wikiversity.org/w/index.php?title=Validity&oldid=2306241"