Other Measurement Validity TypesOther Measurement Validity TypesOther Measurement Validity TypesOther Measurement Validity Types

OverviewOverviewOverviewOverview

Face validityFace validity Content validityContent validity Criterion-related validityCriterion-related validity Predictive validityPredictive validity Concurrent validityConcurrent validity Construct validityConstruct validity

– Convergent validityConvergent validity– Discriminant validityDiscriminant validity

Face ValidityFace ValidityFace ValidityFace Validity

The measure The measure seemsseems valid “on its face”.valid “on its face”.

A A judgmentjudgment call. call. Probably the Probably the

weakestweakest form of form of measurement measurement validity.validity.

12

34

5

12

34

5

3Scan a multitu

de of inform

ation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and

decide what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

Content ValidityContent ValidityContent ValidityContent Validity

Check the measure Check the measure against the relevant against the relevant content domaincontent domain..

Also a Also a judgmentjudgment call.call.

Can make this Can make this relatively rigorous relatively rigorous with a with a systematic systematic checkcheck..

12

34

5

12

34

5

3Scan a multitu

de of inform

ation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and

decide what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

Content domain

Criterion-Related ValidityCriterion-Related ValidityCriterion-Related ValidityCriterion-Related Validity

Check the measure against a relevant Check the measure against a relevant criterioncriterion..

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide what is

important.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage re

sources effectively.

3Scan a multitu

de of inform

ation and decide what

is important.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

Content domain

TestTest

Criterion-Related ValidityCriterion-Related ValidityCriterion-Related ValidityCriterion-Related Validity

Check the measure against a relevant Check the measure against a relevant criterioncriterion..

The standard is The standard is empiricalempirical..

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide what is

important.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage re

sources effectively.

3Scan a multitu

de of inform

ation and decide what

is important.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

Content domain

TestTest CriterionCriterion

Predictive ValidityPredictive ValidityPredictive ValidityPredictive Validity

A type of A type of criterion-relatedcriterion-related validity validity

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide what is

important.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage re

sources effectively.

3Scan a multitu

de of inform

ation and decide what

is important.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

TestTest

Predictive ValidityPredictive ValidityPredictive ValidityPredictive Validity

A type of A type of criterion-relatedcriterion-related validity validity Look at measure’s ability to Look at measure’s ability to predictpredict

something it should be able to predictsomething it should be able to predict

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide what is

important.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage re

sources effectively.

3Scan a multitu

de of inform

ation and decide what

is important.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

TestTest CriterionCriterion

Concurrent ValidityConcurrent ValidityConcurrent ValidityConcurrent Validity

A type of A type of criterion-relatedcriterion-related validity validity

Concurrent ValidityConcurrent ValidityConcurrent ValidityConcurrent Validity

A type of A type of criterion-relatedcriterion-related validity, validity, Does the measure Does the measure distinguish between distinguish between

groups groups that it should distinguish between?that it should distinguish between?

Concurrent ValidityConcurrent ValidityConcurrent ValidityConcurrent Validity

A type of A type of criterion-relatedcriterion-related validity validity Does the measure Does the measure distinguish between distinguish between

groups groups that it should distinguish between?that it should distinguish between? Example: a measure of empowerment Example: a measure of empowerment

should show higher scores for managers should show higher scores for managers and lower scores for their workers.and lower scores for their workers.

Relationships Among Validity TypesRelationships Among Validity TypesRelationships Among Validity TypesRelationships Among Validity Types

Almost all can be considered a sub-Almost all can be considered a sub-case of case of constructconstruct validity. validity.

Construct validity is the most Construct validity is the most encompassing and comprehensive encompassing and comprehensive standard.standard.