criterion validity kyle sharp a ed 615 fall 2006

10
Criterion Validity Kyle Sharp A ED 615 Fall 2006

Upload: everett-webb

Post on 19-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Criterion Validity

Kyle Sharp

A ED 615

Fall 2006

Page 2: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Criterion Validity What is it?

This type of validity is used to measure the ability of an instrument to predict future outcomes.

Validity is usually determined by comparing two instruments ability to predict a similar outcome with a single variable being measured.

There are two major types of criterion validity predictive or concurrent forms of validity.

Page 3: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Concurrent Criterion Validity

Concurrent criterion validity is used when the two instruments are used to measure the same event at the same time.

Example: Exit polls during an election can be said to have concurrent criterion validity if they predict similar outcomes to the election.

Page 4: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Predictive Criterion Validity

Predictive validity is used when the instrument is administered then time is allowed to pass and is measured against the another outcome.

Example: During election season polls are taken of registered voters, the outcome of the polls are measured against the outcome of the election to determine their validity.

Page 5: Criterion Validity Kyle Sharp A ED 615 Fall 2006

How is Criterion Validity Measured?

The statistical measure or correlation coefficient tells the degree to which the instrument is valid based on the measured criteria.

What does it look like in an equation? The symbol “r” denotes the correlation coefficient. A higher “r” value shows a positive relationship

between the instruments. A mix of high and low “r” values shows a negative

relationship.

Page 6: Criterion Validity Kyle Sharp A ED 615 Fall 2006

So what does all of that Mean?

With regard to survey research criterion validity in its many forms supports the outcomes given by an instrument by showing it has the power to predict outcomes as well as other known events or instruments.

Page 7: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Criterion Validity and Quantitative Research

When doing quantitative research it is important to have criterion validity with regard to survey instruments. Instrument validity produces dependable raw data for

further quantitative analysis. Dependable raw data provides strong evidence for

reaching a trustworthy conclusions.

Criterion validity is useful when other instruments can be used for comparison and lead to the strongest relationship for a given variable.

Page 8: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Criterion Validity and Qualitative Research

In qualitative research when answers are more subjective it is even more important to have a valid instrument. When an instrument is valid it removes the possibility of

researcher bias affecting the outcome. If researcher bias is removed from the analysis then the

results can lead to stronger conclusions.

In qualitative analysis it is important that the instruments used in criterion validation are measuring the same variable.

Page 9: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Is it ever really used?

For an article which uses criterion validity click here This article describes how an existing

instrument that was being used had been validated using this criterion validation.

Page 10: Criterion Validity Kyle Sharp A ED 615 Fall 2006

Works Consulted Frankel, J., Wallen, N. (2006). Validity and

Reliability. In How to design and evaluate research in education (6th ed., pp. 151, 155-156), Boston, McGraw Hill

Garton, B., Dyer, J., King, B. (2000), The use of learning styles and admission criteria in predicting academic performance and retention of college freshmen, Journal of Agricultural Education, 41(2). 46-53

http://oerl.sri.com/instruments/instrgloss.html http://

www.socialresearchmethods.net/kb/rel&val.htm