Resources: Reliability and Validity Worksheet
A valid instrument is one that measures what it says it measures. Validity depends on the amount and type of evidence there is to support one’s interpretations concerning data that has been collected. This week, you discussed three kinds of evidence that can be collected regarding validity: content-related, criterion-related, and construct-related evidence.
1. How strong is the relationship between the students’ scores obtained using this instrument and their teacher’s rating of their ability?
2. How adequately do the questions in the instrument represent that which is being measured?
3. Do the items that the instrument contains logically reflect that which is being measured?
4. Are there a variety of different types of evidence (test scores, teacher ratings, correlations, etc.) that all measure this variable?
5. How well do the scores obtained using this instrument predict future performance?
6. Is the format of the instrument appropriate?