Studies of Outcome Measures - Reliability and Validity

T/F: Age/gender are also outcome measures.

Psychometric properties are the intrinsic properties of an outcome measure and include ________, ________, and ________.

What are the two general outcome measure categories?

In performance-based measures, time to complete a task is an example of _________ measurement; while determining whether a patient has normal/abnormal gait pattern is a ________ measurement.

The type of outcome measures can also be categorized based on ICF model. Match the following measures to respective ICF level.
1. Geriatric depression scale
2. Mini-mental state exam
3. Activities-specific Balance Confidence Scale
4. 10 Meter Walk Test
5. Pediatric evaluation of disability inventory (PEDI)
6. Neck Disability Index
7. Oswestry disability questionnaire

Validity refers to an outcome's ability to ____________.

Reliability refers to an outcome measure's _______ in _________.

What are the 4 types of reliability that should be considered when appraising outcome measures?

Which reliability answers the question:
Do all the items measure the same construct?

Internal consistency is the consistency of _______ across individual items of an outcome measure.

How is internal consistency measured?

Internal consistency is measured using the __________ (statistical measure).

Cronbach alpha ranges from ___ to ___.

Cronbach alpha close to 0 indicates that ________.

Cronbach alpha close to 1 indicates that ____________.

Why do we not want the Cronbach alpha to exceed 0.90?

What if the Cronbach alpha in a special population is 0.97?

Test-retest reliability establishes the extent to which an outcome measure produces ___________ when ___________ to a patient who (has/has not) experienced change.

To determine the test-retest consistency, (one/multiple) rater measures (the same/ multiple) patient two or more times, over the course of (a year/ several days).

Who is the tester in a patient self-directed questionnaire?

The consistency with which an OM produces the same score when used by the same therapist on the same patient is called ________.

T/F: usually only 1 therapists were required to perform the same test on the same patient repeatedly over several days to test for intra-rater reliability.

The difference between test-retest reliability and intra-rater reliability is that ______ refers only to the OM itself, while __________ specifically addresses the skills of the raters.

Inter-rater reliability refers to the consistency with which (the same/different) raters produce (the same/different) scores for (the same/different) patient.

A trial involving many therapists rating one patient at the same time is able to tell you about the OM's _____.

T/F: the same statistical tool is used to compare test-retest reliability, intra-rater reliability, and inter-rater reliability.

Which test is used to compare test-retest reliability, intra-rater reliability, and inter-rater reliability?

Kappa is usually used for _______ while ICC is usually used for ___________.

Kappa ranges from __ to __

ICC ranges from __ to ___.

If the absolute value of kappa/ICC is >0.80, then there is _____ agreement.

If the absolute value of kappa/ICC is between 0.60 to 0.80, then there is _____ agreement.

If the absolute value of kappa/ICC is between 0.40 to 0.60, then there is _____ agreement.

If the absolute value of kappa/ICC is less than 0.40, then there is _____ agreement.

For a study of OM to have good reliability, the study's purpose should be ____ to the clinical question.

For a study of OM to have good reliability, the inclusion/exclusion criteria should _________.

For a study of OM to have good reliability, the OMs should be _____ to my clinical question and be conducted in a _____ anner.

For a study of OM to have good reliability, the study population should _________.

For a study of OM to have good reliability, the sample size should be ______

For a study of OM to have good reliability, the participants should be (more/less) diverse in the full range of OMs.

For a study of OM to have good reliability, the participants should be (stable/unstable) in the character of interest.

For a study of OM to have good reliability, there should be evidence that the tests were conducted in a ______ manner.

For a study of OM to have good reliability, the raters should be blinded of _______.

Why should there be ample time given even when assessing the intra-rater reliability?

There are three types of outcome measure validity, they are______, _______ and ______.

Content validity establishes that an outcome measure includes____________ that it purports to measure.

How is content validity established?

A less formal evaluation of content validity is ________.

The measure of whether the tested OM matches a gold standard is called ________.

T/F: A gold standard criterion measure has the virtually irrefutable validity for measuring the characteristics of interest.

When a gold standard criterion does not exist, a ______ can be used.

Criterion validity studies can be divided into _______ and ________ validity.

Concurrent validity is established when researchers demonstrate that an outcome measure has a high correlation with the criterion measure taken at ___________.

Predictive validity is established when researchers demonstrate that an OM has a high correlation with a ________.

________ establishes the ability of an OM to assess n abstract characteristic or concept.

How is construct validity established?

What are the three commonly used methods to establish construct validity?

Known-group validity establishes that an OM produces (the same/different) scores for groups with known (similarities/differences) on the characteristic being measured.

_________ validity establishes that a new measure correlates with another thought to measure similar a characteristic or concept. (High/low) correlation is ideal.

__________ validity establishes that a new measure correlates with another thought to measure a distinctly different characteristic or concept. (High/low correlation is ideal).

Which statistic test is used to detemine criterion validity?

convergent validity test may look the same as __________.

To interpret Spearman's rho value, _____ is generally strong, _______ is moderate and _______ is poor.

To have good content validity, the experts establishing the criteria should be _______

To have good content validity, the researchers should collect and respond to the expert's feedback ________.

To have good criterion and construct validity, the authors should argue for the credibility of the _____ or _______.

To have good criterion and construct validity, the raters should be ______ to the results of the OM as well as the criterion measure.

T/F: To have good criterion and construct validity, all participants should have completed one or the other measure.

T/F: To have good criterion and construct validity, there should be reasonable time between tests for predictive validity.

For known-group construct validity studies, the groups established should be ________ on the characteristics of interest.