Question  |
Answer |
|
start learning
|
|
ratio, interval, ordinal, nominal
|
|
|
|
start learning
|
|
|
|
|
|
start learning
|
|
on a scale, distance is meaningful
|
|
|
|
start learning
|
|
measuring using ranking, attributes can be ordered
|
|
|
|
start learning
|
|
|
|
|
|
start learning
|
|
|
|
|
|
start learning
|
|
consistency of measurement
|
|
|
|
start learning
|
|
observed score = true ability + random error
|
|
|
|
start learning
|
|
random error, systematic error
|
|
|
|
start learning
|
|
randomly affect measurement
|
|
|
|
start learning
|
|
consistently affect measurement
|
|
|
|
start learning
|
|
pilot test, train interviewees, observers etc., double-check data, use statistical procedures to adjust for measurement error, triangulate
|
|
|
|
start learning
|
|
feedback from respondents
|
|
|
|
start learning
|
|
combining multiple independent measures
|
|
|
inter-rater or inter observer reliability start learning
|
|
Agreement or correlation between the ratings or codings. Two independent raters or observers of the same phenomenon
|
|
|
|
start learning
|
|
the same test or measurement, two successive time periods
|
|
|
parallel-forms reliability start learning
|
|
two versions of the same test or measure that were constructed in the same way
|
|
|
internal consistency reliability start learning
|
|
the degree to which items on the same multi-item instrument are interrelated
|
|
|
internal consistency methods start learning
|
|
inter-item correlation, average item-total correlation, split half correlation, Cronbach’s Alpha
|
|
|
|
start learning
|
|
translation, criterion-related
|
|
|
|
start learning
|
|
how well is the idea of measure translated into operationalisation?
|
|
|
types of translation validity start learning
|
|
|
|
|
|
start learning
|
|
“on its face” good translation of the construct
|
|
|
|
start learning
|
|
check organisation against the relevant content domain (traits of your construct)
|
|
|
criterion-related validity start learning
|
|
based on its relationship to another independent measure as predicted by your theory
|
|
|
types of criterion-related validity start learning
|
|
predictive, concurrent, convergent, discriminant
|
|
|
|
start learning
|
|
predict what it theoretically should be able to predict
|
|
|
|
start learning
|
|
able to distinguish between groups it should theoretically be able to
|
|
|
|
start learning
|
|
how similar the operationalisation to ones it should theoretically be similar
|
|
|
|
start learning
|
|
how not similar the operationalisation to ones it should theoretically not be similar
|
|
|
threats to construct validity start learning
|
|
not defined well construct, mono-operation bias, mono-method bias, interaction of different treatments, interaction of testing and treatment, restricted generalisability across constructs, confounding constructs and levels of constructs
|
|
|
|
start learning
|
|
when you rely on only a single implementation of your independent variable, cause, program, or treatment
|
|
|
|
start learning
|
|
because you use only a single method of measurement
|
|
|
interaction of different treatments start learning
|
|
when participants take part in several programs
|
|
|
interaction of testing and treatment start learning
|
|
does the testing make groups more sensitive to treatment?
|
|
|
restricted generalisability across constructs start learning
|
|
side effects or negative consequences on other not measured outcomes
|
|
|
confounding constructs and levels of constructs start learning
|
|
results found only for e.g. one dosage of drug and not for range of different doses
|
|
|
|
start learning
|
|
participants in a study guess the purpose of the study and adjust their responses based on that
|
|
|
|
start learning
|
|
many people are anxious about being evaluated - may perform poorly
|
|
|
|
start learning
|
|
researcher can bias the results both in conscious and unconscious ways
|
|
|
social threats to construct validity start learning
|
|
hypothesis guessing, evaluation apprehension, researcher expectancies
|
|
|
