#
|
Course Topic |
T docs: Theory and Methods
|
P docs: Problems and Cases - Practice |
Ancillary Files
|
0
|
Course
presentation
|
|
|
Recommended
MOOC course:
"Learning How to Learn: Powerful mental tools to help you
master tough subjects."
by
McMaster University & University of California
San Diego
- Coursera
|
T1
|
Introduction
to Psychometrics
|
The
role of Psychometrics:
-T1.1.
The Role of Psychometrics.pdf
-T1.2.
Psychometrics as a way.pdf
Psychometrics, definitions and structure:
-T1.3.
Psychometrics: Definitions and Structure.pdf
Psychological Measurement:
-T1.4.
Basic concepts on Psychological Measurement.pdf
Scales of Measurement:
-T1.5.
Types of scales and Statistics.pdf
-T1.6.
Isomorphism, operations and Statistics.pdf
Basics of
Statistics:
Test scores
-T1.7.
Basic Score Types.pdf
|
Psychometrics
CTT and validity using SPSS:
-P1.1.
SPSS Tutorial and Solved Practice.pdf
-P1.1.
Protected EXCEL Data.xlsx
Psychometrics CTT and validity using Stata:
-P1.2.
Stata Tutorial and Solved Practice.pdf
-P1.2.
Protected EXCEL Data.xlsx
-P1.2. Stata do file: Stata14.do file
-QP01_2_Stata14
data.dta
-QP01_2_Stata13
data.dta
-QP01_2_Stata12_11
data.dta
[To use any Stata version data
file: 1. Copy the link address; 2. Stata
command line: write "use" and paste the doc link.]
-QP01_2_Stata.do
[To use any Stata do file: 1. Open-Select All-Copy; 2.
Stata: Open a new do file - Paste]
-QP01_2
Questions. pdf
-QP01_2
Analysis. A screen recording
Basics of Statistics:
The three basic score types and the normalized z-score
transformations using EXCEL:
-P1.3.
Basic Score Types using EXCEL.pdf
|
Learning
SPSS:
-
Howell, D.C - Leerkes, E. Fundamental Statistics for the
Behavioral Sciences (A SPSS handbook).
Learning Stata:
-
YouTube: Getting started with Stata
- UCLA - Institute for
Digital Research and Education (Idra): Resources to
help you learn and use Stata (and other statistical
packages).
-
Introduction to Stata - C.F. Baum Boston College
- Stata tutorial
- Princenton University - Germán Rodríguez
- Baldwin, S.A. (2019). Psychological Statistics and
Psychometrics using Stata. Stata Press. (see Trobes.uv.es - UV
Libraries).
Learning EXCEL:
-
http://www.excel-easy.com/
Choosing a statistical analysis:
-
What statistical analysis should I use? - (IDRA)
UCLA |
T2
|
Fundamentals
of Psychological Scaling for Test and Scale Construction
|
General
Process of Scaling and Measurement:
-T2.1.
The general process of scaling and measurement.pdf
-T2.2.
Additional information: Scaling and Attitudes.pdf
|
Case
Practice: Attitude item generation and rationale
qualitative analysis:
-P2.1.
Attitude item generation and qualitative analysis.pdf
A challenging Case Practice:
Tests Scores and Missing Values on the HPA New Zealand
Attitudes and Behavior towards Alcohol Survey 2014/2015:
-P2.2.
Tests Scores and Missing Values on a professional
survey.pdf
-P2.2. Excel
Fictitious Data (protected).xlsx
|
A
professional survey:
-The
Report and Questionnaire: Attitudes and Behaviour
towards Alcohol Survey 2014/15: Questionnaire [from The
Health Promotion Agency (HPA). New Zealand.]
|
T3
|
Methods
of Psychological Scaling
|
Thurstone's Pairwise Comparisons:
-T3.1.
Thurstone Pairwise Comparisons.pdf
Thurstone's Equal Appearing Intervals
(EAI):
-T3.2.
Thurstone Equal Appearing Intervals.pdf
-T3.3.
Thurstone Scaling Methods: Additional Information.pdf
Likert Scales:
-T3.4. Likert
Scales.pdf
Osgood's Semantic Differential:
-T3.5.
Osgood's Semantic Differential.pdf
Guttman's Scalogram Analysis:
-T3.6.
Guttman Scales.pdf
|
Thurstone's
Paired Comparisons:
-P3.1.
Paired Comparisons.pdf
Thurstone's Equal Appearing Intervals (EAI):
-P3.2.
Equal Appearing Intervals.pdf
Likert Scales:
-P3.3.
Likert Procedure: Problems and Case.pdf
Updated
20181002
-P3.3.
Problem 3. A Likert EXCEL Calculator: reverse
worded items, total scores and missing values.xls
-P3.3.
Case 4. S10/12 Datafile (protected).xlsx
-P3.3.
Likert Tutorial for "Case 4. The Job Satisfaction
Scales.pdf"
[How to solve Likert Case 4 from the doc
"P3.3. Likert procedure: Problems and Case.pdf"]
Osgood Semantic Differential:
-P3.4. Osgood
case.pdf
Guttman's Scalogram Analysis:
-P3.5.
Guttman Cases and Problems.pdf
|
Basics of
mathematics:
Combinations for paired comparisons:
* Permutations and Combinations
-Paired Comparisons (Empty)
Data Spreadsheet.xls (R20250203)
[This empty EXCEL data spreadsheet may help you to
record Paired Comparisons data and to analyze
transitivity]
Scales for Organizational Psychology:
The Job Satisfaction Questionnaires S4/82, S20/23, and
S10/12:
*
Full papers and questionnaires (R20250203)
Going beyond Psychometrics:
The American Marketing Association
*
Marketing and marketing research
* An example of a
professional psychological website: The Therapy Project
|
T4
|
Test
Construction
|
Tests
and test types:
-T4.1.
Tests types.pdf
Item types:
-T4.2.
Item types.pdf
Test Construction:
-T4.3.
Test construction.pdf
Difficulty analysis:
-T4.4.
Difficulty analysis.pdf
Item analysis:
-T4.5.
Item analysis.pdf
Updated 20181116
|
Difficulty
Analysis and Profiles:
-P4.1
Difficulty analysis.pdf
Item Analysis:
-P4.2
Item Analysis.pdf
Updated 20181218
Distractor Analysis:
-P4.3
Distractor Analysis: A solved case.pdf
Updated 20191016
|
Quiz
solutions:
*
Some basic item analysis for binary items: Index
of difficulty, q index, item variance, test q-profile
and elementary distractor analysis for multiple choice
items -a small solved example. (UV
YouTube screen record R20250203)
|
T5
|
Classical
Test Theory (CTT): Basics of the classic linear model
|
Scenario
1:
CTT: Model and the Standard Error of Measurement:
-T5.1.
The Classical Test Model and the Standard Error of
Measurement.pdf
Scenario 2:
CTT: Two approaches for Reliability and the Basic
Equations:
-T5.2.
The Basic Equations for Reliability.pdf
An Ad Hoc Solution:
-T5.3.
Parallel Measurements.pdf
|
Basics
of Statistics:
The relationship between test scores:
-P5.1
Analyzing the relationship between test scores:
Covariances and Correlations.pdf
Estimating the main Classical Test Theory
equations:
-P5.2 The
main CTT equations.pdf
The estimation of reliability assuming
constant Standard Error of Measurement (SEM):
-P5.3.
Assuming SEM constant.pdf
|
Videos
explaining some basics of theme 5 docs:
* Psychometrics; The core of the
Classical Test Theory: The definition of the true score,
the observed score, and the error of measurement. Why
the sum (and the mean) of the errors of measurement is
always 0 when measuring the same object many times.
(T5.1 CTT. Basic concepts. UV video R20250203)
[A UV video explaining some basic CTT concepts from the
doc T5.1]
* Psychometrics Classical Test
Theory: A UV video explaining some basic Classical
Test Theory equations when measuring once many cases
(T5.1 slides 1-13 T5.2 CTT. Basic
equations UV video R20250203)
[A UV video explaining some basic CTT equations from
the doc T5.1 slides 1-13]
|
T6
|
Estimation
of Reliability
|
Procedures
for estimating test reliability based on parallel
measurements:
-T6.1.
The estimation of test reliability.pdf
The relationships between the test total scores and the
item scores:
-T6.2.
Item-test statistics relationships.pdf
Reliability and test length: The Spearman-Brown prophecy:
-T6.3.
Spearman-Brown.pdf
The Standard Error of Measurement prophecy:
-T6.4.
SEM prophecy.pdf
The Internal Consistency: Alpha, Hoyt, KR20
and KR21:
-T6.5. Alpha,
KR20 and KR21.pdf
The interpretation
of the Reliability Coefficient and the Standard Error of
Measurement:
-T6.6.
The interpretation of the reliability.pdf
The estimation of the True Scores: Point
estimation and Confidence Intervals:
-T6.7.
The estimation of true scores. pdf
|
Procedures
for estimating test reliability based on parallel
measurements: Parallel forms, Test-retest and Split-half
methods:
-P6.1.
Parallel, Test-retest and Split-half.pdf
Reliability and test length: Spearman-Brown and SEM
prophecies
-P6.2.
Spearman-Brown and SEM.pdf
The estimation of the Internal Consistency:
-P6.3.
Alpha, KR20, KR21.pdf
Alpha using Hoyt Procedures and Alpha using
a two-way ANOVA:
-P6.4.
Alpha using Hoyt and ANOVA procedures.pdf
-P6.4.
Stata Data: Guttman like Data.dta
-P6.4.
Stata do file: Alpha Reshape Anova Hoyt.do
Basics of Statistics:
The linear relationship between two sets of scores:
Covariances, Correlations and Regression
-P6.5.
Linear relationships.pdf
-P6.5. Stata
Data: X and Y data.dta
-P6.5.
Stata do file: X and Y linear relationships.do
-P6.5.
Stata Data: X and Y unsolved.dta
The estimation of the True Scores and Confidence
Intervals:
-P6.6.
True scores.pdf
|
|
T8
(Old T7)
|
Validity
|
The
concept of Validity:
-T7.1.
Concept of Validity.pdf
Historical Evolution:
-T7.2.
History of Validity theory.pdf
Validity of Psychological Inferences:
-T7.3.
Validity as the support for Psychological Inferences.pdf
|
What's
Validity?
-P7.1.
What is Validity?.pdf
Validity and Prediction on qualitative
variables
-P7.2.
Prediction Qualitative.pdf
Validity and Prediction on discrete
variables
-P7.3.
Prediction Discrete.pdf
Validity and Prediction on continuous
variables
-P7.4.
Prediction Continuous.pdf
|
Psychometrician
as a profession:
* Psychometrician as a job |
T9 (Old T8)
|
Validity:
Internal sources of evidence |
Validity.
Internal Sources of Evidence:
-T8.1.
Validity: Internal Sources.pdf
Content validity:
-T8.2.
Content Validity.pdf
Factor Analysis:
-T8.3.
Factor Analysis: The basic concepts.pdf
-T8.4.
Factor Analysis: Steps and interpretation.pdf
-T8.5.
Factor Analysis: Rotation.pdf
|
Inter-rater
reliability:
-P8.1. Inter-rater reliability.pdf
-P8.1.
Inter-rater reliability: Excel Data.xlsx
Content validity:
-P8.2.
Content Validity.pdf
-P8.2.
Content Validity: Excel Data.xlsx
Factor Analysis. Output interpretation:
-P8.3.
Factor Analysis: SPSS output interpretation.pdf
Factor Analysis. The analysis and interpretation of the
rotated factor matrix:
-P8.4.
Factor Analysis: Analysis and interpretation of the
rotated factor matrix.pdf
|
Factor
Analysis:
*
UCLA - Idra (Institute for Digital Research and
Education): Factor Analysis Annotated SPSS Output.
*
UCLA - Idra (Institute for Digital Research and
Education): Factor Analysis Annotated Stata
Output.
Annotated output:
*
UCLA: Idra (Institute for Digital Research and
Education): Annotated Output SPSS, Stata and others.
Videos explaining some basics of theme 8 docs:
* P08.1 s6-7 Inter-rater
Percentage of Agreement.mp4 (UV Video R20250204)
* P08.1 s9 Probability
of Agreement by chance.mp4 (UV Video R20250204)
* P08.1 s10, 12-15 Cohen's
Kappa.mp4 (UV Video R20250204)
* T08.2 P08.2 Content validity:
Hambleton's method, Lawshe's method, and Rovinelli and
Hambleton's method - Solved examples.mp4 (UV Video
R20250204)
|
T10 (Old T9)
|
Validity:
External sources of evidence
|
Validity
evidence based on external sources: The criterion-related
validity:
-T9.1.
The criterion related validity.pdf
Validity evidence for two or more
predictive tests:
-T9.2.
Validity evidence with Multiple Predictors.pdf
Validity evidence controlling for the
effects of other variables:
-T9.3.
Validity using semipartial correlation.pdf
-T9.4.
Validity using partial correlation.pdf
Construct validity, convergent and
discriminant validity and the multitrait-multimethod
matrix:
-T9.5.
Construct validity.pdf
Validity evidence for categorical criteria:
-T9.6.
Validity for categorical criteria.pdf
|
Validity
and Prediction using a predictor variable:
-P9.1.
Prediction using a predictor variable.pdf
Criterion-Related Validation:
-P9.2.
Criterion Validity.pdf
The interpretation of the validity
coefficient:
-P9.3.
Interpretation of the criterion validity
coefficient.pdf.
Criterion Validation for several predictor
tests:
-P9.4. Validity evidence using Multiple
Regression.pdf
Criterion validation controlling for the effects of one or
more variables:
-P9.5.
Validity evidence using Partial and Semipartial
correlations.pdf
Validation using categorical criteria:
-P9.6.
Categorical criteria.pdf
Validation using categorical criteria:
-P9.7.
Challenging Case in Sport Psychology.pdf
|
Annotated
output:
* UCLA: Idra (Institute for Digital Research
and Education): Stata FAQ: Regression by groups.
Annotated output:
* UCLA: Idra (Institute for Digital Research
and Education): SPSS FAQ: How can I compare regression
coefficients between two groups?
A useful SPSS manual:
* Howell, D.C - Leerkes, E. Fundamental Statistics for
the Behavioral Sciences. (Available on internet)
Learning Stata: Video examples:
* Simple linear regression in Stata
* Multiple linear regression in Stata
Can you read and understand psychometric papers?:
* Psychometric Properties of the Psychological State
Test for Athletes (TEP)
|
T11 (Old T10)
|
Validity:
Other Aspects
|
Factors
affecting test validity:
-T10.1.
Factors affecting validity. pdf
Validity and decision making:
-T10.2.
Validity and decision making.pdf
Classification efficiency statistics:
-T10.3.
Classification Statistics.pdf
Bias in selection:
-T10.4. Bias in
selection.pdf
COP and ITC Guidelines on test use:
-T10.5.
Guidelines on test use.pdf
|
Disattenuating
the validity coefficient:
-P10.1.
Disattenuation.pdf
Classification efficiency statistics and bias in
prediction:
-P10.2. A
Bias in selection case.pdf
Classification efficiency statistics: Sensitivity,
specificity, accuracy and optimal selection cutpoint:
-P10.3.
Classification Efficiency.pdf
-P10.3.
Problem 4. Stata Data.dta
-P10.3.
Problem 4. Stata Instructions.do
Integrative transverse case practice:
-P10.4.
Achievement Motivation Case.pdf
|
Can you read
and understand psychometric papers?:
*
A clinical example: The tinnitus handicap inventory.
Main applications of validity:
*
Personnel Selection Procedures (Society for Industrial
and Organizational Psychology)
Guidelines on test use:
* The International
Test Commission
* Consejo General
de la Psicología de España:
* Comisión
de Tests - Normas para el uso de los tests - Tests
revisados - Modelo para evaluar la calidad de los tests.
Classification efficiency statistics:
*
MEDCALC: Diagnostic Test Evaluation Calculator
|
T12 (Old T11)
|
Interpretation
of Test Scores
|
The
interpretation of test scores:
-T11.1.The
interpretation of test scores.pdf
|
Scoring
and Correcting for Guessing:
-P11.1.
Scoring and correcting for guessing.pdf
Setting Standards:
-P11.2.
Setting standards.pdf
Sampling for Normative Samples (or other
purposes):
-P11.3.
Sampling.pdf
Norms and Standard Scores:
-P11.4.
Norms and standard scores.pdf
Score Equating:
-P11.5.
Equating.pdf
Integrative transverse case practice:
-P11.6.
Gender Case.pdf
-P11.6.
Excel Data.xlsx
-P11.6.
CAIG Questionnaire.pdf
-P11.6.
Short form questionnaire and additional
variables.pdf
|
Random
numbers for random sampling or random assignment:
* Research
Randomizer.
Am I able to read and understand psychometric papers?:
*
A clinical example: Handelzalts, J.E., Hairston,
I.S., Matatyahu, A. (2018). Construct Validity and
Psychometric Properties of the Hebrew Version of the
City Birth Trauma Scale.
|
T7.1 (Old T12)
|
Item
Response Theory (IRT): Models, estimation and fit
|
IRT,
CTT and FA: similarities and differences:
-IRT
and CTT features.pdf
IRT Assumptions and main concepts:
-IRT
Assumptions.pdf
The basic IRT models and parameters: Normal Ogive and
Logistic Models (1PL, 2PL and 3PL):
-IRT
basic models.pdf
Relating IRT to CTT:
-IRT
from CTT.pdf
|
Statistical
dependence and local independence:
-P
Local Independence.pdf
-P
Example of Stata do file.do
-P
Examples of EXCEL files.xlsx
The
interpretation of Item Characteristic Curves (ICC):
-P The
interpretation of ICCs.pdf
Approaching IRT from CTT: empirical ICCs and logistic
regression:
-P
Approaching IRT from CTT.pdf
-P
Stata do file: IRT from CTT.do.pdf
Estimation of IRT models using Stata:
-P
Estimating and interpreting IRT 1PL models.pdf
-P Stata
data file: Stata1PL1.dta
How to calculate Pearson, Point-Biserial, and Biserial
-P
Pearson, Point-Biserial and Biserial.pdf
|
Introduction
to Item Response Theory:
*
What is item response theory?
* Innovative Psychometrics by
Assessment Systems (a psychometrics company).
*
Statistical Dependence and Independence: How to create a
case of statistical dependence or independence from
scratch (UV Video R20250204)
*
How to calculate the probability of a correct answer
given a logistic model 1PL, 2PL, and 3PL (UV Video
R20250204)
|
T7.2 (Old T13)
|
Item
Response Theory (IRT): Applications
|
IRT
Information functions:
-Information
functions.pdf
IRT Applications:
-IRT
Applications.pdf
|
Rasch
estimation:
-P
Rasch models estimation using Stata.pdf
Updated 2020 03 26
IRT estimation using Structural Equation Models (SEM):
-P
IRT estimation using Structural Equation Models
(SEM).pdf
Combining IRT and CTT
-P
A challenging case combining IRT and CTT
|
|