Research method
Factor Analysis
Factor analysis (EFA, PCA, CFA) models covariation among questionnaire items as a smaller set of latent dimensions. A four-factor solution that fits, or a hierarchy of factor means, is a measurement claim: these items hang together in this sample. It is not a causal test of teaching, not an RCT, and not proof that a summed factor score is interval 'truth' about engagement in the world. SEM paths that later use those factors remain observational.
Teacher-practice and online-quality papers use factor analysis to build scales (technology-integration quality, online-learning priorities, information-literacy beliefs) before relating them to engagement or self-efficacy. They answer 'do these items cluster as theory hoped?' Their main limitation is mistaking a well-fitting measurement model for evidence that changing the named practice would move the outcome.
Evidence
What the evidence shows
Drawn from 4 studies in this library. Each finding starts with a plain-language takeaway, then the denser detail. Supports means evidence for a finding; Challenges means evidence against a stated position; Qualifies marks scope with a short note on each study’s contribution. Challenged positions are labeled — they are not findings.
The Technology Integration Quality Scale was validated with EFA/CFA in 2,281 second-year upper-secondary students; four EFA factors accounted for 57.8% of variance. Cluster-robust SEM then found that support for learning and classroom management positively predicted behavioural engagement, cognitive activation predicted digital competencies, use-frequency links were smaller, and individualised teaching related negatively to engagement in the reported models. Cross-sectional perceptions cannot prove that changing integration quality would raise engagement.
After a 397-student pilot, instructors distributed a Qualtrics survey to about 2,500 students; 987 responded (40%), 78% under age 30. Exploratory factor analysis organised priorities into a hierarchy of online-learning quality factors. Students treated some baseline conditions as near-threshold requirements while weighting teaching presence and interactive features as higher-order drivers; factor means differentiated clusters of importance rather than a flat list. Importance ratings are not measured learning gains, and instructors opted into distribution.
Among 310 Lithuanian pre-service teachers, a structural equation model used literacy and self-efficacy constructs: perceived information-evaluation literacy predicted information-search literacy (B = 0.993) and ICT self-efficacy (B = 0.369), with an additional path from search literacy to ICT self-efficacy. Cross-sectional self-report SEM cannot prove that training evaluation literacy would raise teaching ICT self-efficacy.
A faculty-training programme (695 participants) used multi-item instruments on attitudes toward innovation and the LMS, knowledge of teaching-practice elements, and reported application, then showed pre/post attitude and knowledge gains in a single-group quasi-experiment. Those instruments may be factor-scored internally, but the design that supports 'attitudes improved' is pre/post without a control — not a CFA proving that innovation training caused student learning.
Open questions
Tensions and limits
Some items are genuine disagreements on the same question. Others mark different assays, populations, or outcomes — limits on how far one study travels — not a forced fight between papers.
Measurement models and change scores are different jobs. TIQS uses EFA/CFA then SEM paths, including an unexpected negative individualised-teaching path. The online-quality paper uses EFA to rank importance, not to predict engagement. The teacher-education paper uses SEM path coefficients among self-beliefs. The faculty paper reports pre/post attitude change for 695 trainees without a control. One software family (factors, SEM, scales) is not one empirical result.
- Technology integration quality and engagement
- What do students rank as most important online?
- Info literacy skills predict teachers’ ICT self-efficacy
- Faculty training that shifts teaching innovation attitudes
Study Role Design N Population Outcome Technology integration quality and engagement Supports Cross-sectionalTIQS validation and SEM linking technology-integration quality to engagement N=2281 · 2,281 second-year Swiss upper-secondary students Swiss upper-secondary students rating classroom technology integration Behavioral engagement and digital competencies related to TIQS quality dimensions What do students rank as most important online? Supports Cross-sectionalLarge survey with EFA of student-rated online course quality factors N=987 · 987 respondents (~40% of ~2,500 contacted); 397-student pilot University students rating online-course quality priorities Hierarchy of online-learning quality factors (modality, teaching presence, interaction) Info literacy skills predict teachers’ ICT self-efficacy Supports Cross-sectionalSEM survey linking information literacy to ICT teaching self-efficacy N=310 · 310 pre-service teachers at two Lithuanian universities Lithuanian pre-service teachers ICT self-efficacy for teaching predicted by information evaluation and search literacy Faculty training that shifts teaching innovation attitudes Supports OtherPre–post faculty development program evaluating attitudes toward teaching innovation N=695 · 695 university professors participated University faculty (full-time and part-time) in a faculty training program Attitudes toward transformative/innovative teaching after the development experience Theoretically positive quality dimensions do not all point the same way. TIQS finds support and classroom management positively linked to behavioural engagement, but individualised teaching negative in the reported model — a sign the authors flag as fragile. The hierarchy paper’s teaching-presence/interactive factors are importance ratings, not the same latent as TIQS’s integration-quality factors. Do not treat them as replications of one 'quality raises engagement' law.
Study Role Design N Population Outcome Technology integration quality and engagement Supports Cross-sectionalTIQS validation and SEM linking technology-integration quality to engagement N=2281 · 2,281 second-year Swiss upper-secondary students Swiss upper-secondary students rating classroom technology integration Behavioral engagement and digital competencies related to TIQS quality dimensions What do students rank as most important online? Supports Cross-sectionalLarge survey with EFA of student-rated online course quality factors N=987 · 987 respondents (~40% of ~2,500 contacted); 397-student pilot University students rating online-course quality priorities Hierarchy of online-learning quality factors (modality, teaching presence, interaction)
Common misconceptions
Factor analysis tests whether a teaching practice causes engagement.
EFA/CFA say whether item covariances in 2,281 students fit four TIQS factors (57.8% of EFA variance). Causal effects of changing those practices were not assigned. SEM paths from factors to engagement remain associations among perceptions.
A well-fitting factor solution means the summed Likert score is interval truth about the construct.
Fit says the items cluster. Online-quality factor means differentiate stated importance among 987 respondents (40% of those contacted), not equal-interval learning. Lithuanian B = 0.993 is a path among self-reports, not a calibrated unit of literacy.
If faculty complete a multi-factor attitude instrument and scores rise, the scale validated the training as improving teaching.
695 trainees’ attitude and knowledge self-reports rose without a control group and without student-learning outcomes. Instrument structure, even if factored, does not convert that design into a causal teaching trial.
Exam-style questions
Short-answer questions that ask you to explain or compare, not recall.
TIQS’s four factors fit in 2,281 students and then SEM shows a negative path from individualised teaching to engagement. Why is that path especially weak as a 'don’t individualise' recommendation?
It is a cross-sectional perception model among theoretically positive quality dimensions. Unexpected signs can be suppressors, collinearity or misfit. The authors already urge caution; no one was randomised to more or less individualised teaching.
987 students (40% of ~2,500 contacted; 78% under 30) produce a hierarchy in which teaching presence outranks baseline online conditions. What is that a hierarchy of?
Stated importance on a survey whose instructors opted into distribution — not measured learning, and not a representative age mix. Baseline conditions can still be necessary even if they are not the highest-mean 'wow' factors.
Evaluation literacy → search literacy B = 0.993 in 310 pre-service teachers. Why does that not prescribe teaching evaluation before search?
It is a decomposition of concurrent self-reports in two Lithuanian universities. A trial that trains evaluation then search would be a different design; the coefficient is not a curriculum sequence.
Compare factor analysis in TIQS with the faculty-training paper: which result is a measurement model, and which is a change score?
TIQS’s EFA/CFA (four factors, 57.8% EFA variance) is the measurement model; subsequent SEM paths are still observational. The faculty paper’s result is a single-group pre/post rise in attitude/knowledge scores for 695 people. Using factor-scored instruments does not make that rise a validated causal effect on teaching quality.
The studies
4 studies in this library bear on Factor Analysis, ordered by citations.
- What do students rank as most important online?
Students prioritize a hierarchy of online-course quality factors spanning basic modality, teaching presence, and richer interaction.
- Info literacy skills predict teachers’ ICT self-efficacy
For Lithuanian pre-service teachers, stronger perceived information evaluation and search literacy predicted higher ICT self-efficacy for teaching.
- Technology integration quality and engagement
Among Swiss upper-secondary students, validated TIQS dimensions—especially support for learning and classroom management—were positively related to behavioral engagement, while cognitive activation related to digital competencies.
- Faculty training that shifts teaching innovation attitudes
A university faculty development program improved professors’ attitudes toward teaching innovation and LMS use, plus knowledge of innovative teaching elements.
Learn alongside