Academic literature on the topic 'Multitrait-multimethod matrix'

The classical multitrait-multimethod (MTMM) matrix can be viewed as a two-dimensional cross-classification of traits and methods. Beside commonly used analysis methods such as structural equation modeling and generalizability theory, multilevel analysis offers attractive possibilities. If the focus is only on analyzing classical MTMM data, the multilevel approach has no surplus value, because the resulting model is equivalent to a confirmatory factor model with additional restrictions imposed by the multilevel parameterization. However, if the data contain further complexities, such as additional information on the traits or persons, multilevel analysis of MTMM data offers a flexible analysis tool with more possibilities than the other approaches.

Thesis (M.A.)--University of North Carolina at Greensboro, 2007.
Title from PDF t.p. (viewed Feb. 28, 2008). Directed by Heidi Gazelle; submitted to the Dept. of Psychology. Includes bibliographical references (p. 41-47).

There continues to be doubt regarding the validity of laboratory aggression paradigms. This paper provides an investigation of the construct validity of one prominent aggression task, the Taylor Aggression Paradigm (TAP), within a Multitrait Multimethod Matrix (MTMM) methodology. Participants consisted of 151 male undergraduate psychology students with a median age of 19 years old (M=19.45, SD = 2.03). Participants completed self-report and behavioral measures of aggression, impulsivity, and pro-social behavior which were analyzed using a Correlated Trait – Correlated Method Confirmatory Factor Analysis model. Results supported the construct validity of the MTMM model and the TAP. This study provides one of the only a priori tests of construct validity for the TAP and provides a basis for additional validation studies using this methodology.

The aim of this research programme was to examine the 3P model of learning (Biggs, 1987a, 1999). The first stage necessarily involved an examination of the Study Process Questionnaire (SPQ) (Biggs, 1987a), an instrument developed to measure the process component of the model. The structure of the SPQ was examined utilising exploratory and confirmatory factor analysis of undergraduate responses (n= 260). The results indicated the higher-order factor structure of deep-achieving and surface-achieving-motive provided the most reliability and a better model fit than either the subscales or scales of the SPQ. The construct validity of the two constructs deep and surface was assessed next using a multitrait-multimethod matrix (MTMM) constructed from the three measures of the self-report questionnaire, interview ratings and written assessments from first-year students (n = 50). The results indicated good convergent validity between the deep scale of the SPQ and the interview ratings on the deep scale, between the deep scale on the SPQ and the written assessment ratings, and between the interview ratings and written assessment ratings. The results indicated good convergent validity between the surface scale on the SPQ and the interview ratings on the surface scale, but not between the surface scale on the SPQ and the written assessment ratings, and between the interview ratings and written assessment ratings. The discriminant validity between deep and surface was good for the SPQ, but not for either the interview or the written assessment. The findings indicate the deep and surface scales of the SPQ adequately measure the underlying deep and surface constructs. The retest reliability of the SPQ was then examined utilising Spearman’s Rho to assess the rank-order correlations with a sample of third-year students (n=87). Over a period of three months there were significant correlations for the surface motive, surface strategy, deep strategy, achieving motive and achieving strategy subscales of the SPQ, suggesting good reliability for these subscales. The results at the scale level of the SPQ result in similar conclusions. There was a moderate significant correlation for the surface, deep and achieving scales of the SPQ, suggesting the scales have good reliability over a period of three months. There was also a moderate significant correlation for the surface-achieving-motive and deep-achieving scales over a period of three months. The stability of SPQ scores was also assessed utilising a series of one-way repeated measures MANOVA’s with a sample of third-year undergraduates (n = 64). The results suggest some change occurs in self-reported use of approaches to learning between the first and third-years of an undergraduate degree programme. The role of the teaching-learning environment was next examined. Utilising a within-subjects design, undergraduate students (n=48) concurrently enrolled in traditional (viz. lecture and tutorial) and non-traditional (viz. workshops and group projects) subjects completed the SPQ to describe their approaches to learning in each subject. A series of 2x2 repeated measures MANOVA’s were undertaken. The results indicated students were likely to change their approach to learning based on their perceptions of the learning environment (traditional or non-traditional subject). However, those students identified as predominantly surface learners significantly increased their deep scale scores in the non-traditional subject when compared to deep learners. The next study examined a range of personality (locus of control, sensing function, thinking function, intelligence) and demographic variables (age, gender, year of study) to assess which were good predictors of deep and surface approaches to learning. A series of regression analyses identified age, sensing function and locus of control as significant predictors of the surface, surface-achieving-motive, and deep approaches to learning. Locus of control was found to be a significant predictor of the deep-achieving approach to learning. The final study examined the 3P model of learning. Based on the results of earlier studies in the research programme the situational component of the presage factors was not included. The model was examined using structural equation modelling (n= 394). Two initial models were tested using both the three (deep, surface, achieving) and two (surface-achieving-motive and deep-achieving) process factor models. The three process factor model provided the better model fit. The results suggest deep and surface approaches to learning do not mediate between personal characteristics and learning outcomes (i.e. GPA). The results of this series of studies suggest the need for further research into the SPQ and the 3P model of learning. The implications of the research programme are also discussed.

The aim of this research programme was to examine the 3P model of learning (Biggs, 1987a, 1999). The first stage necessarily involved an examination of the Study Process Questionnaire (SPQ) (Biggs, 1987a), an instrument developed to measure the process component of the model. The structure of the SPQ was examined utilising exploratory and confirmatory factor analysis of undergraduate responses (n= 260). The results indicated the higher-order factor structure of deep-achieving and surface-achieving-motive provided the most reliability and a better model fit than either the subscales or scales of the SPQ. The construct validity of the two constructs deep and surface was assessed next using a multitrait-multimethod matrix (MTMM) constructed from the three measures of the self-report questionnaire, interview ratings and written assessments from first-year students (n = 50). The results indicated good convergent validity between the deep scale of the SPQ and the interview ratings on the deep scale, between the deep scale on the SPQ and the written assessment ratings, and between the interview ratings and written assessment ratings. The results indicated good convergent validity between the surface scale on the SPQ and the interview ratings on the surface scale, but not between the surface scale on the SPQ and the written assessment ratings, and between the interview ratings and written assessment ratings. The discriminant validity between deep and surface was good for the SPQ, but not for either the interview or the written assessment. The findings indicate the deep and surface scales of the SPQ adequately measure the underlying deep and surface constructs. The retest reliability of the SPQ was then examined utilising Spearman’s Rho to assess the rank-order correlations with a sample of third-year students (n=87). Over a period of three months there were significant correlations for the surface motive, surface strategy, deep strategy, achieving motive and achieving strategy subscales of the SPQ, suggesting good reliability for these subscales. The results at the scale level of the SPQ result in similar conclusions. There was a moderate significant correlation for the surface, deep and achieving scales of the SPQ, suggesting the scales have good reliability over a period of three months. There was also a moderate significant correlation for the surface-achieving-motive and deep-achieving scales over a period of three months. The stability of SPQ scores was also assessed utilising a series of one-way repeated measures MANOVA’s with a sample of third-year undergraduates (n = 64). The results suggest some change occurs in self-reported use of approaches to learning between the first and third-years of an undergraduate degree programme. The role of the teaching-learning environment was next examined. Utilising a within-subjects design, undergraduate students (n=48) concurrently enrolled in traditional (viz. lecture and tutorial) and non-traditional (viz. workshops and group projects) subjects completed the SPQ to describe their approaches to learning in each subject. A series of 2x2 repeated measures MANOVA’s were undertaken. The results indicated students were likely to change their approach to learning based on their perceptions of the learning environment (traditional or non-traditional subject). However, those students identified as predominantly surface learners significantly increased their deep scale scores in the non-traditional subject when compared to deep learners. The next study examined a range of personality (locus of control, sensing function, thinking function, intelligence) and demographic variables (age, gender, year of study) to assess which were good predictors of deep and surface approaches to learning. A series of regression analyses identified age, sensing function and locus of control as significant predictors of the surface, surface-achieving-motive, and deep approaches to learning. Locus of control was found to be a significant predictor of the deep-achieving approach to learning. The final study examined the 3P model of learning. Based on the results of earlier studies in the research programme the situational component of the presage factors was not included. The model was examined using structural equation modelling (n= 394). Two initial models were tested using both the three (deep, surface, achieving) and two (surface-achieving-motive and deep-achieving) process factor models. The three process factor model provided the better model fit. The results suggest deep and surface approaches to learning do not mediate between personal characteristics and learning outcomes (i.e. GPA). The results of this series of studies suggest the need for further research into the SPQ and the 3P model of learning. The implications of the research programme are also discussed.
Thesis (PhD Doctorate)
Doctor of Philosophy (PhD)
School of Applied Psychology
Full Text