Dissertations / Theses on the topic 'Measurement invariance'
To see the other types of publications on this topic, follow the link: Measurement invariance.
Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles
Consult the top 50 dissertations / theses for your research on the topic 'Measurement invariance.'
Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.
You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.
Browse dissertations / theses on a wide variety of disciplines and organise your bibliography correctly.
1
Wang, Shanshan. "Bayesian Approximate Measurement Invariance Approach." University of Cincinnati / OhioLINK, 2017. http://rave.ohiolink.edu/etdc/view?acc_num=ucin150512542310924.
Full text
2
Foster, Garett C. "Measurement Invariance of Burnout Inventories across Sex." Bowling Green State University / OhioLINK, 2015. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu1428162452.
Full text
3
Carter, Janet A. "Worry and Rumination: Measurement Invariance Across Gender." DigitalCommons@USU, 2010. https://digitalcommons.usu.edu/etd/805.
Full textAbstract:
The present study examined the factor structure of the Penn State Worry Questionnaire (PSWQ), the Student Worry Questionnaire-30 (SWQ-30), the Anxious Thoughts Inventory (AnTI), the Ruminative Responses Scale (RRS), and the Rumination-Reflection Questionnaire (RRQ). The present study also examined the measurement invariance between men (n = 186) and women (n = 316) in a university sample. Different models for each measure were identified through a review of the literature, and the models were examined through confirmatory factor analyses. The best-fitting models for each measure were retained for subsequent model modification to improve fit and for invariance testing across gender. The results of the confirmatory factor analyses and subsequent exploratory models provided general support for invariance in the configural models, but only the RRQ displayed measurement, scalar, and latent mean structure invariance. Results of the bootstrapped regression analyses indicated that summated scores derived from the exploratory models demonstrated different relationships between anxiety and depression in men and women. Frequency of worry, metaworry, and general anxiety symptoms significantly contributed to prediction of anxiety in men, whereas metaworry, social worry, lethargy, general anxiety symptoms, and health worries predicted anxiety in women. Social worry, metaworry, recrimination, and reflection (negatively) contributed to prediction of depression in men, whereas social worry, metaworry, lethargy, general anxiety symptoms, and social adequacy concerns predicted depression in women.
4
Clawson, Robb E. "Youth Disclosure: Examining Measurement Invariance Across Time and Reporter." BYU ScholarsArchive, 2017. https://scholarsarchive.byu.edu/etd/6491.
Full textAbstract:
Measurement invariance across time and reporter is rarely reported in the literature for measures of youth disclosure, even though it is often necessary to establish at least strong invariance before proceeding to further analyses such as comparing means across time or reporter. Measurement invariance was examined across time (ages 11, 14, and 17) and across reporter (youth report of disclosure to mother, youth report of disclosure to father, mother report of youth disclosure, father report of youth disclosure) with a sample of 348 youth and their parents. Youth report of disclosure to mothers demonstrated strong invariance across ages 11-14 and 14-17, but strong equivalence was not found for mother report over time across any age. Youth report of disclosure to mothers and fathers demonstrated strong equivalence at ages 11, 14, 17, and across ages 11-14-17. Mother and father reports also demonstrated strong equivalence at ages 11, 14, and 17. The item "I talk with my parent about how I am doing with school work" had lower factor loadings and higher intercepts at age 11 than at other ages for fathers and mothers and compared to youth report. Implications for youth disclosure theory and construct development are discussed.
5
Dunbar-Isaacson, Hazel. "An investigation into the measurement invariance of the performance index." Thesis, Link to the online version, 2006. http://hdl.handle.net/10019/534.
Full text
6
Chen, Danxia. "Eastern Work Ethic: Structural Validity, Measurement Invariance, and Generational Differences." Thesis, University of North Texas, 2014. https://digital.library.unt.edu/ark:/67531/metadc500082/.
Full textAbstract:
This present study examined the structural validity of a Chinese version of Multidimensional Work Ethic Profile (MWEP-C), using a large sample of Chinese parents and their young adult children (N = 1047). Confirmatory factor analysis (CFA) was applied to evaluate the model fit of sample data on three competing models using two randomly split stratified subsamples. Measurement invariance for these two generational respondents was checked using differential item functioning (DIF) analysis. The results indicated that MWEP-C provided a reasonable fit for the sample data and the majority of survey items produced similar item-level responses for individuals that do not differ on the attributes of work ethic across these two generations. DIF items were detected based on advanced and successive iterations. Monte Carlo simulations were also conducted for creating threshold values and for chi-square probabilities based on 1,000 replications. After identifying the DIF items, model fit improved and generational differences and similarities in work ethic between parents and their young adult children were also identified. The results suggested that the younger Chinese generations have higher work ethic mean scores on the dimensions of work centrality and morality/ethics while they have similarities on time concept, self-reliance, delay of gratification, and hard work as their parents.
7
LaBat, Lauren, Heidi M. Kuehn, John P. Meriac, and C. Allen Gorman. "Race and Gender Differences in Regulatory Focus: Examining Measurement Invariance." Digital Commons @ East Tennessee State University, 2015. https://dc.etsu.edu/etsu-works/423.
Full textAbstract:
We investigated race and gender differences in regulatory focus, which distinguishes between two modes of motivational regulation: promotion and prevention focus. Item response theory was used to examine measurement equivalence/invariance and mean differences across groups were examined. Several items functioned differently across groups, but differences cancelled out at the test-level. Analyses using an undergraduate student sample (N = 1,845) revealed that females were significantly more promotion and prevention focused than males and African Americans were significantly more promotion and prevention focused than Caucasians. Interestingly, both gender and racial minority groups scored higher on regulatory focus indicators than the majority groups. Arguably, unlike minority group members, majority group members would have less of a necessity to prevent failure or to promote their own success. Implications for these motivation regulation differences can be applied to workforce settings in which managers seek to provide equal opportunities for both genders and racial groups.
8
Duku, Eric K. "Assessing Early Child Development: Issues of Measurement Invariance and Psychometric Validity." Thèse, Université d'Ottawa / University of Ottawa, 2013. http://hdl.handle.net/10393/24097.
Full textAbstract:
The measurement of reliable and valid indicators of early child development is necessary for assessing phenomena and is useful in the monitoring of ongoing efforts to eradicate inequalities in the social determinants of health. There is an increasing awareness of the contextual, cultural, and developmental influences on constructs used in early child development (ECD) research. Using a measurement perspective, this dissertation examined the issue of measurement invariance and psychometric validity in early child development research. A construct violates the principle of invariance when two persons from different populations who are theoretically identical on the construct being measured have different scores on it.
This dissertation consists of three journal-style manuscripts (published or under review) that were used as examples to address the importance of the issue of measurement invariance and psychometric validity in ECD research using data from two unique areas: autism and executive functioning. The three data sets were collected on pre-school children with parents and or teachers as informants and were chosen to represent different levels of data collection – clinical, community, and population. These data sets allowed for the examination of measurement invariance by type of informant, sex, and age of child. The results from the three studies illustrate the importance of assessing measurement invariance in ECD and whether or not the instruments examined can be used to assess sub-group differences with confidence.
A lack of measurement invariance found for two of the studies, suggests that observed group differences in latent constructs could be attributed, in part, to measurement bias. More importantly, bias in the measurement of the constructs of severity of social impairment symptoms in autism, and executive functioning across groups could have an impact on services such as patient treatment. These biases could also influence public policy development, particularly when there may be an underlying need for a cross-group approach where belief systems may affect the meaning and structure of constructs.
In summary, measurement invariance should be a prerequisite for making any meaningful comparisons across groups. A requirement of establishing measurement invariance should be included in the guidelines for comparative research studies as a necessary first step before an instrument is adopted for use.
9
Clark, Jonathan Caleb. "Evaluating Model Fit for Longitudinal Measurement Invariance with Ordered Categorical Indicators." BYU ScholarsArchive, 2020. https://scholarsarchive.byu.edu/etd/8725.
Full textAbstract:
Current recommended cutoffs for determining measurement invariance have typically derived from simulation studies that have focused on multigroup confirmatory factor analysis, often using continuous data. These cutoffs may be inappropriate for ordered categorical data in a longitudinal setting. This study conducts two Monte Carlo studies that evaluate the performance of four popular model fit indices used to determine measurement invariance. The comparative fit index (CFI), Tucker-Lewis Index (TLI), and root mean square error of approximation (RMSEA) were all found to be inconsistent across various simulation conditions as well as invariance tests, and thus were not recommended for use in longitudinal measurement invariance testing. The standardized root mean square residual (SRMR) was the most consistent and robust fit index across simulation conditions, and thus we recommended using ≥ 0.01 as a cutoff for determining longitudinal measurement invariance with ordered categorical indicators.
10
Arneill-Py, Ann. "Measurement invariance of the Mental Health Statistics Improvement Program Consumer Survey /." For electronic version search Digital dissertations database. Restricted to UC campuses. Access is free to UC campus dissertations, 2004. http://uclibs.org/PID/11984.
Full text
11
Wang, Yan. "Covariates in Factor Mixture Modeling: Investigating Measurement Invariance across Unobserved Groups." Scholar Commons, 2018. https://scholarcommons.usf.edu/etd/7715.
Full textAbstract:
Factor mixture modeling (FMM) has been increasingly used to investigate unobserved population heterogeneity. This Monte Carlo simulation study examined the issue of measurement invariance testing with FMM when there are covariate effects. Specifically, this study investigated the impact of excluding and misspecifying covariate effects on the class enumeration and measurement invariance testing with FMM. Data were generated based on three FMM models where the covariate had impact on the latent class membership only (population model 1), both the latent class membership and the factor (population model 2), and the latent class membership, the factor, and one item (population model 3). The number of latent classes was fixed at two. These two latent classes were distinguished by factor mean difference for conditions where measurement invariance held in the population, and by both factor mean difference and intercept differences across classes when measurement invariance did not hold in the population.
For each of the population models, different analysis models that excluded or misspecified covariate effects were fitted to data. Analyses consisted of two parts. First, for each analysis model, class enumeration rates were examined by comparing the fit of seven solutions: 1-class, 2-class configural, metric, and scalar, and 3-class configural, metric, and scalar. Second, assuming the correct solution was selected, the fit of analysis models with the same solution was compared to identify a best-fitting model. Results showed that completely excluding the covariate from the model (i.e., the unconditional model) would lead to under-extraction of latent classes, except when the class separation was large. Therefore, it is recommended to include covariate in FMM when the focus is to identify the number of latent classes and the level of invariance. Specifically, the covariate effect on the latent class membership can be included if there is no priori hypothesis regarding whether measurement invariance might hold or not. Then fit of this model can be compared with other models that included covariate effects in different ways but with the same number of latent classes and the same level of invariance to identify a best-fitting model.
12
Koommoo-Welch, Penny. "Measurement Invariance in Performance Appraisal Ratings of US Army Special Forces Soldiers." NCSU, 2005. http://www.lib.ncsu.edu/theses/available/etd-03252005-021113/.
Full textAbstract:
The purpose of the present study was to examine the equivalence of mental models of job performance between rater groups among US Army Special Forces Soldiers. Performance appraisals are often completed in organizations by individual raters, whose ratings are then compared to one another in order to make inferences of the ratee?s performance on the job. Disagreements in ratings can lead to erroneous conclusions unless it is first established that comparisons between the rater groups are appropriate. Ratings of soldiers by two supervisory rater groups (N = 1052 and N = 910) on an appraisal instrument designed specifically for the Special Forces were examined. An exploratory factor analysis of the ratings indicated a four-factor model, which was then subsequently used to test for measurement invariance between the rater groups using multiple-group confirmatory factor analysis and item response theory. Fit indices indicated reasonable fit of the model, and ratings were concluded to be invariant at the rater group level of analysis, indicating that the rater groups refer to similar mental models of performance when rating individual soldiers.
13
Olson, Brent. "Evaluating the error of measurement due to categorical scaling with a measurement invariance approach to confirmatory factor analysis." Thesis, University of British Columbia, 2008. http://hdl.handle.net/2429/332.
Full textAbstract:
It has previously been determined that using 3 or 4 points on a categorized response scale will fail to produce a continuous distribution of scores. However, there is no evidence, thus far, revealing the number of scale points that may indeed possess an approximate or sufficiently continuous distribution. This study provides the evidence to suggest the level of categorization in discrete scales that makes them directly comparable to continuous scales in terms of their measurement properties. To do this, we first introduced a novel procedure for simulating discretely scaled data that was both informed and validated through the principles of the Classical True Score Model. Second, we employed a measurement invariance (MI) approach to confirmatory factor analysis (CFA) in order to directly compare the measurement quality of continuously scaled factor models to that of discretely scaled models. The simulated design conditions of the study varied with respect to item-specific variance (low, moderate, high), random error variance (none, moderate, high), and discrete scale categorization (number of scale points ranged from 3 to 101). A population analogue approach was taken with respect to sample size (N = 10,000). We concluded that there are conditions under which response scales with 11 to 15 scale points can reproduce the measurement properties of a continuous scale. Using response scales with more than 15 points may be, for the most part, unnecessary. Scales having from 3 to 10 points introduce a significant level of measurement error, and caution should be taken when employing such scales. The implications of this research and future directions are discussed.
14
Xin, Xin. "Using Posterior Predictive Checking of Item Response Theory Models to Study Invariance Violations." Thesis, University of North Texas, 2017. https://digital.library.unt.edu/ark:/67531/metadc984130/.
Full textAbstract:
The common practice for testing measurement invariance is to constrain parameters to be equal over groups, and then evaluate the model-data fit to reject or fail to reject the restrictive model. Posterior predictive checking (PPC) provides an alternative approach to evaluating model-data discrepancy. This paper explores the utility of PPC in estimating measurement invariance. The simulation results show that the posterior predictive p (PP p) values of item parameter estimates respond to various invariance violations, whereas the PP p values of item-fit index may fail to detect such violations. The current paper suggests comparing group estimates and restrictive model estimates with posterior predictive distributions in order to demonstrate the pattern of misfit graphically.
15
Govan, Gregory D. "Mental Health Screeners in Elementary Schools| Measurement Invariance across Racial and Ethnic Groups." Thesis, University of Nevada, Reno, 2018. http://pqdtopen.proquest.com/#viewpdf?dispub=10685645.
Full textAbstract:
Mental health screeners need to demonstrate measurement equivalence across the populations of their intended use in order to improve the fairness in the identification of students in need of social, emotional, and behavioral supports. This study examined measurement invariance on three mental screeners across five racial and ethnic groups. The Elementary Social Behavior Assessment measures academic enablers associated with the latent construct of teachability (ESBA). The Student Risk Screening Scale assesses externalizing problems (SRSS) and the Student Internalizing Behavior Screener measures internalizing problems (SIBS). Multigroup confirmatory factor analyses tested for measurement invariance from the sample of African American (18%), Asian American/Pacific Islander (13%), Latino Hispanic (25%), European American (31%), and multiracial (11%) groups of students in elementary schools. Only the ESBA required respecification to establish an adequate baseline model. The ESBA, SRSS, and SIBS demonstrated metric invariance with ordinal ratings of never, occasionally, sometimes, and frequently in addition to scalar invariance with the thresholds between the ordinal ratings. Thus, the total scores from the ESBA, SRSS, and SIBS generalize across racial and ethnic groups and the student’s race or ethnicity is less likely to mask their true level of need for social, emotional, and behavioral supports. The results indicate that the ESBA, SRSS, and SIBS may help teachers to identify racially and ethnically students who need intervention, to customize the interventions, and to evaluate students’ response to intervention. Schools using these mental health screeners may reduce disproportionality in discipline and special education.
16
Wirth, R. J. Curran Patrick J. "The effects of measurement non-invariance on parameter estimation in latent growth models." Chapel Hill, N.C. : University of North Carolina at Chapel Hill, 2008. http://dc.lib.unc.edu/u?/etd,2060.
Full textAbstract:
Thesis (Ph. D.)--University of North Carolina at Chapel Hill, 2008.Title from electronic title page (viewed Feb. 17, 2009). "... in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Department of Psychology." Discipline: Psychology; Department/School: Psychology.
17
Herst, David Evan Loran. "Cross-Cultural Measurement Invariance Of Work/Family Conflict Scales Across English-Speaking Samples." [Tampa, Fla.] : University of South Florida, 2003. http://purl.fcla.edu/fcla/etd/SFE0000181.
Full text
18
Vanhille, Sean B. "Y-BOCS Factor Structure Analysis and Calculation of Measurement and Structural Invariance Between Genders." BYU ScholarsArchive, 2019. https://scholarsarchive.byu.edu/etd/8479.
Full textAbstract:
The Yale-Brown Obsessive-Compulsive Scale (Y-BOCS) is considered the “gold standard” for measuring symptoms for Obsessive-Compulsive Disorder (OCD) due to the high reliability and validity of the measure. Originally, the Y-BOCS was divided into Obsessive and Compulsive factors; however, literature on the factor structure of the Y-BOCS is inconsistent. Models range from one global factor to different interpretations of bi-factor models to three-factor models. Inconsistencies between models may be attributed to sampling error, including participants with subclinical OCD in some samples, and measurement error. In addition, many researchers treat the Y-BOCS measurement as an interval or ratio scale when it likely reflects ordinal measurement. Our paper has two primary aims. First, we compare the fit of the models proposed in the literature using a large sample from multiple sites of patients diagnosed with OCD. We also evaluate how the models can be improved and whether those improvements show evidence for convergent validity. We treat the Y-BOCS observations as ordinal data. Second, we evaluate measurement and structural invariance between genders. Additionally, we examine convergent validity of the factor structure of the best fitting model with subscales of the OCI-R. Data from five separate samples were combined into one dataset with 288 total participants all formally diagnosed with OCD. We selected several Y-BOCS factor models from the literature and used confirmatory factor analysis to evaluate goodness of fit indices on our pooled sample. Only one model approached acceptable goodness of fit indices. We considered the factors in this model and proposed a new factor model with a global factor (OCD) and two sub-factors (Obsessions and Resistance to Symptoms). Our model exhibited the highest goodness of fit indices which we further improved with modifications to our factor model. On invariance analyses, our model exhibited measurement invariance between genders and partial structural invariance. Additionally, the latent factors of our model exhibited convergent validity with all of the OCI-R subscales (except Ordering). Our model exhibited stronger goodness of fit indices with our data than existing models in the Y-BOCS literature and measurement invariance and partial structural invariance between genders. We recommend that future studies replicate the efficacy of our factor model using the Y-BOCS as an ordinal measurement.
19
Sanguras, Laila Y. "Construct Validation and Measurement Invariance of the Athletic Coping Skills Inventory for Educational Settings." Thesis, University of North Texas, 2017. https://digital.library.unt.edu/ark:/67531/metadc984216/.
Full textAbstract:
The present study examined the factor structure and measurement invariance of the revised version of the Athletic Coping Skills Inventory (ACSI-28), following adjustment of the wording of items such that they were appropriate to assess Coping Skills in an educational setting. A sample of middle school students (n = 1,037) completed the revised inventory. An initial confirmatory factor analysis led to the hypothesis of a better fitting model with two items removed. Reliability of the subscales and the instrument as a whole was acceptable. Items were examined for sex invariance with differential item functioning (DIF) using item response theory, and five items were flagged for significant sex non-invariance. Following removal of these items, comparison of the mean differences between male and female coping scores revealed that there was no significant difference between the two groups. Further examination of the generalizability of the coping construct and the potential transfer of psychosocial skills between athletic and academic settings are warranted.
20
Davis, Samantha. "The measurement invariance and measurement equivalence of the sources of work stress inventory (SWSI) across gender groups in South Africa." Thesis, Stellenbosch : Stellenbosch University, 2014. http://hdl.handle.net/10019.1/95741.
Full textAbstract:
Thesis (MCom)--Stellenbosch University, 2014.You will be needing the program SPSS in order to read the .spv files
ENGLISH ABSTRACT: The primary goal of an organisation, in a capitalistic system, is the maximisation of profit. The task of the human resource function in organisations is to affect the work performance of working man to the advantage of the organisation and in a manner that adds value to the organisation. The management of employee wellbeing/psychological health is one of the human resource interventions with which the human resource function pursues this objective. It is imperative for organisations to be aware of, and sensitive to, negative factors in the workplace, such as occupational stress, that influence employees’ health and wellbeing and have a significant effect on job satisfaction and performance (Hamidi & Eivazi, 2010). Prevailing stress levels need to be monitored regularly if escalating stress levels are to be detected in time to prevent serious personal and organisational problems from developing. The Sources of Work Stress Inventory (SWSI) is an instrument developed in South Africa specifically for this purpose (De Bruin & Taylor, 2005). The inappropriate use of occupational stress assessments across genders can seriously jeopardize the extent to which occupational stress assessments, and the decisions based on them, achieve their intended objectives. In order to avoid making widespread generalisations and untested assumptions which will eventually do a disservice to the field of psychology, the absence of measurement bias (i.e. invariance and equivalence) should be demonstrated instead of simply assumed (Van de Vijver & Tanzer, 2004). Establishing the measurement invariance and equivalence of an instrument across groups should be a prerequisite to conducting substantive cross-group comparisons (Dunbar, Theron & Spangenberg, 2011). It is imperative to empirically ascertain whether the instruments that are used are free of cultural, language, gender, age and racial bias, not only because it is prohibited by the Employment Equity Act 55 of 1998, but also as it is in the interest of good workmanship. Bias is indicated as nuisance factors that threaten the validity of cross-group (cultural) comparisons (Van de Vijver & Leung, 1997). These nuisance factors could be due to construct bias, method bias and/or item bias. Due to the importance of the decisions made, it would seem essential that the information provided by test results apply equally across different reference groups. In this study the specific measurement invariance and equivalence sequence of tests set out by Dunbar et al. (2011) was used to answer a sequence of research questions that examine the extent to which the SWSI multi-group measurement model may be considered measurement invariant and equivalent or not, and to determine the source of variance if it existed (Vandenberg & Lance, 2000). Upon investigating the measurement model fit of the SWSI, the results indicated that support was found for the hypotheses that the measurement model fits the data of both gender samples independently. Furthermore, support was found for the configural and weak invariance model. However, due to not meeting the requirements for metric equivalence, partial measurement invariance and equivalence was explored. The SWSI multi-group measurement model met the requirements of partial complete invariance and partial full equivalence, and the non-invariant items were identified in the process. The implications of the results are discussed, limitations are indicated and areas for further research are highlighted.
AFRIKAANSE OPSOMMING: Die kerndoelwit van enige organisasie, veral in ‘n kapitalistiese stelsel, is om optimale wins te genereer. Die taak van die menslike hulpbronbestuurfunksie binne organisasies is om die werksverrigting van die werkende mens te beïnvloed tot voordeel van die organisasie en terselfdetyd waarde tot die organisasie toe te voeg. Die bestuur van ‘n werknemer se welstand / sielkundige gesondheid is een van die menslike hulpbron-iintervensies waarmee die menslike hulpbronfunksie hierdie doelwit nastreef. Dit is uiters belangrik vir organisasies om bewus te wees van, asook sensitief te wees vir, negatiewe faktore soos werkstres, wat werknemers se gesondheid en welsyn beïnvloed en wat 'n beduidende invloed op werkstevredenheid en prestasie het (Hamidi & Eivazi, 2010). Heersende stresvlakke moet gereeld gemonitor word om tydig stygende stresvlakke te bespeur ten einde ernstige persoonlike en organisasieverwante probleme te verhoed. Die Bronne van die Werkstres-inventaris (BWSI) is in Suid-Afrika spesifiek vir hierdie doel ontwikkel (De Bruin & Taylor, 2005). Die ontoepaslike gebruik van werkstresmetings oor geslagte kan egter die mate waartoe beroepstresmetings en die besluite wat daarop gebaseer word hul oogmerke bereik ernstig benadeel. Die afwesigheid van metingsydigheid (bv. invariansie en ekwivalensie) moet dus empiries gedemonstreer word, in stede daarvan dat die afwesigheid daarvan eenvoudig aanvaar word (Van de Vijver & Tanzer, 2004). Die afwesigheid van hierdie informasie kan lei tot wydverspreide veralgemenings en ongetoetsde aannames wat die Sielkunde professie ernstige skade kan berokken. Die meetings-invariansie en -ekwivalensie van 'n instrument oor groepe is 'n voorvereiste vir substantiewe kruis-groepvergelykings (Dunbar, Theron & Spangenberg, 2011). Dit is noodsaaklik om empiries te bepaal of die instrumente wat gebruik is vry is van kulturele-, taal, geslag-, ouderdom- en rasse-sydigheid, nie net omdat dit verbied word deur die Wet op Diensbillikheid 55 van 1998 nie, maar ook omdat dit in die belang van goeie vakmanskap is. Sydigheid is sistermatiese steurnisse wat die geldigheid van die kruis-groep (kulturele) vergelykings (Van de Vijver & Leung, 1997) bedreig. Hierdie steurnisse kan wees as gevolg van konstruk-, metode- en/of itemsydigheid. Gegewe die belangrikheid van die besluite wat geneem word gebaseer op die metings is dit noodsaaklik dat die inligting vergelykbaar oor die verskillende verwysingsgroepe is. Die studie het die stel metingsinvariansie en -ekwivalensie toetse wat deur Dunbar et al. (2011) gebruik om 'n reeks van navorsingsvrae te beantwoord. Daar is ondersoek gestel na die mate waartoe die BWSI multi-groep metingsmodel as invariant of ekwivalent beskou kan word, en die bron van variansie te bepaal as dit sou bestaan (Vandenberg & Lance, 2000). In die ondersoek na die metingsmodel passing van die BWSI, is daar ondersteuning gevind is vir die hipoteses dat die metingsmodel beide van die geslagsteekproewe goed pas. Steun is ook gevind vir die konfigurale en swak invariansie modelle. Aangesien slegs beperkte steun vir metriese ekwivalensie gevind is, is ondersoek na die parsiële metriese invariansie en ekwivalensie ingestel. Die BWSI multi-groep metingsmodel het voldoen aan die vereistes van parsiële volledige invariansie en parsiële volle ekwivalensie, en die nie-invariante items is deur die proses geïdentifiseer. Die implikasies van die resultate word bespreek, beperkinge word aangedui en areas vir verdere navorsing word uitgelig.
21
Bedford, Lee. "Measurement Invariance of a Posttraumatic Stress Disorder Symptoms Measure (PCL-5) in College Student and Amazon's Mechanical Turk Samples." Thesis, University of North Texas, 2020. https://digital.library.unt.edu/ark:/67531/metadc1707346/.
Full textAbstract:
College student and Amazon's Mechanical TURK (MTURK) samples are regularly utilized in trauma research. Recent literature, however, has criticized these samples for not being generalizable to the general U.S. population. Measurement invariance (MI) using confirmatory factor analyses (CFA), is rarely utilized in trauma research, even though the analysis can determine whether groups are invariant across factor structure, factor loadings, item intercepts, and residual error variances on a given measure of PTSD symptom severity. The purpose of this study was to determine whether college student (n = 255) and MTURK (n = 316) samples are invariant on the PCL-5. Model fit indices indicated the 7-factor Hybrid model was the best fitting model, but the 6-factor anhedonia model was the most parsimonious model. Both models demonstrated equivalence in factor structures (configural invariance), factor loadings (metric invariance), intercepts (scalar invariance), and residuals (strict invariance), indicating MTURK and college student samples are similar in regards to PTSD symptom severity. These findings provide evidence that these groups can be combined in future studies to increase sample size for trauma research. Only the Anhedonia factor exhibited mean differences between groups, which may be related to true differences between college students and MTURK survey-takers. Thus, there is further evidence that the findings from trauma studies using these populations are generalizable to each other.
22
Chen, Yu-Ling. "Measurement invariance across cultures a comparison between Chinese adolescents in China and in United States /." online access from Digital Dissertation Consortium, 2007. http://libweb.cityu.edu.hk/cgi-bin/er/db/ddcdiss.pl?1443900.
Full text
23
Caycho-Rodríguez, Tomás, Patricia Sancho, José M. Tomás, Renzo Felipe Carranza Esteban, José Ventura-León, Felix Neto, Mario Reyes-Bossio, and Isabel Cabrera-Orosco. "Validity and invariance of measurement of the satisfaction with love life scale in older adults." South-West University "Neofit Rilski", 2020. http://hdl.handle.net/10757/655588.
Full textAbstract:
In recent years, interest in satisfaction with love life (SWLL) has increased. Empirical evidence demonstrated that SWLL favors subjective well-being, physical and mental health, marital quality and stability. In this regard, the study aimed to examine evidence based on the internal structure validity, reliability, and measurement invariance of the Peruvian version of the Satisfaction with Love Life Scale (SWLLS). The participants were 323 older adults recruited from the region of San Martin (Peru) with an average age of 68.73 years (SD = 7.17). The sample comprised of 49.5% women and 50.5% men. The results supported the one-dimensional model and adequate reliability of the SWLLS. A multi-group analysis provided evidence of configural, metric, and scale invariance across genders. The findings verified the validity and reliability of the Peruvian version of the SWLLS, which can be used to measure SWLL.Universidad del Norte
24
Fornito, Matthew C. "A cross-cultural examination of measurement invariance of smallholders in Kenya, Uganda, Mali and Lesotho." Thesis, Virginia Tech, 2014. http://hdl.handle.net/10919/48126.
Full textAbstract:
Cross-cultural research requires tests of measurement invariance to determine if different populations have equivalent latent constructs. A psychometric assessment of the Agricultural Production Perspectives Scale (APPS) was necessary to determine the validity of the scale constructed and whether data from multiple countries could be compared. Using 918 farmers sampled from Kenya, Uganda, Mali, and Lesotho, I conducted exploratory factor analysis and scale reliability tests to determine whether the item loadings and factors were equivalent across populations. No factor structure could be obtained across country or agroecological populations. The data were reanalyzed within each agroecology to determine localized factor structures. Results indicate that a market driven factor and agrarian driven factor tend to emerge across multiple agroecologies suggesting some emergence of latent variables. Recommendations for scale revisions are included to increase reliability and measurement invariance.Master of Science
CCRA-8 (Technology Networks for Sustainable Innovation)
25
Haeny, Angela M., Jacqueline Woerner, Cassie Overstreet, Terrell A. Hicks, Manik Ahuja, Ananda Amstadter, and Carolyn E. Sartor. "Measurement Invariance of the World Assumptions Questionnaire across Race/Ethnic Group, Sex, and Sexual Orientation." Digital Commons @ East Tennessee State University, 2021. https://doi.org/10.1037/tra0001001.
Full textAbstract:
Objective: The World Assumptions Questionnaire (WAQ) was developed to assess optimism and assumptions about the world, which often shift after traumatic events. However, no known study has investigated whether the WAQ holds similar meaning across demographic groups. The objective of this study was to investigate measurement invariance of the WAQ across race/ethnic group, sex, and sexual orientation. Method: Participants consisted of 1,181 college students (75% female; 25% Black, 13% Latinx, 18% Asian, 45% White; 90% heterosexual) who completed an online survey on stress, personality, substance use, and mental health. We investigated a unidimensional and the 4-factor structure of the WAQ using confirmatory factor analysis, and configural, metric, and scalar invariance using multigroup confirmatory factor analysis. Results: After dropping 3 items, a 4-factor structure fit the data well (comparative fit index = .92; root mean square error of approximation =.05; 95% confidence interval [.045, .054]; standardized root mean square residual = .06). Mean WAQ scores were higher for participants with probable posttraumatic stress disorder on 2 of the 4 factors. We also identified multiple items that were not invariant across race/ethnic group, sex, and sexual orientation. However, after invariant items were removed, evidence of configural, scalar, and metric invariance was found. Conclusions: This study replicated the 4-factor structure, mapping onto the 4 WAQ subscales, and indicated that a unidimensional measure of world assumptions should not be used. After making the adjustments recommended herein, the WAQ can be used to investigate differences across race/ethnic group, sex, and sexual orientation.
26
Gower, Kim. "MULTISOURCE FEEDBACK LEADERSHIP RATINGS: ANALYZING FOR MEASUREMENT INVARIANCE AND COMPARING RATER GROUP IMPLICIT LEADERSHIP THEORIES." VCU Scholars Compass, 2012. http://scholarscompass.vcu.edu/etd/342.
Full textAbstract:
This research outlines a conceptual framework and data analysis process to examine multisource feedback (MSF) rater group differences from a leadership assessment survey, after testing the measures for equivalence. MSF gathers and compares ratings from supervisors, peer, followers and self and is the predominant leadership assessment tool in the United States. The results of MSF determine significant professional outcomes such as leadership development opportunities, promotions and compensation. An underlying belief behind the extensive use of MSF is that each rater group has a different set of implicit leadership theories (ILTs) they use when assessing the leader, and therefore each group is able to contribute unique insight. If this is true, research findings would find rater group consistency in leadership assessment outcomes, but they do not. A review of group comparison research reveals that most empirical MSF studies fail to perform preliminary data exploration, employ consistent models or adequately test for measurement equivalence (ME); yet industry standards strongly suggest exploratory methods whenever data sets undergo changes, and misspecified models cause biased results. Finally, ME testing is critical to ascertain if rater groups have similar conceptualizations of the factors and items in an MSF survey. If conceptual ME is not established, substantive group comparisons cannot be made. This study draws on the extant MSF, ILT and ME literature and analyzes rater group data from a large, application-based MSF leadership database. After exploring the data and running the requisite MI tests, I found that the measures upheld measurement invariance and were suitable for group comparison. Additional MI tests for substantive hypotheses support found that significant mean differences did exist among certain rater groups and dimensions, but only direct report and peer groups were consistently significantly different in all four dimensions (analytical, interpersonal, courageous and leadership effectiveness). Additionally, the interpersonal dimension was the most highly correlated with leadership effectiveness in all five rater groups. The overall findings of this study address the importance of MSF data exploration, offer alternative explanations to the disparate leadership MSF research findings to date and question the application use of MSF tools in their current form.
27
Green, Kat Tumblin. "Establishing Measurement Invariance of Thin Ideal Internalization and Body Dissatisfaction Across Studies: An Integrative Data Analysis." BYU ScholarsArchive, 2013. https://scholarsarchive.byu.edu/etd/4240.
Full textAbstract:
With increased data sharing and research collaboration options available through modern technology, there is an increased need to find more advanced techniques to analyze data across multiple studies. A systematic method of pooling participant-level versus study-level data would be particularly valuable as it would allow for more complex statistical analyses, broader assessment of constructs, and a cost effective way to examine new questions and replicate previous findings. One notable difficulty in pooling raw data in the behavioral sciences is the heterogeneity in methodologies and consequent need to establish measurement invariance. The present study explores the feasibility of using Integrative Data Analysis (IDA) to combine 10 heterogeneous eating disorder prevention data sets and establish measurement invariance across the constructs of thin ideal internalization and body dissatisfaction. Using standard multiple groups factor analysis and likelihood-ratio tests to examine differential item functioning, separate one-factor models were established for the three measures used across studies. Partial measurement invariance was established for all measures. Implications for future IDA studies based on this process are discussed, particularly regarding the clinical impact of measurement invariance.
28
Kromash, Rachelle, Shania L. Siebert, Hannah G. Mitchell, Kelly E. Moore, and Meredith K. Ginley. "A Replication of Measurement Invariance Across Gender of the 36-Item Difficulties in Emotion Regulation Scale." Digital Commons @ East Tennessee State University, 2021. https://dc.etsu.edu/etsu-works/8888.
Full text
29
Nguyen, Diep Thi. "Statistical Models to Test Measurement Invariance with Paired and Partially Nested Data: A Monte Carlo Study." Scholar Commons, 2019. https://scholarcommons.usf.edu/etd/7869.
Full textAbstract:
While assessing emotions, behaviors or performance of preschoolers and young children, scores from adults such as parent psychiatrist and teacher ratings are used rather scores from children themselves. Data from parent ratings or from parents and teachers are often nested such as students are within teachers and a child is within their parents. This popular nested feature of data in educational, social and behavioral sciences makes measurement invariance (MI) testing across informants of children methodologically challenging. There was lack of studies that take into account the nested structure of data in MI testing for multiple adult informants, especially no simulation study that examines the performance of different models used to test MI across different raters.
This dissertation focused on two specific nesting data types in testing MI between adult raters of children: paired and partial nesting. For the paired data, the independence assumption of regular MI testing is often violated because the two informants (e.g., father and mother) rate the same child and their scores are anticipated to be related or dependent. The partial nesting data refers to the research situation where teacher and parent ratings are compared. In this scenario, it is common that each parent has only one child to rate while each teacher has multiple children in their classroom. Thus, in case of teacher and parent ratings of the same children, data are repeated measures and also partially nested. Because of these unique features of data, MI testing between adult informants of children requires statistical models that take into account different types of data dependency. I proposed and evaluated the performance of the two statistical models that can handle repeated measures and partial nesting with several simulated research scenarios in addition to one commonly used and one potentially appropriate statistical models across several research scenario. Results of the two simulation studies in this dissertation showed that for the paired data, both multiple-group confirmatory factor analysis (CFA) and repeated measure CFA models were able to detect scalar invariance most of the time using Δχ2 test and ΔCFI. Although the multiple-group CFA (Model 2) was able to detect scalar invariance better than the repeated measure CFA model (Model 1), the detection rates of Model 1 were still at the high level (88% - 91% using Δχ2 test and 84% - 100% using ΔCFI or ΔRMSEA). For configural invariance and metric invariance conditions for the paired data, Model 1 had higher detection rate than Model 2 in almost examined research scenario in this dissertation. Particularly while Model 1 could detect noninvariance (either in intercepts only or in both intercepts and factor loadings) than Model 2 for paired data most of the time, Model 2 could rarely catch it if using suggested cut-off of 0.01 for RMSEA differences. For the paired data, although both Models 1 and 2 could be a good choice to test measurement invariance, Model 1 might be favored if researchers are more interested in detecting noninvariance due to its overall high detection rates for all three levels (i.e. configural, metric, and scalar) of measurement invariance. For scalar invariance with partially nested data, both multilevel repeated measure CFA and design-based multilevel CFA could detect invariance most of the time (from 81% to 100% of examined cases) with slightly higher detection rate for the former model than the later. Multiple-group CFA model hardly detect scalar invariance except when ICC was small. The detection rates for configural invariance using Δχ2 test or Satorra-Bentler LRT were also highest for Model 3 (82% to 100% except only two conditions with detection rates of 61%), following by Model 5 and lowest Model 4. Models 4 and 5 could reach these rates only with the largest sample sizes (i.e., large number of cluster or large cluster size or large in both factors) when the magnitude of noninvariance was small. Unlike scalar and configural invariance, the ability to detect metric invariance was highest for Model 4, following by Model 5 and lowest for Model 3 across many conditions using all of the three performance criteria. As higher detection rates for all configural and scalar invariance, and moderate detection rates for many metric invariance conditions (except cases of small number of clusters combined with large ICC), Model 3 could be a good candidate to test measurement invariance with partially nested data when having sufficient number of clusters or if having small number of clusters with small ICC. Model 5 might be also a reasonable option for this type of data if both the number of clusters and cluster size were large (i.e., 80 and 20, respectively), or either one of these two factors was large coupled with small ICC. If ICC is not small, it is recommended to have a large number of clusters or combination of large number of clusters and large cluster size to ensure high detection rates of measurement invariance for partially nested data. As multiple group CFA had better and reasonable detection rates than the design-based and multilevel repeated measure CFA models cross configural, metric and scalar invariance with the conditions of small cluster size (10) and small ICC (0.13), researchers can consider using this model to test measurement invariance when they can only collect 10 participants within a cluster (e.g. students within a classroom) and there is small degree of data dependency (e.g. small variance between clusters) in the data.
30
Rademacker, Jonas. "Evaluation of the LHCb RICH detectors and a measurement of the CKM angle #gamma#." Thesis, University of Oxford, 2001. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.365334.
Full text
31
Brace, Jordan. "Type I error rates and power of robust chi-square difference tests in investigations of measurement invariance." Thesis, University of British Columbia, 2015. http://hdl.handle.net/2429/54538.
Full textAbstract:
A Monte Carlo simulation study was conducted to investigate Type I error rates and power of several corrections for non-normality to the normal theory chi-square difference test in the context of evaluating measurement invariance via Structural Equation Modeling (SEM). Studied statistics include: 1) the uncorrected difference test, DML, 2) Satorra’s (2000) original computationally intensive correction, DS0, 3) Satorra and Bentler’s (2001) simplified correction, DSB1, 4) Satorra and Bentler’s (2010) strictly positive correction, DSB10, and 5) a hybrid procedure, DSBH (Asparouhov & Muthén, 2010), which is equal to DSB1 when DSB1 is positive, and DSB10 when DSB1 is negative. Multiple-group data were generated from confirmatory factor analytic models invariant on some but not all parameters. A series of six nested invariance models was fit to each generated dataset. Population parameter values had little influence on the relative performance of the scaled statistics, while level of invariance being tested did. DS0 was found to over-reject in many Type I error conditions, and it is suspected that high observed rejection rates in power conditions are due to a general positive bias. DSB1 generally performed well in Type I error conditions, but severely under-rejected in power conditions. DSB10 performed reasonably well and consistently in both Type I error and power conditions. We recommend that researchers use the strictly positive corrected difference test, DSB10, to evaluate measurement invariance when data are not normally distributed.Arts, Faculty of
Psychology, Department of
Graduate
32
Hinerman, Krystal M. "Construct Validation of the Social-Emotional Character Development Scale in Belize: Measurement Invariance Through Exploratory Structural Equation Modeling." Thesis, University of North Texas, 2014. https://digital.library.unt.edu/ark:/67531/metadc699875/.
Full textAbstract:
Social-emotional learning (SEL) measures assessing social-emotional learning and character development across a broad array of constructs have been developed but lack construct validity. Determining the efficacy of educational interventions requires structurally valid measures which are generalizable across settings, gender, and time. Utilizing recent factor analytic methods, the present study extends validity literature for SEL measures by investigating the structural validity and generalizability of the Social-Emotional and Character Development Scale (SECDS) with a large sample of children from schools in Belize (n = 1877, ages 8 to13). The SECDS exhibited structural and generalizability evidence of construct validity when examined under exploratory structural equation modeling (ESEM). While a higher order confirmatory factor structure with six secondary factors provided acceptable fit, the ESEM six-factor structure provided both substantive and methodological advantages. The ESEM structural model situates the SECDS into the larger body of SEL literature while also exhibiting generalizability evidence over both gender and time.
33
Echeverria, Roy Arnon. "School Engagement: Testing the Factorial Validity, Measurement, Structural and Latent Means Invariance between African American and White Students." Diss., Virginia Tech, 2006. http://hdl.handle.net/10919/30078.
Full textAbstract:
This study was designed to accomplish three main objectives. The first objective was to test the hypothesis that school engagement is a multidimensional construct with three factors: behavioral, emotional, and cognitive or academic engagement. The second objective was to test for invariance of the measurement and factorial structures of school engagement across white and African-American students. And the third objective of the study was to test for invariance of the latent mean structures of school engagement across white and African-American students.
In order to accomplish the objectives of the study a step by step approached, using structural equation modeling, was followed. First, the best fitting model of school engagement for both white and African American students were identified. Second, invariance of the number of underlying factors of school engagement across white and African-American students was tested. Third, invariance of factor loadings across the two racial/ethnic groups was tested. Fourth, invariance of the factor variances and covariances was tested. Fifth, latent mean structures of school engagement between white and African-American were compared. Finally, the results of the calibrating sample were cross-validated with the second half of the sample.
Results from this study produced consistent support for a three-factor model of school engagement and without cross-loadings to other dimensions of school engagement. However, some parameters including factor loadings, factor variances and latent means were found non-invariant across white and African American students. African American students rated themselves statistically significantly higher on emotional engagement than white students. In addition, weaknesses in the measurement model especially the reliability coefficients of observed indicators and variance accounted for by the latent factors were identified. Cognitive engagement proved to be the most difficult to measure among all three dimensions of school engagement. Finally, analysis of the cross-validating sample produced some important differences which included one additional non-invariant factor loading, one factor covariance, and one additional latent mean difference between white and African American students.Ph. D.
34
Cherry, Donna J., and John G. Orme. "Validation Study of a Co-Parenting Scale for Foster Couples." Digital Commons @ East Tennessee State University, 2011. https://dc.etsu.edu/etsu-works/7643.
Full textAbstract:
This study examined the Casey Foster Applicant Inventory-Applicant-Co-Parenting Scale (CFAI-CP), a new scale developed to measure foster parent applicants' co-parenting potential. Also, this study illustrates statistical methods used to analyze the psychometric properties of dyadic data. Factor structure and measurement invariance were tested with 111 approved foster couples. Mplus was used to accommodate ordinal-level data. Exploratory factor analysis supported a 10-item, unidimensional measure with excellent internal consistency reliability (.88 fathers,.89 mothers). Confirmatory factor analysis supported scalar measurement invariance but not structural invariance, as expected. Good construct validity was evident. Findings support the CFAI-CP as an empirically sound measure to assess foster parent co-parenting.
35
Villafañe-García, Sachel M. "Use of Assessments in College Chemistry Courses: Examining Students' Prior Conceptual Knowledge, Chemistry Self-efficacy, and Attitude." Scholar Commons, 2015. https://scholarcommons.usf.edu/etd/5591.
Full textAbstract:
Students' retention in STEM-related careers is of great concern for educators and researchers, especially the retention of underrepresented groups such as females, Hispanics, and Blacks in these careers. Therefore it is important to study factors that could potentially influence students' decision to stay in STEM. The work described in this dissertation involved three research studies where assessments have been used in college chemistry courses to assess students' prior content knowledge, chemistry-self-efficacy, and attitude toward science. These three factors have been suggested to have an influence on students' performance in a course and could eventually be a retention factor.
The first research study involved the development and use of an instrument to measure biochemistry prior knowledge of foundational concepts from chemistry and biology that are considered important for biochemistry learning. This instrument was developed with a parallel structure where three items were used to measure a concept and common incorrect ideas were used as distractors. The specific structure of this instrument allows the identification of common incorrect ideas that students have when entering biochemistry and that can hinder students' learning of biochemistry concepts. This instrument was given as pre/posttest to students enrolled in introductory biochemistry courses. The findings indicated that some incorrect ideas are persistent even after instruction, as is the case for bond energy and the structure of the alpha helix concepts. This study highlights the importance of measuring prior conceptual knowledge; so that instructors can plan interventions to help students overcome their incorrect ideas.
For the second research study, students' chemistry self-efficacy was measured five times during a semester of preparatory college chemistry. Chemistry self-efficacy beliefs have been linked to students' achievement, and students with stronger self-efficacy are more likely to try challenging tasks and persist in them, which will help them to stay in STEM. Using multilevel modeling analysis to examine potential differences in students' self-efficacy beliefs by sex and race/ethnicity, it was found that there were some differences in the trends by race/ethnicity. In particular, we found that for Hispanic and Black males the trends were negative when compared with White males. This study highlights the importance of measuring self-efficacy at different time points in the semester and for instructors to be aware of potential differences in their students' confidence when working on a chemistry task.
The third research study involves the use of the Test of Science Related Attitudes (TOSRA) in an introductory chemistry course. A shortened version of the instrument that includes three scales, normality of scientists, attitude toward inquiry, and career interest in science was used. The first purpose of this study was to gather validity evidence for the internal structure of the instrument with college chemistry students. Using measurement invariance analysis by sex and race/ethnicity, it was found that the internal structure holds by sex, but it did not hold for Blacks in our sample. Further analysis revealed problems with the normality scales for Blacks. The second purpose was to examine the relationship between the scales of TOSRA, achievement in chemistry, and math prior knowledge. Using Structural Equation Modeling (SEM) it was found that two of the TOSRA scales, attitude toward inquiry and career interest in science, have a small but significant influence on students' achievement in chemistry. This study highlights the importance of examining if the scores apply similarly for different group of students in a population, since the scores on these assessments could be used to make decisions that will affect student.
The research studies presented in this work are a step forward with our intention to understand better the factors that can influence students' decisions to stay or leave STEM-related careers. Each study has provided psychometric evidence for the use of three different assessments in college chemistry courses. Instructors can use these assessments in large and small lecture classrooms. Information obtained from these assessments can then be used to make target interventions to help students learn and/or be more confident on a given task. Also, it highlights the importance to look at different group of students, such as the underrepresented groups, since response trends may be different. Being aware of students' diverse needs will help us to understand some of the challenges that student face in the chemistry classroom. Understanding some of these challenges will help instructors be more prepared for teaching.
36
ROSATI, ROSSANA. "Testing cross-national construct equivalence in international surveys. Applications on international civic and citizenship education survey data." Doctoral thesis, Università degli Studi di Milano-Bicocca, 2015. http://hdl.handle.net/10281/95793.
Full textAbstract:
Data collected in international studies enables researchers, educators, and policy makers to compare educational systems regarding several aspects such as student achievement but also different attitudes and beliefs. Such findings are often included in international reports in the form of league tables comparing country averages on different measures and are subject of important country comparisons and subsequent decisions.
Nevertheless the cross-cultural generalizability of attitudinal measures and the possibility of country comparisons cannot be always reached and statistical tests of measurement invariance (MI) must be carried out to ensure meaningful country comparisons and related conclusions.
This dissertation aims to address the issue of MI of attitudinal measures. A case is made for valid country comparisons of measures collected in cross-national surveys by documenting and illustrating with examples the required tests of measurement invariance (MI).
After a comprehensive account of the theoretical groundings of MI in a multiple-group confirmatory analysis (MG-CFA) framework, three nested and consecutively more constraining levels of invariance - configural invariance, metric invariance, and scalar invariance – are discussed and explored. More specifically, by testing a set of three increasingly constrained models measuring the latent concept, we estimate whether model structure in the groups, factor loadings and intercepts are equivalent. Consequently, we establish if comparisons that are made on the latent variable are significant across groups (countries). In agreement with the theory, it is assumed that in order to ensure the highest level of cross-cultural comparability (e.g. comparing country averages), MI testing must confirm the highest level of MI, scalar invariance.
We approach the research topic taking as example the measure of students’ attitudes toward equal rights for immigrants collected in the International Civic and Citizenship Education Study – ICCS conducted by the International Association for the Evaluation of Educational Achievement – IEA in 2009. The methodology is applied both to all European countries and to sub-groups of students such as the non-immigrant/native students in these countries as well as students with an immigrant background. The estimation takes into account the specific properties of data.
The results are discussed both within the sample and sub-samples setting and show that the required level of scalar invariance is not always reached. In particular, in the studied countries, higher levels of construct equivalence seem to be achieved only for the sub-sample of students with an immigrant background. Conclusions and implications for further research and also for reporting and interpreting current research findings are drawn.
37
Walker, Eric C. "The importance of using SEM when studying multiple dimensions of marital satisfaction : measurement invariance across relationship length and gender /." Diss., CLICK HERE for online access, 2009. http://contentdm.lib.byu.edu/ETD/image/etd3008.pdf.
Full text
38
Holtzkamp, Jani Gerda. "Measurement invariance of the second edition of the Fifteen Factor Personality Questionnaire (15FQ+) over different ethnic groups in South Africa." Thesis, Stellenbosch : Stellenbosch University, 2013. http://hdl.handle.net/10019.1/85619.
Full textAbstract:
Thesis (MComm)--Stellenbosch University, 2013.ENGLISH ABSTRACT: Commericial organizations operate in a free-market economic system. The goal of commercial organizations in a free-market economic system is to utilise scarce resources at their disposal to optimally maximise their profits. To achieve this goal, the human resources function is tasked with the responsibility to acquire and maintain a competent and motivated workforce in a manner that would add value to the bottom-line. The human resource management interventions are therefore a critical tool in regulating human capital in such a manner that it optimally adds value to the business. Personality tests are used in the world of work to determine individual differences in behaviour and performance. There was recently a dispute over the effectiveness of the use of personality tests in predicting job performance, but personality is nowadays regarded as a an influential causal antecedent in the prediction of job performance. From the first democratic elections held in 1994, greater demands have been placed on the cultural appropriateness of psychological testing in South Africa. The use of cross-cultural assessments in South Africa are therefore currently very prominent. The use of psychological tests, including personality tests, is now strictly controlled by legislation, including the Employment Equity Act 55 of 1998. In order to make informed decisions, industrial psychologists and registered psychology practitioners need reliable and valid information about the personality construct which will enable them to make accurate predictions on the criterion construct. This argument provides significant justification for the primary purpose of this study, namely an equivalence and invariance study of the second edition of the Fifteen Factor Questionnaire (15FQ +) in a sample of Black, Coloured and White South Africans. Bias in psychological testing can be described as ‘troublesome’ factors that threaten the validity of cross-cultural comparisons across different groups e.g., ethnic groups (Van de Vijver & Leung, 1997). These factors can be caused by construct bias, method bias and/or item bias. It is therefore essential that the information provided by the test results must have the same meaning across all the various reference groups. This assumption necessitates evidence of equivalent and invariant measurements across different groups. Equivalence and invariance in this study is investigated by making use of Dunbar, Theron and Spangenberg (2011)'s proposed steps. Complete measurement invariance and full measurement equivalence is the last step and implies that the observed measurements can be compared directly between the different groups.
AFRIKAANSE OPSOMMING: Kommersiële Organisasies word bedryf in ‘n vrye-mark ekonomiese stelsel. Die doel van kommersiële organisasies is dus om skaars hulpbronne tot hul beskikking optimaal aan te wend ten einde wins te maksimeer. Daarom is dit belangrik vir die menslikehulpbron funksie om ‘n bevoegde en gemotiveerde werksmag te verkry en in stand te hou op ‘n wyse wat waarde tot die onderneming byvoeg. Dit is daarom uiters belangrik om die regte menslikehulpbron intervensies in organisasies te implementeer om die menslike kapitaal so te reguleer dat hulle optimaal waarde tot die onderneming byvoeg. Persoonlikheidstoetse word gebruik in die wêreld van werk om individuele verskille in gedrag en werksprestasie te bepaal. Daar was onlangs ‘n dispuut oor die effektiwiteit van persoonlikheidstoetse se gebruik in die voorspelling van werksprestasie, maar persoonlikheid word hedendaags beskou as ‘n invloedryke oorsaaklike veranderlike in die voorspelling van werksprestasie. Vanaf die eerste demokratiese verkiesing van 1994 word daar sterker eise geplaas op die kulturele toepaslikheid van sielkundige toetse in Suid Afrika. Kruis-kulturele assesserings in Suid Afrika is daarom tans baie prominent. Die gebruik van sielkundige toetse, ingesluit persoonlikheidstoetse, word nou streng beheer deur wetgewing, onder andere die Wet op Gelyke Indiensneming 55 van 1998. Ten einde ingeligte besluite te kan neem, benodig bedryfsielkundiges en geregistreerde sielkundé praktisyns betroubare en geldige inligting oor die persoonlikheidskonstruk om hul in staat te stel om akkurate voorspellings van die kriteriumkonstruk te maak. Dit bied wesenlik die regverdiging vir die primêre oogmerk van hierdie studie, naamlik om ‘n ekwivalensie en invariansie studie van die tweede uitgawe van die Vyftien Faktor Vraelys (the Fifteen Factor Questionnaire, 15FQ+) op ‘n steekproef van Swart, Kleurling en Wit Suid Afrikaners te onderneem. Sydigheid in toetse kan beskryf word as ‘lastige’ faktore wat die geldigheid van kruis-kulturele vergelykings oor verskillende groepe (bv. Etniese groepe) bedreig (Van de Vijver & Leung, 1997). Hierdie faktore kan veroorsaak word deur konstruksydigheid, metodesydigheid en/of itemsydigheid. Dit is dus noodsaaklik dat die informasie wat verskaf word deur die toetsresultate dieselfde betekenis moet hê oor al die verskillende verwysingsgroepe. Hierdie aanname noodsaak bewyse van ekwivalente en invariante metings oor verskillende groepe. Ekwivalensie en Invariansie in hierdie studie word ondersoek deur gebruik te maak van Dunbar, Theron en Spangenberg (2011) se voorgestelde stappe. Volle ekwivalensie en invariansie is die laaste stap en impliseer dat waargenome metings oor verskillende groepe direk met mekaar vergelyk kan word.
39
Meng, Juan. "Excellent leadership in public relations an application of multiple-group confirmatory factor analysis models in assessing cross-national measurement invariance /." Thesis, [Tuscaloosa, Ala. : University of Alabama Libraries], 2009. http://purl.lib.ua.edu/113.
Full text
40
Brooks, Billy. "Rural Opioid and Other Drug Use Disorder Diagnosis: Assessing Measurement Invariance and Latent Classification of DSM-IV Abuse and Dependence Criteria." Digital Commons @ East Tennessee State University, 2015. https://dc.etsu.edu/etd/2569.
Full textAbstract:
The rates of non-medical prescription drug use in the United States (U.S.) have increased dramatically in the last two decades, leading to a more than 300% increase in deaths from overdose, surpassing motor vehicle accidents as the leading cause of injury deaths. In rural areas, deaths from unintentional overdose have increased by more than 250% since 1999 while urban deaths have increased at a fraction of this rate. The objective of this research was to test the hypothesis that cultural, economic, and environmental factors prevalent in rural America affect the rate of substance use disorder (SUD) in that population, and that diagnosis of these disorders across rural and urban populations may not be generalizable due to these same effects. This study applies measurement invariance analysis and factor analysis techniques: item response theory (IRT), multiple indicators, multiple causes (MIMIC), and latent class analysis (LCA), to the DSM-IV abuse and dependency diagnosis instrument. The sample used for the study was a population of adult past-year illicit drug users living in a rural or urban area drawn from the 2011-2012 National Survey on Drug Use and Health data files (N = 3,369| analyses 1 and 2; N = 12,140| analysis 3). Results of the IRT and MIMIC analyses indicated no significant variance in DSM item function across rural and urban sub-groups; however, several socio-demographic variables including age, race, income, and gender were associated with bias in the instrument. Latent class structures differed across the sub-groups in quality and number, with the rural sample fitting a 3-class structure and the urban fitting 6-class model. Overall the rural class structure exhibited less diversity and lower prevalence of SUD in multiple drug categories (e.g. cocaine, hallucinogens, and stimulants). This result suggests underlying elements affecting SUD patterns in the two populations. These findings inform the development of surveillance instruments, clinical services, and public health programming tailored to specific communities.
41
Deiters, Jay A. "Factorial Validity and Measurement Invariance of the Test of Performance Strategies, Sport Anxiety Scale, and the Golf Performance Survey Across Age Groups." Thesis, University of North Texas, 2014. https://digital.library.unt.edu/ark:/67531/metadc799546/.
Full textAbstract:
The purpose of this study was to examine the factorial validity and measurement equivalence of the Test of Performance Strategies (TOPS; Thomas, Murphy, & Hardy, 1999); the Sport Anxiety Scale (SAS; Smith, Smoll, & Schultz, 1990); and the Golf Performance Survey (GPS; Thomas & Over, 1994) across age groups in a representative sample of amateur golfers. Based on archival data, participants comprising this study were 649 younger adult (n = 237) and older adult (n = 412) amateur golfers who played in the Dupont World Amateur Golf Championship in Myrtle Beach, South Carolina. The participants completed a set of questionnaires including psychological skills and strategies (e.g., self-talk, goal setting, imagery, etc.) used during competition, sport-specific competitive trait anxiety, and psychomotor skills and involvement in golf. Results demonstrated that the original factor structure of the TOPS competition subscale, the SAS, and the GPS, did not adequately fit the data among this sample of younger and older adult amateur golfers. Further exploratory and confirmatory factor analyses established evidence of factorial validity with the TOPS competition subscale, SAS, and the GPS with both younger and older adult amateur golfers. Configural, metric, scalar, and strict measurement invariance were identified in relation to the TOPS competition subscale, SAS, and the GPS across age cross-group comparisons. In general, the analyses demonstrated support that the TOPS competition subscale, SAS, and the GPS can be utilized with confidence with older adult amateur golfers, as well as conducting group comparisons with younger adult amateur golfers. The findings from this study have several future research directions and practical implications for structuring effective interventions with older adult amateur athletes.
42
Gibbons, Rebecca E. "Survey research in postsecondary chemistry education: Measurements of faculty members’ instructional practice and students’ affect." Scholar Commons, 2018. https://scholarcommons.usf.edu/etd/7296.
Full textAbstract:
Collection of data through survey-type measurements and analysis contributes rich, meaningful information to the chemical education research enterprise. This dissertation reports two strands of research that each contribute a “snapshot” of the state of chemical education on two different levels. The first uses survey research methods, collecting data from faculty members to learn about postsecondary chemistry education across the United States. The second uses survey instruments of student achievement emotions within the organic chemistry classroom, collecting longitudinal data to learn about the relationships of emotions with achievement over time. Both areas are of interest because chemical education research produces evidence-based instructional practices as well as survey instruments of student characteristics, many of which are ready to be used in classroom, yet there is a recognized disconnect between development of these products and enacted practices. The research in this dissertation improves upon previous methodology in both strands of research included while reporting data with implications for instructional, research, and policy matters.
A national survey of postsecondary chemistry faculty uses a stratified sampling procedure to gather information about the state of education in chemistry classrooms. The use of the teacher-centered systemic reform model of educational change enables us to use the data collected in the survey to gather empirical support of the relationship between faculty members’ beliefs about how students learn chemistry more effectively, faculty members’ self-efficacy for instruction and chemistry content, and the instructional practices that they utilize in the course for which they felt they had the most influence. This information is paramount for the developers of evidence-based instructional practices as well as parties interested in determining the methods best suited to the dissemination of these tools. Professional development activities designed to inspire the use of evidence-based instructional tools or techniques must acknowledge the belief systems of faculty members and the need for change in these beliefs prior to the incorporation of new methods. These results present a call for reform efforts on fostering change from its core, i.e., the beliefs of those who ultimately adopt evidence-based instructional practices. Dissemination and design should incorporate training and materials that highlight the process by which faculty members interpret reformed practices within their belief system, and explore belief change in the complex context of education reform.
Another example of the use of national survey data is the determination of the niche distribution of classroom response systems, also known as clickers. It is determined in this study that clickers are used more often in large courses taught at the lower level across the United States. This niche is deemed a more suitable situation for the use of clickers than others. This information is important for researchers developing tools intended for use within the classroom. Despite the possibility for use in all contexts, the national population of faculty members will adopt tools in the contexts which are deemed most suitable; the niche markets of educational tools can provide insight in to best development practices also well as direction for the optimization of the experience for the most frequent users of these tools.
The other set of studies in this dissertation utilize the control-value theory of achievement emotions in the postsecondary organic chemistry context to explore nuanced relationships of affect with achievement. These studies utilize a longitudinal panel data collection mechanism, enhancing our ability to understand relationships. The control-value theory posits that there are a set of nine achievement emotions, dictated by control and value, which influence achievement. Two of these achievement emotions, anxiety and enjoyment, are determined in one study to fluctuate over the semester of organic chemistry and significantly influence achievement as measured by examination scores. These are supported by their theoretical interpretation as activating emotions, and when experienced, inspire students to take measures that ultimately either increase or reduce their success. A deactivating emotion, boredom, is measured in another study and found to also hold a reciprocal relationship with achievement when measured over time. In both studies, results show that the reciprocal causation model with an exam snowballing effect best fits data among the alternative models. There is a small and significant negative relationship between anxiety and performance contrasted with a positive relationship between enjoyment and performance throughout the semester. Negative relationships were observed between boredom and examination performance across the term. In addition, relationships were observed to be stronger at the beginning of the course term. Future research should consider achievement emotions in light of educational reforms to ensure that innovative curricula or pedagogies are functioning in the classroom as intended.
43
Sancho, Patricia, Tomás Caycho-Rodríguez, José Ventura-León, José M. Tomás, and Bossio Mario Reyes. "Does the Spanish version of the SWLS measure the same in Spain and Peru?" Elsevier B.V, 2019. http://hdl.handle.net/10757/626101.
Full textAbstract:
Aim
Satisfaction with life is a measure of protection in older adults. There lies the importance of providing quality instruments. The aim of the study was to evaluate the invariance of the life satisfaction scale (SWLS) in two samples of older adults in Spain and Peru.
Method
The participants were 857 older adults in Spain (mean age = 68.23 years, SD = 5.93) and 336 older adults in Peru (average age = 72.42, SD = 7.07). All multi-group confirmatory factor analyzes were estimated in Mplus 8.0.
Results
The results indicate the presence of a strict invariance of the one-dimensional structure of the SWLS in samples of older adults in Spain and Peru, which allows for meaningful comparisons of latent means and covariances. Comparison of latent means showed small differences in the construct between the cultural groups.
Conclusions
The SWLS is a valid instrument for intercultural comparisons between Spanish and Peruvian population. The measurement invariance assessment contributes to a better understanding of life satisfaction in populations from different cultural contexts.Objetivo La satisfacción con la vida es una medida de protección en los adultos mayores. Aquí radica la importancia de tener instrumentos de calidad para medirla. El objetivo de este estudio fue evaluar la invarianza de la Escala de Satisfacción con la Vida (SWLS) en 2 muestras de adultos mayores de España y Perú. Método Los participantes fueron 857 adultos mayores españoles (edad media: 68,23 años y DT: 5,93) y 336 adultos mayores peruanos (edad media: 72,42 años y DT: 7,07). Todos los análisis factoriales multi-muestra se estimaron en Mplus 8.0. Resultados Los resultados indican la presencia de una invarianza estricta de la estructura unifactorial de la SWLS en muestras de adultos mayores de España y Perú, lo que permite realizar comparaciones adecuadas, tanto de medias latentes como de relaciones con otras variables. La comparación de las medias latentes mostró pequeñas diferencias en el constructo entre las 2 culturas. Conclusiones La SWLS es una escala válida para realizar comparaciones transculturales entre poblaciones peruanas y españolas. La evaluación de la invarianza de medida contribuye a entender mejor la satisfacción vital desde contextos culturales diferentes.
44
Maier, Marco J., and Ingrid Koller. "Supplement to Koller, Maier, & Hatzinger: "An Empirical Power Analysis of Quasi-Exact Tests for the Rasch Model: Measurement Invariance in Small Samples"." WU Vienna University of Economics and Business, 2014. http://epub.wu.ac.at/4340/1/Report127.pdf.
Full textAbstract:
This document is a supplementary text to "An Empirical Power Analysis of
Quasi-Exact Tests for the Rasch Model: Measurement Invariance in Small
Samples" by Koller, Maier, & Hatzinger (to be published in Methodology,
ISSN-L 1614-1881), which covers all technical details regarding the
simulation and its results.
First, the simulation scenarios and the introduction of differential item
functioning (DIF) are described. Next, the different populations'
distributions that were investigated are discussed, and finally, actual
type-I-error rates and empirical power are displayed for all simulated
scenarios. (authors' abstract)Series: Research Report Series / Department of Statistics and Mathematics
45
Quilain, Benjamin. "Measurement of the muon neutrino cross section through charged-current interactions and search for Lorentz invariance violation at the T2K experiment : neutrino oscillation." Palaiseau, Ecole polytechnique, 2014. http://www.theses.fr/2014EPXX0071.
Full textAbstract:
L'expérience T2K, située au Japon, est une expérience étudiant l'oscillation des neutrinos à longue distance. Elle vise à mesurer les paramètres décrivant ce phénomène d'oscillations quantiques, et plus particulièrement, l'angle de mélange θ13. Ce dernier est mesuré par la production de neutrinos muons à J-PARC et la détection de neutrinos électroniques 295 km plus loin, dans le détecteur Super-Kamiokande. Etant donné que T2K a mesuré un angle de mélange θ13 ≠ 0 à plus de 7σ de confiance, cela ouvre la possibilité de mesurer la phase de violation CP dans les expériences d'oscillation de neutrino. Par la mesure précise des paramètres d'oscillations, T2K a pour but d'apporter les premières contraintes sur l'existence possible d'une phase de violation CP dans le secteur leptonique. Après avoir introduit la théorie d'oscillation des neutrinos ainsi que l'expérience, nous présentons le Générateur de Cone, un dispositif que nous avons développé afin de calibrer le détecteur lointain Super-Kamiokande. Nous étudions ensuite l'uniformité et l'isotropie de ce dernier, avant de mettre en évidence les différentes sources de désaccord entre les données et la simulation du détecteur. Nous montrons en particulier une imperfection dans la simulation de la réflexion de la lumière sur le mur du détecteur. Par la suite, nous présentons la calibration du dépot de charge que nous avons effectuée pour les détecteurs proches et sur axe, INGRID et le Module Proton. En particulier, nous observons un phénomène de diaphonie optique entre des scintillateurs d'un certain type, que nous avons corrigé. Cette calibration est ensuite utilisée pour effectuer la première mesure de section efficace double différentielle des interactions (CC0π) des neutrinos avec le Module Proton. L'incertitude provenant des sections efficaces est l'une des sources principales d'erreurs sur la mesure des oscillations de neutrinos, et le canal CC0π est le canal principal d'interaction des neutrinos dans l'expérience T2K. Nous montrons que notre mesure est en accord avec les mesures récentes de l'expérience MiniBooNE. Enfin, nous présentons la première recherche de signaux de violation de l'invariance de Lorentz dans l'expérience T2K. Nous montrons que les oscillations de neutrinos constituent l'une des sondes les plus sensibles pour ce phénomène. Nous dévoilerons d'abord les raisons de la recherche d'un tel effet, avant de présenter notre résultat de recherche de violation d'invariance de Lorentz qui utilise le détecteur INGRID nouvellement calibré. Nous montrons qu'aucun effet de cette violation n'est observé dans ce détecteur proche de T2K.
46
Yeung, Kwong. "Perception of teacher emotional support and parental education level : the impacts on students’ math performance." Thesis, University of Leicester, 2010. http://hdl.handle.net/2381/8607.
Full textAbstract:
There is a paucity of research juxtaposing parental education level and teacher emotional support in a single study which examines their relative impacts on students’ academic achievements. Therefore, the first objective of this dissertation is to study the influence of parental education level, in comparison to the influence of teacher emotional support, on students’ math performance, by using more representative data and a rigorous statistical method. The second objective is to identify and examine how some important psychological traits (both affective and cognitive) mediate the effects of social factors on students’ math performance. The third objective is to examine whether those relationships are moderated by gender. Hong Kong’s survey data is extracted from the Program of International Students Assessment (2003) as organized by Organization for Economic Co-operation and Development (OECD), on the math performances of 4,478 students at the age of fifteen. Measurement invariance was first tested, and then followed by Confirmatory Factor Analysis. Two structural models were tested by Structural Equation Modeling using Linear Structural Relations (LISREL) 8.5 which is computer software for SEM. Results indicated that first, parental education level affects children’s math scores by providing home education resources and enhancing children’s math self-efficacy, and second the Self Determination Theory is applicable in supporting the hypothesis that teachers affects their students’ math scores by providing a cooperative learning environment, which in turn, enhances students’ affective and cognitive factors. Three important mediators, namely cooperative learning environment, math self-efficacy, and home education resources are concluded as significant mediating factors upon the effects of parents and teachers on students’ math performance. The perceived support from parents and teachers are not significantly different across gender in Hong Kong. This is consistent with recent studies that differences favoring males in mathematics achievement are disappearing. Theoretical contributions and practical implications are discussed in the final part of the dissertation.
47
Bussey, Heidi Celeste. "Special Education Teacher Burnout: A Factor Analysis." BYU ScholarsArchive, 2020. https://scholarsarchive.byu.edu/etd/9244.
Full textAbstract:
The poor retention of special education teachers negatively impacts student academic outcomes. Special education teachers commonly cite burnout as a primary reason for leaving the field; however, there is a deficit of literature available to validate claims concerning special educators and their level of burnout. This study analyzed the psychometric properties of the Maslach Burnout Inventory: Educators' Survey using a sample of 349 special education teachers from schools across the nation (201 resource room special education teachers and 148 self-contained special education teachers). The Maslach Burnout Inventory: Educators' Survey measures three factors (e.g. subscales) emotional exhaustion, depersonalization, and personal accomplishment. A confirmatory factor analysis, an exploratory factor analysis, and a multi-group measurement invariance confirmatory factor analysis were conducted. The results showed measurement invariance between the two groups of teachers. During the exploratory factor analysis, a significant fourth factor, collaborative stress, emerged. These findings suggest the current factor structure of the Maslach Burnout Inventory: Educators' Inventory needs to be modified when measuring burnout among special education teachers. This includes the need to further explore how collaboration stress relates to special education teachers and how to implement formative collaboration practices to retain special education teachers.
48
Gerhardt, Micah Gerhardt. "Development of Emotion Regulation and Parental Socialization during Early Childhood." The Ohio State University, 2020. http://rave.ohiolink.edu/etdc/view?acc_num=osu1595368352889174.
Full text
49
Misieng, Jecky. "Translation, Adaptation and Invariance Testing of the Teaching Perspectives Inventory: Comparing Faculty of Malaysia and the United States." Scholar Commons, 2013. http://scholarcommons.usf.edu/etd/4921.
Full textAbstract:
As a result of growing attention in cross-cultural research, existing measurement instruments developed in one language are being translated and adapted for use in other languages and cultural contexts. The benefits of having the same instrument across cultures can only be realized if the process of translation and adaptation of the measurement instruments produces measurement operations that function similarly across national and cultural boundaries. Producing invariant measurement instruments that assess educational and psychological constructs provide a way of testing the cross-cultural generality of theories that include these constructs.
The major purposes of the study were to translate and adapt the Teaching Perspectives Inventory (Pratt, 1992, 1990) from English to Bahasa Malaysia and compare the psychometric properties of the two versions. The TPI is an instrument developed by Pratt (1992) to ascertain the different conceptions that teachers in higher education have about teaching. The TPI has 45 items, which are divided into five subscales or perspectives referred to as Transmission, Apprenticeship, Developmental, Nurturing, and Social Reform. The first phase of this study translated and adapted the TPI from English into the Malay language of Malaysia or Bahasa Malaysia (BM) using multiple approaches as recommended by the International Test Commission. The approaches used to translate the TPI included forward and back translations, an expert panel review, a pilot study, and cognitive interviews. In the translation process, three initial translators, two back translators, and six expert panel members, including the researcher, came up with a pre-final version of the Malay TPI. During the translation process, two items were found to contain expressions that had no exact equivalent forms in Malay: "virtuoso performers" and "higher ideals." Overall, translating the TPI was a challenging task due to the relatively large number of items in the instrument (45) as well as the complexity and very abstract nature of the constructs. Many of the words and expressions that were brief and concise in the English version became longer and more verbose when translated in Malay. As a result, the translated TPI version appeared longer than the original version. Pilot testing with 25 native speakers of Malay who were faculty members from a number of public universities in Malaysia revealed nine items that needed modification. Cognitive interviewing with five participants from the pilot group revealed one item requiring a change by adding a borrowed word "novis" in brackets next to the Malay expressions, which refers to the original word novice. Due to the confusion with the words referring to `people' in many of the items, additional instructions were added at the beginning of the survey to ensure that the participants responded according to the original intention of the items, which focuses on learners in the faculty's specific classroom context instead of people in the society in general. Following changes to the TPI, this instrument was administered in phase two to a Malaysian sample of 561 faculty.
In the second phase, the study assessed the psychometric properties of the original English version of the TPI with 605 faculty in the U. S. and the translated TPI version of the TPI with the Malaysian sample. The overall internal consistency reliability of both the English (α=.88) and the Malay TPI (α=.93) appeared to be adequate. At the subscale level, the internal consistency reliabilities of all the scales were on the lower side considering the large number of items (9) for each subscale (range = .67 to .83 for the U. S. and .59 to .81 for Malaysia). It was found that three out of the five subscales of the U. S. and Malay TPI had similar alpha reliabilities (Apprenticeship, Nurturing, Social Reform). To assess the cross-cultural factorial validity and measurement invariance of the TPI, confirmatory factor analysis (CFA) was carried out for both the original and the Malay TPI. The sample size for the U. S. group was 605 and the Malay group was 561. The fit for both the U. S. and the Malay correlated five-factor models was less than adequate with the Malay model showing a much worse fit. Correlated errors were found between 64 item pairs in the U. S. model and 389 item pairs in the Malay model. The correlations between the five perspectives in the Malay sample were much higher than those in the U. S. sample suggesting that the perspectives had limited discriminant validity. For example, the correlations between the Nurturing and Developmental perspectives and Nurturing and Social Reform perspectives were 1.0. The inadequate fit of the five-factor correlated model in the Malaysian sample and the minimally acceptable fit in the U. S. sample led to the decision to carry out analyses and compare the groups one subscale at a time. Model modifications for each subscale of both samples were carried out to improve the fit by adding one or more parameters (i.e., correlated errors) for each subscale model to obtain acceptable baseline models. The results of the invariance testing for each subscale did not support the existence of measurement invariance. Overall, the results indicate that the Malay version of the TPI is not ready for use and additional translation and adaptation work is recommended. Future efforts could incorporate improvements in the translation process in the form of recruiting a larger number of certified translators who have in-depth knowledge of teaching in higher education as well as a deep knowledge of the philosophy and purposes behind the TPI. Additional cognitive interviews before and after pretesting and pilot testing of the pre-final version are recommended. Finally, adding a large sample of bilingual educators who would complete both the Malay and English versions of the TPI would provide important psychometric data on the equivalence of the TPI items.
50
Soto, Ramirez Pamela. "Validity Evidence of Internal Structure and Subscores Use of the Portfolio in the Chilean Teachers’ Evaluation System." The Ohio State University, 2020. http://rave.ohiolink.edu/etdc/view?acc_num=osu159316412299089.
Full text