Hostname: page-component-6bf8c574d5-h6jzd Total loading time: 0.001 Render date: 2025-02-23T22:04:14.608Z Has data issue: false hasContentIssue false

Estimating the Strength of a General Factor: Coefficient Omega Hierarchical

Published online by Cambridge University Press:  02 October 2015

Gilles E. Gignac*
Affiliation:
School of Psychology, University of Western Australia
*
Correspondence concerning this article should be addressed to Gilles E. Gignac, School of Psychology, University of Western Australia, 35 Stirling Highway, Crawley, Western Australia, 6009, Australia. E-mail: gilles.gignac@uwa.edu.au
Rights & Permissions [Opens in a new window]

Extract

Relying on work described by Jackson (2003), Ree, Carretta, and Teachout (2015) recommended researchers use the first unrotated principal component associated with a principal components analysis (PCA) to estimate the strength of a general factor. Arguably, such a recommendation is based on rather old work. Furthermore, it is not a method that can be relied on to yield an accurate solution. For example, it is well known that the first component extracted from a correlation matrix of the Wechsler intelligence subtests is biased toward the verbal comprehension subtests (Ashton, Lee, & Vernon, 2001).

Type
Commentaries
Copyright
Copyright © Society for Industrial and Organizational Psychology 2015 

Relying on work described by Jackson (Reference Jackson2003), Ree, Carretta, and Teachout (Reference Ree, Carretta and Teachout2015) recommended researchers use the first unrotated principal component associated with a principal components analysis (PCA) to estimate the strength of a general factor. Arguably, such a recommendation is based on rather old work. Furthermore, it is not a method that can be relied on to yield an accurate solution. For example, it is well known that the first component extracted from a correlation matrix of the Wechsler intelligence subtests is biased toward the verbal comprehension subtests (Ashton, Lee, & Vernon, Reference Ashton, Lee and Vernon2001).

In contrast to the first unrotated principal component, it is arguably important for industrial–organizational researchers to be aware of the options of estimating the strength of a general factor via structural equation modeling (SEM). Within the context of multidimensional models, a general factor can be specified within a higher order model (see Model 1, Figure 1) or as a first-order breadth factor represented within a bifactor model (see Model 2, Figure 1). Based on either a higher order model or a bifactor model solution, the strength of a general factor can be estimated via an attractive coefficient known as omega hierarchical (ωh; Zinbarg, Revelle, Yovel, & Li, Reference Zinbarg, Revelle, Yovel and Li2005). Coefficient ωh represents the strength of a general factor on a standardized metric and ranges from .00 to 1.0. It is essentially the ratio of common variance to total variance and can be estimated relatively easily in most SEM programs (see Gignac, Reference Gignac2014b, for step-by-step instructions). A coefficient ωh of .80, for example, would imply that the general factor accounts for 80% of the total variance in the data. Gignac and Watkins (Reference Gignac and Watkins2013) found that the general factor associated with the Wechsler Adult Intelligence Scale–IV (Wechsler, Reference Wechsler2008) was associated with a very large ωh of .86. Thus, Ree et al. are correct to contend that there are some very large general factors that can be found in the literature. I suspect the general factor of personality discussed by Ree et al. would be very weak by comparison, however, when modeled and estimated appropriately via ωh (see Revelle & Wilt, Reference Revelle and Wilt2013, for example).

Figure 1. The two most common models used to estimate general factor variance in structural equation modeling (Model 1 = higher order model; Model 2 = bifactor model). F = factor; R = residual; g = general factor; a, b, and c = observed indicators.

What makes a model-based coefficient such as ωh particularly attractive is that it is derived from either a higher order model or a bifactor model, both of which partition the various sources of common variance into separate terms. For example, in the context of the Wechsler scales, the substantial common variance associated with verbal subtests can be “controlled” through the specification of a nested factor in a bifactor model (say, the “F1” term in Model 2). Alternatively, a higher order model would specify the unique common variance associated with the verbal subtests as a first-order factor residual (say, the “R1” term in Model 1).Footnote 1 As the verbal common variance is associated with its own term, it does not contaminate the general factor. Consequently, the strength of the general factor can be estimated accurately via ωh.

Although the higher order model and the bifactor model have some similarities, there are at least two key differences. First, the higher order model imposes a proportionality constraint on the association between the observed variables and the latent variablesFootnote 2 (Schmiedek & Li, Reference Schmiedek and Li2004). For this reason, the bifactor model tends to fit better than does the competing higher order model (Gignac, Reference Gignac2008; Reise, Reference Reise2012). Second, because of issues relevant to identification, only the bifactor allows for the simultaneous estimation of effects associated with all of the latent variables (general factor and nested factors) and a dependent variable of interest (Schmiedek & Li, Reference Schmiedek and Li2004). Across a number of considerations, the bifactor model may be considered preferable in the context of estimating the effects of a general factor and competing specific factors on a dependent variable (Brunner, Reference Brunner2008). Whether one prefers a higher order or a breadth conceptualization of a general factor is irrelevant, as omega hierarchical can be applied to both. A similar coefficient, omega specific (ωs; Reise, Reference Reise2012), can also be used to estimate the strength of secondary factors independently of the effects of the general factor (see Gignac, Reference Gignac2014b, for an accessible demonstration).

The estimation of the strength of a general factor is not a purely statistical or psychometric consideration, as interesting theories can be tested with such information. For example, Gignac (Reference Gignac2014a) tested the dynamic mutualism theory of general intelligence by plotting the strength of the general factor (ωh) across the ages of 2.5 to 90 years. The results suggested that the strength of the general factor (g) is largely constant across age, which was considered a failure to support the dynamic mutualism theory of g (van der Maas et al., Reference van der Maas, Dolan, Grasman, Wicherts, Huizenga and Raijmakers2006). Almost undoubtedly, many more useful hypotheses could be tested with ωh across many disciplines in psychology. Thus, in line with Ree et al., researchers are encouraged to consider the strength of a general factor in their data. However, I would urge all researchers to decline the option of the first component derived from a PCA, in favor of a sophisticated method such as ωh.

Footnotes

1 The addition of correlated uniqueness between common subtest residuals is another model from which coefficient ωh could be estimated (i.e., the single-trait correlated uniqueness model; Gignac, Reference Gignac2006).

2 I use the term “latent variables” in this context to refer to both the higher order factors and the residuals associated with the lower order factors.

References

Ashton, M. C., Lee, K., & Vernon, P. A. (2001). Which is the real intelligence? A reply to Robinson (1999). Personality and Individual Differences, 30, 13531359.Google Scholar
Brunner, M. (2008). No g in education? Learning and Individual Differences, 18 (2), 152165.Google Scholar
Gignac, G. E. (2006). Evaluating subtest “g” saturation levels via the single trait-correlated uniqueness (STCU) SEM approach: Evidence in favor of crystallized subtests as the best indicators of “g.” Intelligence, 34, 2946.CrossRefGoogle Scholar
Gignac, G. E. (2008). Higher-order models versus bifactor modes: g as superordinate or breadth factor? Psychology Science, 50 (1), 2143.Google Scholar
Gignac, G. E. (2014a). Dynamic mutualism versus g factor theory: An empirical test. Intelligence, 42, 8997.Google Scholar
Gignac, G. E. (2014b). On the inappropriateness of using items to calculate total scale score reliability via coefficient alpha for multidimensional scales. European Journal of Psychological Assessment, 30, 130139.Google Scholar
Gignac, G. E., & Watkins, M. W. (2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48, 639662.Google Scholar
Jackson, J. E. (2003). A user's guide to principal components. Hoboken, NJ: Wiley.Google Scholar
Ree, M. J., Carretta, T. R., & Teachout, M. S. (2015). Pervasiveness of dominant general factors in organizational measurement. Industrial and Organizational Psychology: Perspectives on Science and Practice, 8 (3), 409427.Google Scholar
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667696.CrossRefGoogle ScholarPubMed
Revelle, W., & Wilt, J. (2013). The general factor of personality: A general critique. Journal of Research in Personality, 47 (5), 493504.CrossRefGoogle ScholarPubMed
Schmiedek, F., & Li, S. C. (2004). Toward an alternative representation for disentangling age-associated differences in general and specific cognitive abilities. Psychology and Aging, 19 (1), 4056.Google Scholar
van der Maas, H. L., Dolan, C. V., Grasman, R. P., Wicherts, J. M., Huizenga, H. M., & Raijmakers, M. E. (2006). A dynamical model of general intelligence: The positive manifold of intelligence by mutualism. Psychological Review, 113 (4), 842.Google Scholar
Wechsler, D. (2008). Wechsler Adult Intelligence Scale—Fourth Edition. San Antonio, TX: Pearson Assessment.Google Scholar
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach's α, Revelle's β, and McDonald's ω H: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70 (1), 123133.CrossRefGoogle Scholar
Figure 0

Figure 1. The two most common models used to estimate general factor variance in structural equation modeling (Model 1 = higher order model; Model 2 = bifactor model). F = factor; R = residual; g = general factor; a, b, and c = observed indicators.