Hostname: page-component-745bb68f8f-mzp66 Total loading time: 0 Render date: 2025-02-06T07:46:10.625Z Has data issue: false hasContentIssue false

Psychometric Properties of Spanish Version Student Utrecht Work Engagement Scale (UWES–S–9) in High-school Students

Published online by Cambridge University Press:  13 May 2019

Cristina Serrano*
Affiliation:
Universitat de València (Spain)
Yolanda Andreu
Affiliation:
Universitat de València (Spain)
Sergio Murgui
Affiliation:
Universitat de València (Spain)
Paula Martínez
Affiliation:
Universidad Internacional de Valencia (Spain)
*
*Correspondence concerning this article should be addressed to Cristina Serrano. Universidad de Valencia. Departamento de Personalidad, Evaluación y Tratamientos Psicológicos. Avenida Blasco Ibáñez, 21. 46010 Valencia (Spain).
Rights & Permissions [Opens in a new window]

Abstract

The Utrecht Work Engagement Scale (UWES) is a self-report instrument widely used, both in the original and its abbreviated version of nine items, to assess the work -UWES, UWES–9– and academic engagement -UWES-S, UWES–S–9–. The present study examines factor structure of the UWES–S–9 using confirmatory factor analysis (CFA), its convergent validity and invariance across sex and age groups in a sample of 626 Spanish high school students. The results support an unidimensional conceptualization of engagement (S-Bχ2/df = 5.29; CFI = .96; NNFI = .94; RMSEA = .083; IFI = .96; AIC = 82.21; BIC = 267.38), revealed an essentially invariant structure of the UWES–S–9 across the sex, ΔS-Bχ2(Δ6) = 10.67; p ≤ .05, and age, ΔS-Bχ2(Δ7) = 9.67; p ≤ .05, and confirmed the positive association between academic engagement and achievement (r = .30; p ≤ .001), dispositional optimism (r = .21; p ≤ .001), and subjective well-being (r = .16; p ≤ .001), and the negative association with perceived stress (r =. –13; p ≤ .001). In short, the Spanish version of UWES–S–9 is presented as a brief, reliable and valid tool to measure academic engagement in high school students (α = .91, AVE = .52, Ω = .911).

Type
Research Article
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2019 

Schaufeli, Salanova, González-Romá, and Bakker (Reference Schaufeli, Martínez, Marques-Pinto, Salanova and Bakker2002) define engagement as a positive, fulfilling, and work-related state of mind that is characterized by vigor, dedication and absorption and developed the Utrecht Work Engagement Scale (UWES) to evaluate this construct. The instrument is composed of 17 items grouped into three subscales corresponding to engagement’s components: high levels of energy, persistence and effort during the job (vigor, 6 items); involvement in one’s job and a sense of enthusiasm, inspiration, pride and challenge (dedication, 5 items), and concentration and immersion levels experienced on one’s work (absorption, 6 items). Subsequent psychometric analysis showed inconsistent two items which disappeared in a revised 15-item version (UWES–15) (Demerouti, Bakker, de Jonge, Janssen, & Schaufeli, Reference Demerouti, Bakker, de Jonge, Janssen and Schaufeli2001). Later, Schaufeli, Bakker, and Salanova (Reference Schaufeli, Bakker and Salanova2006) constructed a nine-item short version (UWES–9), with only three items by dimension.

The UWES has been the most widely used instrument to assess engagement in work context. It has been analyzed in different samples and adapted to several languages; among other: Dutch (Schaufeli & Bakker, Reference Schaufeli and Bakker2003), Spanish (Schaufeli & Bakker, Reference Schaufeli and Bakker2003), Italian (Balducci, Fraccaroli, & Schaufeli, Reference Balducci, Fraccaroli and Schaufeli2010), and Chinese (Fong & Ng, Reference Fong and Ng2012).

Consistently with the theory of work engagement (Schaufeli & Salanova, Reference Schaufeli, Salanova, Gilliland, Steiner and Skarlicki2007), previous research has focused on job and personal predictors, and outcomes of this construct (Bakker, Schaufeli, Leiter, & Taris, Reference Bakker, Schaufeli, Leiter and Taris2008). The available evidence regarding to personal resources shows, for example, those variables as resilience, self-efficacy, and optimism facilitate work engagement (e.g. Barkhuizen, Rothmann, & van de Vijver, Reference Barkhuizen, Rothmann and van de Vijver2013). Research also supports the link between work engagement and positive outcomes as job performance (e.g. Balducci et al., Reference Balducci, Fraccaroli and Schaufeli2010) and negative outcomes such as poor mental health (e.g. Fong & Ng, Reference Fong and Ng2012).

The results regarding the factor structure of the scale are, however, inconsistent. Several studies support the original three-factor structure in both the UWES–17 and UWES–9 (e.g. Hernández Vargas, Llorens Gumbau, Rodríguez Sánchez, & Dickinson-Bannack, Reference Hernández Vargas, Llorens Gumbau, Rodríguez Sánchez and Dickinson-Bannack2016; Petrović, Vukelić, & Čizmić, Reference Petrović, Vukelić and Čizmić2017). Other authors find support for a two-factor structure, in which vigor and absorption are grouped into one factor (Christian & Slaughter, Reference Christian and Slaughter2007). Some studies conclude that the UWES can be most accurately and parsimoniously represented as a unidimensional construct (e.g. Vallières, McAuliffe, Hyland, Galligan, & Ghee, Reference Vallières, McAuliffe, Hyland, Galligan and Ghee2017; Vazquez, Magnan, Pacico, Hutz, & Schaufeli, Reference Vazquez, Magnam, Pacico, Hutz and Schaufeli2015). Finally, other authors (e.g. Lovakov, Agadullina, & Schaufeli, Reference Lovakov, Agadullina and Schaufeli2017; Rodríguez-Montalbán, Sánchez-Cardona, & Martínez-Lugo, Reference Rodríguez-Montalbán, Sánchez-Cardona and Martínez-Lugo2014) support the good fit of both, one-factor and three-factor structures of the scale, defending that the overall score and subscale scores can be used according to the aim of the research. Concretely, Schaufeli et al. (Reference Schaufeli, Bakker and Salanova2006) suggest the use of a single indicator of the UWES–9 in regression analysis to avoid the problem of multicollinearity caused by the high correlation between its subscales; and also using the value of these –vigor, dedication and absorption- as indicators of the latent factor of work engagement when testing structural equation models. However, to date, the fit of a hierarchical model with a second order level representing a combination of all elements and including three or alternatively two first-order factors has not yet been explored.

The original scale has been modified in order to adapt it to the academic environment, giving rise to the UWES-S (Schaufeli & Bakker, Reference Schaufeli and Bakker2003). This instrument has been also adapted to various languages; among other: Spanish (Benevides-Pereira, Fraiz de Camargo, & Ponto-Martins, Reference Benevides-Pereira, Fraiz de Camargo and Porto-Martins2009), Brazilian (Vazquez et al., Reference Vazquez, Magnam, Pacico, Hutz and Schaufeli2015), Korean (Römer, Reference Römer2016), and Turkish (Çapri, Gündüz, & Akbay, Reference Çapri, Gündüz and Akbay2017).

Although to a lesser extent, the convergent validity and factor structure of the UWES-S has also been studied, particularly with undergraduate students. The results have shown the positive association of UWES-S with other variables such as life satisfaction (Rastogi, Prakash ), academic performance (Gómez et al., Reference Gómez, Pérez, Parra, Ortiz, Matus, McColl and Meyer2015), and responsibility (Çapri et al., Reference Çapri, Gündüz and Akbay2017); and its negative relation with academic procrastination (Çapri et al., Reference Çapri, Gündüz and Akbay2017), stress, depression, and anxiety (Rashid & Asghar, Reference Rashid and Asghar2016, August). The studies that have addressed the factor structure of the UWES-S have also yield non-consistent results. Different studies point to the three-factor model fits better than a single-factor structure (Benevides-Pereira et al., Reference Benevides-Pereira, Fraiz de Camargo and Porto-Martins2009; Cadime, Lima, Marques-Pinto, & Ribeiro, Reference Cadime, Lima, Marques-Pinto and Ribeiro2016; Casuso-Holgado, Moreno-Morales, Labajos-Manzanares, & Montero-Bancalero, Reference Casuso-Holgado, Moreno-Morales, Labajos-Manzanares and Montero-Bancalero2017; Meng & Jin, Reference Meng and Jin2017) whereas other authors support alternative factor structures; Medrano, Moretti, and Ortiz (Reference Medrano, Moretti and Ortiz2015) and Portalanza Chavarria, Grueso Hinestroza, and Duque Oliva (Reference Portalanza Chavarria, Grueso Hinestroza and Duque Oliva2017) found that a two factors solution (vigor-absorption and dedication) emerged as the most appropriated model, and Römer (Reference Römer2016) indicated that the one factor model was better than the others.

Finally, the research about the invariance factorial of the UWES in academic contexts (UWES-S) is still limited. As far as we know, only one study has analyzed and supported the factorial invariance of the three-factor model of UWES–S–9 through samples of high school and university students (Cadime et al., Reference Cadime, Lima, Marques-Pinto and Ribeiro2016).

To sum up, the inconsistency of the obtained results regarding the factorial structure of the UWES is also replicated in its adaptation to the academic context and to demand, therefore, the necessity of new research to clarify the structural validity of this instrument.

This study aims (i) to explore the factor structure of the UWES-S–9 from a large sample of Spanish high school students through the application of confirmatory factor analysis (CFA) and testing three first-order structures -one-factor, two and three-factors- and two hierarchical models -with second-order level representing all items and first-order level with two and three factors respectively -; (ii) to inspect the internal consistency of the scale through Cronbach’s alpha, omega coefficient and average variance extracted, (iii) to provide information on convergent validity of the instrument through the relationship between academic engagement and variables as much antecedents (optimism) as positive (subjective well-being and academic achievement) and negative (perceived stress) outcomes.

Finally, we also test the invariance of the UWES–S–9 across sex and age characteristics. The rationale lies both in the invariance implications for the discriminant validity of the construct –academic engagement-, and in its practical significance for the use of the instrument across different age and sex groups and for longitudinal tracking of individuals (Prince-Embury & Courville, Reference Prince-Embury and Courville2008).

Method

Participants and Procedure

The sample comprised of 626 high school students (male = 317, female = 309), aged 13 to 18 (mean = 15.48, SD = 1.00). Of them, 322 adolescents were in the range of age between 13 and 15 years (early adolescence subgroup) and the 304 remaining between 16–18 years (late adolescence subgroup). Regarding the distribution by course, 41.5% of the students attended to 3rd, 32.6% to 4th of Secondary School and 25.9% to 1st of A-levels. The participants were from four urban lay secondary schools of Castellon and Valencia provinces.

Fifteen public and private secondary schools of the Valencian Community were selected randomly and contacted by e-mail to request their involvement in the study. Once the schools showed their interest, a personal interview was arranged to explain the study characteristics and to confirm their participation. The study was approved by the school board of each academic center that provided the informed consent. As inclusion criteria, the sample must meet the age (13 to 18 years) and the Spanish language knowledge. The questionnaires were administered to participants in paper-and-pencil format were completed anonymously, in presence of the researcher and tutor, during a group tutorial session of 45 minutes. The data were collected the third quarter of the academic year.

The presence of random incomplete data was examined. Data were imputed following the procedure of “Mean substitution” whenever the percentage of lost data was less than 20%, otherwise the response protocol was removed (Hair, Anderson, Tatham, & Black, Reference Hair, Anderson, Tatham and Black1999).

Instruments

Brief Student Utrecht Work Engagement Scale –UWES–S–9– (Spanish and original version in Benevides-Pereira et al., Reference Benevides-Pereira, Fraiz de Camargo and Porto-Martins2009) was used to evaluate academic engagement (e.g. When I’m doing my work as a student, I feel bursting with energy). It is a 9-items self-report instrument based on a 7-point Likert scale ranging from 0 (never) to 6 (always). It consists of three dimensions: vigor, dedication and absorption.

Subjective Happiness Scale -SHS- (Spanish version of Extremera, Fernández- Berrocal, González-Herrero, & Cabello, Reference Extremera, Fernández-Berrocal, González-Herrero, Cabello and Fernández- Berrocal2009) was developed to measure the subjective well-being. The SHS consists of 4 items (e.g. Compared with most of my peers, I consider myself: Less happy/happier) rated on a 7-point Likert scale (1–7) (α= .76 in this study). The Spanish version of the instrument has shown good psychometric properties (e.g. Extremera et al., Reference Extremera, Fernández-Berrocal, González-Herrero, Cabello and Fernández- Berrocal2009).

Perceived Stress Scale -PSS- (Spanish version of Remor & Carrobles, Reference Remor and Carrobles2001). The PSS is a self-report instrument consisting of 14 items. Respondents are instructed to indicate on a 5-point Likert scale from 0 (never) to 4 (very often) the level of experienced stress during the last month (e.g. In the last month, how often have you been upset because of something that happened unexpected) (α = .79). The questionnaire in its Spanish version has shown adequate psychometric properties (e.g. Remor & Carrobles, Reference Remor and Carrobles2001).

Revised Life Orientation Test -LOT-R- (Spanish version Otero, Luengo, Romero, Gómez, & Castro, Reference Otero, Luengo, Romero, Gómez and Castro1998) was developed to measure the dispositional optimism. The self-report questionnaire consists of 10 items (four of them are fillers) on a five-point Likert scale that ranges from 1 (totally disagree) to 5 (totally agree). The respondents indicate the extent to which they agree with each item (e.g. In uncertain times, I usually expect the best) (α= .63). The Spanish of the LOT-R has shown adequate psychometric properties (e.g. Otero et al., Reference Otero, Luengo, Romero, Gómez and Castro1998).

Academic achievement. The average marks obtained in the first two evaluations was used to assess the academic achievement. The high correlation obtained between the two means (r = .96) confirms the use of this measurement as a reliable indicator of criterion.

Statistical analyses

CFAs were conducted using maximum likelihood estimator (MLE) with EQS 6.1 (Bentler, Reference Bentler2006). Thus, one-factor (1F), two-factors (2F), and three-factors (3F) first-order structures, hierarchical models with second-order level representing all items and first-order three-factors (3F > 1F) and first-order two factors (2F > 1F). Robust statistics (Bentler, Reference Bentler2006) were used to evaluate the goodness of fit of the models to the data (acceptable criteria level in parenthesis; Hair et al., Reference Hair, Anderson, Tatham and Black1999; Reference van de Schoot, Lugtig and HoxVan de Schoot, Lugtig, & Hox, 2012): Root Mean Square Error of Approximation (RMSEA), < .08; 90% confidence interval (CI), Non-Normed Fit Index (NNFI) ( > .90), Bollen Incremental Fit Index (IFI) ( > .90), and Comparative Fit Index (CFI) ( > .90). The Satorra–Bentler chi-square (S-Bχ2) and this index divided by df (S-Bχ2/df) –to correct the influence of the number of subjects- were also calculated. Morevover, the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) were employed. Those indexes adjust χ2 for the number of estimated parameters and can be used to compare competing models that do not need to be nested. In the event of an unsatisfactory fit with the confirmed models, the significance of the different saturations, the existence of covariances between errors, and unexpected saturations according to the models submitted to a confirmatory analysis (cross-loadings) are examined until reaching fit values greater than .95 (Hu & Bentler, Reference Hu and Bentler1999).

Secondly, we estimated the invariance of the UWES–S–9 on sex and age. The evidence of multigroup invariance laid on a set of goodness-of-fit indices, including both overall (CFI, RMSEA, and SRMR) and incremental goodness-of-fit indices (∆CFI and ∆χ2). This analysis is the greatest substantive interest because allows to explore the discriminant validity of the UWES–S–9 across sex and age.

Lastly, reliability and validity of UWES–S–9 was measure using Cronbach’s alpha, Omega coefficients and Average Variance Extracted, its convergent validity was examined through Pearson´s correlation coefficients between academic engagement and subjective well-being, perceived stress, dispositional optimism, and academic achievement.

Results

Factor structure

Table 1 reports the results of the CFA of the first-order models (Model 1F, Model 2F, and Model 3F, Model 2FC, and Model 3FC) and the two hierarchical models (Model 3F > 1F, and Model 2F > 1F). The Model 1F, with the simplest factor structure, was calculated first. Then, the models of two and three factors and their variations were analyzed, selecting the best of them all.

Table 1. Models Fit Indices

a Include the covariance between the factors

b Robust version.

Figure 1. Structural Model of the UWES–S–9

As can be seen in the Table 1, Model 2F and Model 3F showed a poor fit and were recalculated inclosing the covariance between the factors (Model 2FC and 3FC model). We also calculated the second order factor versions of the Model 2FC and 3FC (Models 2F > 1F and Models 3F > 1F). Next, following the principle of parsimony, it was analyzed whether introducing a second order factor improves the fit of the 2FC and 3FC Models.

Chi-squared comparisons indicated that Model 2FC fitted worse (p < .05) than Model 3FC (Δχ2 = 9.13, Δdf = 2), Model 2F > 1F (Δχ2 = 9.17, Δdf = 2) and Model 3F >1F (Δχ2 = 9.17, Δdf = 2). Because the similar chi-square values between Model 3FC, Model 2F > 1F and Model 3F > 1F, we evaluated the values of the rest of fit indexes. Model 3FC and Model 3F > 1F showed similar and better fit indexes than Model 2F > 1F, inclosing a CFI value of .939, while the CFI value of Model 2F > 1F was .936 (ΔCFI = .003).

Since the Model 3FC showed a slightly better fit (see S-Bχ2, AIC, and BIC) than Model 3F >1F, and had the advantage of not postulating a second order factor, we selected Model 3FC to compare with Model 1F. In the comparison between Model 3FC and Model 1F, the former showed a better fit than the Model 1F both for his χ2 value (Δχ2 = –38.23, Δdf = 3) and for its CFI value (ΔCFI = .013).

However, a detailed exploration of the Model 3FC revealed that the correlation between Factor 1 (vigor) and Factor 2 (dedication) was 0.90, between Factor 1 and Factor 3 (absorption) was 0.95, and between Factor 2 and Factor 3 was 0.91 (in all cases p ≤ .01). These high correlations seem to indicate that three factors are, in fact, the same factor (Kline, Reference Kline2005) so this model was discarded and Model 1F was selected.

Although selection of Model 1F was not based on fit indexes values, a definitive model also requires adequate saturations among items or factors and adequate covariations between items or factors. Model 1 met all those requirements.

Therefore, it was decided to improve the Model 1F until at least one of the fit indices will exceed .95 (Hu & Bentler, Reference Hu and Bentler1999), thus avoiding a final overparameterized model. The correlation between unique variance of items 7 and 8 (r = .21, p ≤ .01) and between items 1 and 2 (r = .33, p ≤ .01) was added, improving the adjustment significantly (Model 1FImproved). Finally, the AIC and BIC comparison between the models showed that the modified model (Model 1FImproved) could be considered the best fitting model.

Configurational and metric invariance

There are different criteria about the multigroup invariance analysis (Vandenberg & Lance, Reference Vandenberg and Lance2000), so, in the present study, we have focused on the configurational and metric invariance. Configurational and metric invariance are the types of invariance most frequently calculated and the two basic steps of an invariance test (Vandenberg & Lance, Reference Vandenberg and Lance2000). If it is achieved, it can be followed with the rest of the invariances (Vandenberg & Lance, Reference Vandenberg and Lance2000).

The Model 1F was first calculated for both groups in order to test the configurational invariance model. The results showed a good multi-sample fit, indicating a common factor structure across the two groups, S-Bχ250 = 158.13; RCFI = 0.96; RMSEA = 0.059 (.049, .069); IFI = 0.96; AIC = 58.13.

Next, constrains were imposed to factorial saturations (metric invariance), however, the modification indexes of the restricted model showed that constrains on the saturations of Items 1, 5 and 6 were significant, so the model was recalculated without these constrains. After eliminating these constrains, the restricted model was equivalent to configurational model, ΔS-Bχ2(Δ4) = 9.72; p ≤ .05. Therefore, saturation of Item 1 (males, 1.15, females, 0.96), Item 5 (males, 0.92, females, 0.95), and Item 6 (males, 1.29, females, 1.12) was different by sex. Males showed higher saturations than females on Item 1 and Item 6, while the result was reversed on the Item 5.

The same procedure was followed with the age groups. The Model 1F showed a good fit (S-Bχ250 = 160.45; RCFI = 0.96; RMSEA = 0.060 (.049, .070); IFI = 0.96; AIC = 60.45) indicating a configurational invariance model between age groups, ΔS-Bχ2(Δ7) = 9.67; p ≤ .05.

Next, restrictions of item saturations were applied. But the constrain of the saturations of Items 5 and 6 were significant and therefore we recalculated the complete model without these constrains. Once these restrictions were removed, the resulting was equivalent to the unrestricted model, ΔS-Bχ2(Δ6) = 8.16; p ≤ .05. Therefore, late and early adolescents differ in the factorial saturation of Item 5 (early, .72, late, .70) and Item 6 (early, .84, late, .79). That is, the early adolescent presented lower saturations than the mature ones in Item 5 and Item 6.

Taken together, the results support the configurational invariance but only partial metric invariance. Moreover, considering that the scale is composed of nine items, a considerable number of them does not meet the metric invariance. According to Vandenberg and Lance (Reference Vandenberg and Lance2000), it does not seem appropriate to continue with the invariance tests, since it has already been shown that there are differences between the groups considered. So, there are differences on the latent variable are caused, at least, by a difference in the loadings factor (Reference van de Schoot, Lugtig and HoxVan de Schoot et al., 2012).

Reliability and convergent validity

As the Table 2 shows, the Cronbach´s alpha for the UWES–S–9 was satisfactory (α = .91). Likewise, the value of Average Variance Extracted –AVE–and the Omega coefficient -Ω- for the UWES–S–9 were satisfactory (AVE = .52, Ω = .911).

Table 2. Reliability and Convergent Validity of UWES–S–9 (N=626)

*** p ≤ .001

The correlations of academic engagement (AE) with perceived stress (PS), subjective well-being (SW), dispositional optimism (DO), and academic achievement (AA) both for the total sample and for subgroups by sex and age are shown in Table 2. Academic engagement is positive and moderate correlated with academic success (r = .27 to .33; p ≤ .001) in all groups. The relationship with the rest of criteria variables showed variations based on sex and age. Academic engagement correlated positive and weakly with dispositional optimism and displayed differences based on sex: The greatest correlation was found in the subgroup of females (r =.29; p ≤ .001), and the minor in the male subgroup (r = .16; p ≤ .01). The association with both subjective well-being and perceived stress was weak and modulated by sex and age. In both cases, the largest association was found in the youngest subgroup (r SW = .21 and r PS = –.20, p ≤ .001), while it was not significant in the late adolescence subgroup (r SW = .09 and r PS = –.05, p ≥ .05). The difference between subgroups defined by sex was less; still, the correlation was higher in the female subgroup (r SW = .18 and r PS = –.19, p ≤ .001) than in the male subgroup (r SW = .15 and r PS = –.13, p ≤ .05).

Discussion

A primary aim of the present investigation was to analyze the factor structure of the UWES–S–9 in a large sample of Spanish high school students (N = 626). There is considerable debate in the literature as to whether the UWES and, consequently, engagement should be considered a multidimensional or one-dimensional construct. The models tested in this study included the original three-factor model (vigor, dedication and absorption) proposed by Schaufeli and Bakker (Reference Schaufeli and Bakker2003) and two additional models derived from the empirical research: (i) Two-factor model (vigor + absorption, and dedication) and (ii) one-factor model. In addition, we also explore two hierarchical models with a second order level representing a combination of all elements and including, respectively, three and two first order factors. The results of the CFA indicated that the three-dimensional and two-dimensional models showed a similar adjustment, not improved by the corresponding hierarchical models, and slightly superior to that obtained by the one-dimensional model. However, the high correlations between the three factors of UWES–S–9 -vigor, dedication, and absorption- (r ≥ .90, in all cases) evidenced their poor discriminant validity. These results, consistent with a meta-analysis (Christian & Slaughter, Reference Christian and Slaughter2007) and other more recent studies (Fong & Ng, Reference Fong and Ng2012; Vallières, McAuliffe, Hyland, Galligan, & Ghee, Reference Vallières, McAuliffe, Hyland, Galligan and Ghee2017) undermined the viability of this scoring scheme and pointed to unidimensional conceptualization of engagement. In fact, our modified one-factor model obtained satisfactory fit indexes. Consequently, our results are not consistent with a multidimensional structure proposed by some authors (Cadime et al., Reference Cadime, Lima, Marques-Pinto and Ribeiro2016; Casuso-Holgado et al., Reference Casuso-Holgado, Moreno-Morales, Labajos-Manzanares and Montero-Bancalero2017; Meng & Jin, Reference Meng and Jin2017), but rather support unidimensional conceptualization of engagement found in other studies (e.g. Römer, Reference Römer2016).

Moreover, this study also examined the internal consistency and factor invariance of the UWES–S–9. Align with the previous studies in educational setting (Casuso-Holgado et al., Reference Casuso-Holgado, Moreno-Morales, Labajos-Manzanares and Montero-Bancalero2017; Römer, Reference Römer2016) the indexes of Cronbach’s alpha, Omega, and Average Variance Extracted confirmed the satisfactory internal consistency and validity of the scale. Likewise, our results (since there were only minimal differences) supported the invariance of unidimensional-factor model of the UWES–S–9 across sex and age. Specifically, configurational invariance was demonstrated but it is not possible to establish the metric invariance and, consequently, the multigroup absolute invariance.

The convergent validity of UWES–S–9 in terms of its association with measures of academic achievement, dispositional optimism, subjective well-being and perceived stress was also addressed in our study. Align with previous findings (e.g. Gómez et al., Reference Gómez, Pérez, Parra, Ortiz, Matus, McColl and Meyer2015), our data informed that academic engagement is positively and moderately related with academic achievement. It is reasonable to think that greater effort, energy, and involvement carried out in the academic tasks will lead to higher achievement. In fact, Schaufeli, Martínez, Marqués Pinto, Salanova, and Bakker (Reference Schaufeli, Salanova, González-Roma and Bakker2002) suggested that seems plausible that vigorous and dedicated students who are energetic and immersed in their studies are successful in their academic achievement.

Align with results obtained in the work environment (Barkhuizen et al., Reference Barkhuizen, Rothmann and van de Vijver2013), our results also supported the existence of a weak/moderate and positive relation between dispositional optimism and academic engagement. The construct of dispositional optimism arose from a general self-regulatory framework (Carver & Scheier, Reference Carver and Scheier1998). According to this framework, an important determinant of whether people confronting difficulties in progressing toward their goals decide to engage or disengage is the perception of desired outcomes as attainable. Because of their positive outcome expectancies, it is more likely that optimists invest effort and persistence (Solberg Nes, Reference Solberg Nes and Fink2016) and, in a particular, show more academic engagement.

Not only persistent goal pursuit can be associated with their attainment (as its association with academic achievement indicate), which is linked to well-being. Moreover, engagement is defined as a positive, fulfilling, and motivational state of mind related to students’ tasks that is characterized by vigor, dedication, and absorption (Schaufeli et al., Reference Schaufeli, Martínez, Marques-Pinto, Salanova and Bakker2002). As shown by previous research with undergraduate students (Rastogi et al., Reference Rastogi, Prakash Pati, Kumar, Kumar Dixit and Pradhan2017), our results indicated a positive, although weak, association between academic engagement and subjective well-being.

Our results also supported the negative but weak relation between academic engagement and perceived stress found in previous studies (Cadime et al., Reference Cadime, Lima, Marques-Pinto and Ribeiro2016; Fong & Ng, Reference Fong and Ng2012). Higher perceived stress levels may predispose poor coping mechanisms in response to the stress and, thereby affect to the ability to manage difficulties, impacting negatively then on academic engagement.

To sum up and align with the previous literature, the results shown that the strongest association was between academic engagement and achievement, supposedly due to that both are circumscribe at the same context compared to the rest of the criterion variables. In addition, the relationship between the first two variables -EA and AA- was the only one not modulated by sex and age. The sex parameter played the same role in the link of engagement with dispositional optimism, subjective well-being and perceived stress. Specifically, this was slightly higher in the female subgroup than in the male subgroup.

In relation to the subgroup defined by age, the most relevant result was the lack of significate association between academic engagement and the outcome variables subjective well-being and perceived stress in the late adolescence group. The reason of this could be the greatest complexity that gradually characterizes to the problematic inherent adolescence (Özdemir, Utkualp, & Palloş, Reference Özdemir, Utkualp and Palloş2016). Consequently, the relative importance of academic engagement in the global level of subjective well-being and perceived stress manifested by the adolescent would be reduced.

Finally, it is necessary to point out the strengths and limitations of this study. It constitutes the first validation study of the Spanish version of the UWES–S–9 in high school students. More specifically, we examined its structure through CFA; the internal consistence of the scale with several indices and its configurational and metric factorial invariance across sex and age. We also explored its convergent validity by means constructs that can constitute determinants (dispositional optimism) or outcome variables (subjective well-being, perceived stress, and academic performance).

Educational institutions globally seek to foster academic engagement, due to its relationship with numerous other positive outcomes -like psychosocial development and other long term recompenses-, besides academic achievement (Rashid & Asghar, Reference Rashid and Asghar2016; August). For this purpose, Spanish education professionals will have available a brief, reliable and valid tool to measure the academic engagement of students. Of this way, they could assess the involvement, participation and concentration shown by the students, and not only value the mark as proof of their academic achievement.

On the other hand, the limitations of our work include the used indicator for academic performance is temporarily limited to two partial assessments of the same course. In addition, the results obtained in the multi-group analysis to verify the invariance factorial across age should be interpreted carefully due to the limited age range. Finally, the cross-sectional design used did not allow statements on nature or type of relationships between variables. In order to solve the previously mentioned limitations, future research should explore the psychometric properties and invariance factorial of the UWES–S–9 in adolescents of different sexes with broader age ranges, as well as examine the possible mediating role of academic engagement in the relationship between antecedents and outcome variables.

Footnotes

How to cite this article:

Serrano, C., Andreu, Y., Murgui, S., & Martínez, P. (2019). Psychometric properties of Spanish version student Utrecht Work Engagement Scale (UWES–S–9) in high-school students. The Spanish Journal of Psychology, 22. e21. Doi:10.1017/sjp.2019.25.

References

Bakker, A., Schaufeli, W., Leiter, M., & Taris, T. (2008). Work engagement: An emerging concept in occupational health psychology. Work & Stress, 22(3), 187200. http://doi.org/10.1080/02678370802393649CrossRefGoogle Scholar
Balducci, C., Fraccaroli, F., & Schaufeli, W. B. (2010). Psychometric properties of the Italian version of the Utrecht Work Engagement Scale (UWES–9): A cross-cultural analysis. European Journal of Psychological Assessment, 26, 143149. http://doi.org/10.1027/1015-5759/a000020CrossRefGoogle Scholar
Barkhuizen, N., Rothmann, S., & van de Vijver, F. J. R. (2013). Burnout and work engagement of academics in higher education institutions: Effects of dispositional optimism. Stress & Health, 30(4), 322332. http://doi.org/10.1002/smi.2520CrossRefGoogle ScholarPubMed
Benevides-Pereira, A. M., Fraiz de Camargo, D., & Porto-Martins, P. (2009). Utrecht Work Engagement Scale, Spanish manual. Retrieved from https://www.wilmarschaufeli.nl/publications/Schaufeli/Test%20Manuals/Test_manual_UWESEspanol.pdfGoogle Scholar
Bentler, P. M. (2006). EQS 6 structural equations program manual. Encino, CA: Multivariate Software.Google Scholar
Cadime, I., Lima, S., Marques-Pinto, A., & Ribeiro, I. (2016). Measurement invariance of the Utrecht Work Engagement Scale for Students: A study across secondary school pupils and university students. European Journal of Developmental Psychology, 13(2), 254263. https://doi.org/10.1080/17405629.2016.1148595CrossRefGoogle Scholar
Çapri, B., Gündüz, B., & Akbay, S. E. (2017). Utrecht Work Engagement Scale- Student Forms’ (UWES-SF) Adaptation to Turkish, validity and reliability studies, and the mediator role of work engagement between academic procrastination and academic responsibility. Educational Sciences: Theory & Practice, 17, 411435. https://doi.org/10.12738/estp.2017.2.0518Google Scholar
Carver, C. S., & Scheier, M. F. (1998). On the self-regulation of behavior. New York, NY: Cambridge University Press.CrossRefGoogle Scholar
Casuso-Holgado, M. J., Moreno-Morales, N., Labajos-Manzanares, M. T., & Montero-Bancalero, F. J. (2017). Características psicométricas de la versión española de la Escala UWES-S en estudiantes universitarios de fisioterapia [Psychometrics of the Spanish version of the UWES-S Scale in physiotherapy college students]. Fisioterapia, 39(1), 49. https://doi.org/10.1016/j.ft.2016.02.003CrossRefGoogle Scholar
Christian, M. S., & Slaughter, J. E. (2007). Work engagement: A meta-analytic review and directions for research in an emerging area. Academy of Management Proceedings, 1, 16. http://doi.org/10.5465/AMBPP.2007.26536346CrossRefGoogle Scholar
Demerouti, E., Bakker, A. B., de Jonge, J., Janssen, P. P. M., & Schaufeli, W. B. (2001). Burnout and engagement at work as a function of demands and control. Scandinavian Journal of Work, Environment & Health, 27, 279286. http://doi.org/10.5271/sjweh.615CrossRefGoogle ScholarPubMed
Extremera, N., Fernández-Berrocal, P., González-Herrero, V., & Cabello, R. (2009). Una validación preliminar de la versión española de la Subjective Happiness Scale [Preliminary validation of the Spanish version of the Subjective Happiness Scale]. In Fernández- Berrocal, P. (Ed.), Avances en el estudio de la inteligencia emocional [Advances in the study of emotional intelligence] (pp. 3944). Santander, Spain: Fundación Marcelino Botín.Google Scholar
Fong, T. C.-t, & Ng, S.-m. (2012). Measuring engagement at work: Validation of the Chinese version of the Utrecht Work Engagement Scale. International Journal of Behavioral Medicine, 19(3), 391397. https://doi.org/10.1007/s12529-011-9173-6CrossRefGoogle ScholarPubMed
Gómez, H. P., Pérez, V. C., Parra, P. P., Ortiz, M. L., Matus, B. O., McColl, C. P., ... Meyer, K. A. (2015). Academic achievement, engagement and burnout among firs year medical students. Revista Médica de Chile, 143(7), 930937. http://doi.org/10.4067/S0034-98872015000700015Google Scholar
Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1999). Análisis multivariante [Multivariate analysis]. Madrid, Spain: Pearson.Google Scholar
Hernández Vargas, C. I., Llorens Gumbau, S., Rodríguez Sánchez, A. M., & Dickinson-Bannack, M. E. (2016). Validación de la escala UWES–9 en profesionales de la salud en México [Validation of the UWES–9 Scale in Mexican Health Professionals]. Pensamiento Psicológico, 14(2), 89100. http://doi.org/10.11144/Javerianacali.PPSI14-2.veupCrossRefGoogle Scholar
Hu, L.-t., & Bentler, P. M. (1999). Cut-off criteria in fix indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 155. https://doi.org/10.1080/10705519909540118CrossRefGoogle Scholar
Kline, R. B. (2005). Methodology in the social sciences. Principles and practice of structural equation modeling (2nd Ed.). New York, NY: Guilford PressGoogle Scholar
Lovakov, A. V., Agadullina, E. R., & Schaufeli, W. B. (2017). Psychometric properties of the Russian versión of the Utrecht Work Engagement Scale (UWES–9). Psychology in Russia State of the Art, 10(1), 145162.CrossRefGoogle Scholar
Medrano, L. A., Moretti, L., & Ortiz, A. (2015). Medición del engagement académico en estudiantes universitarios [Measure of academic engagement in university students]. Revista Iberoamericana de Diagnóstico y Evaluación, 2(40), 114125.Google Scholar
Meng, L., & Jin, Y. (2017). A confirmatory factor analysis of the Utrecht Work Engagement Scale for Students in a Chinese sample. Nurse Education Today, 49, 129134. http://doi.org/10.1016/j.nedt.2016.11.017.CrossRefGoogle Scholar
Otero, J. M., Luengo, A., Romero, E., Gómez, J. A., & Castro, C. (1998). Psicología de la personalidad. Manual de prácticas [Personality psychology. Manual of practices]. Barcelona, Spain: Ariel Practicum.Google Scholar
Özdemir, A., Utkualp, N., & Palloş, A. (2016). Physical and psychological effects of the changes in adolescence period. International Journal of Caring Sciences, 9(2), 717724.Google Scholar
Petrović, I. B., Vukelić, M., & Čizmić, S. (2017). Work engagement in Serbia: Psychometric properties of the Serbian version of the Utrecht Work Engagement Scale (UWES). Frontiers in Psychology, 8, article 1799. https://doi.org/10.3389/fpsyg.2017.01799CrossRefGoogle Scholar
Portalanza Chavarria, C. A., Grueso Hinestroza, M. P., & Duque Oliva, E. J. (2017). Propiedades de la Utrecht Work Engagement Scale UWES–S–9: Análisis exploratorio con estudiantes en Ecuador [Properties of the Utrecht Work Engagement Scale (UWES–S–9): Exploratory analysis of students in Ecuador]. Innovar: Revista de Ciencias Administrativas y Sociales, 27(64), 145156. https://doi.org/10.15446/innovar.v27n64.62374CrossRefGoogle Scholar
Prince-Embury, S., & Courville, T. (2008). Measurement invariance of the resiliency scales for children and adolescents with respect to sex and age cohorts. Canadian Journal of School Psychology, 23(1), 2640. https://doi.org/10.1177/0829573508316590CrossRefGoogle Scholar
Rashid, T., & Asghar, H. M. (2016, August). Construct validity of two student engagement scales: The UWES-S and the SEI. Paper presented at the 8 th Biennial Conference of EARLI SIG 1: Assessment & Evaluation. EARLI Congress. Munich, Germany.Google Scholar
Rastogi, A., Prakash Pati, S., Kumar, P., Kumar Dixit, J., & Pradhan, S. (2017). Investigation of psychometric properties of UWES-S (student engagement) and its relationship with burnout and life satisfaction in the Indian context (Working Paper Number 222). Indian Institute of Management Kozhikode . Retrieved from: https://econpapers.repec.org/RePEc:iik:wpaper:222Google Scholar
Remor, E. A., & Carrobles, J. A. (2001). Versión española de la Escala de Estrés Percibido (PSS–14): Estudio psicométrico en una muestra VIH+ [Spanish version of the Perceived Stress Scale (PSS-14): Psychometric study in a HIV+ sample]. Ansiedad y Estrés, 7(2–3), 195201.Google Scholar
Rodríguez-Montalbán, R., Sánchez-Cardona, I., & Martínez-Lugo, M. (2014). Análisis de las propiedades psicométricas de la Utrecht Work Engagement Scale en una muestra de trabajadores en Puerto Rico [Analysis of Psychometric Properties of the Utrecht Work Engagement Scale in a sample of workers in Puerto Rico]. Universitas Psychologica, 13(4), 12551266. https://doi.org/10.11144/Javeriana.UPSY13-4.appuCrossRefGoogle Scholar
Römer, J. (2016). The Korean Utrecht Work Engagement Scale-Student (UWES-S): A factor validation study. Testing, Psychometrics, Methodology in Applied Psychology, 23(1), 6581. https://doi.org/10.4473/TPM23.1.5Google Scholar
Schaufeli, W., & Bakker, A. (2003). UWES. Utrecht Work Engagement Scale. Utrecht, The Netherlands: Utrecht University.Google Scholar
Schaufeli, W. B., Bakker, A. B., & Salanova, M. (2006). The measurement of work engagement with a short questionnaire: A cross-national study. Educational and Psychological Measurement, 66, 701716. https://doi.org/10.1177/0013164405282471CrossRefGoogle Scholar
Schaufeli, W. B., Martínez, I. M., Marques-Pinto, A., Salanova, M., & Bakker, A. B. (2002). Burnout and engagement in university students: A cross-national study. Journal of Cross-Cultural Psychology, 33, 464481. https://doi.org/10.1177/0022022102033005003CrossRefGoogle Scholar
Schaufeli, W. B., Salanova, M., González-Roma, V., & Bakker, A. B. (2002). The measurement of engagement and burnout: A two sample confirmatory factor analytic approach. Journal of Happiness Studies, 3, 7192. https://doi.org/10.1023/A:1015630930326CrossRefGoogle Scholar
Schaufeli, W. B., & Salanova, M. (2007). Work engagement: An emerging psychological concept and its implications for organizations. In Gilliland, S. W., Steiner, D. D., & Skarlicki, D. P. (Eds.), Research in social issues in management: Vol. 5. Managing social and ethical issues in organizations. Greenwich, CT: Information Age Publishers.Google Scholar
Solberg Nes, L. (2016). Optimism, pessimism, and stress. In Fink, G (Ed.), Concepts, cognition, emotion, and behavior. Handbook of stress (pp. 405411). London, UK: Academic Press.Google Scholar
Vallières, F., McAuliffe, E., Hyland, P., Galligan, M., & Ghee, A. (2017). Measuring work engagement among community health workers in Sierra Leone: Validating the Utrecht Work Engagement Scale. Journal of Work and Organizational Psychology, 33, 4146. https://doi.org/10.1016/j.rpto.2016.12.001Google Scholar
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 470. https://doi.org/10.1177/109442810031002CrossRefGoogle Scholar
van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486492. https://doi.org/10.1080/17405629.2012.686740CrossRefGoogle Scholar
Vazquez, A. C., Magnam, E. S., Pacico, J., Hutz, C. S., & Schaufeli, W. B. (2015). Adaptation and validation of the Brazilian version of the Utrecht Work Engagement Scale. Psico-USF, 20(2), 207217. http://doi.org/10.1590/1413-82712015200202CrossRefGoogle Scholar
Figure 0

Table 1. Models Fit Indices

Figure 1

Figure 1. Structural Model of the UWES–S–9

Figure 2

Table 2. Reliability and Convergent Validity of UWES–S–9 (N=626)