Hostname: page-component-7b9c58cd5d-f9bf7 Total loading time: 0 Render date: 2025-03-15T11:30:41.739Z Has data issue: false hasContentIssue false

Assessing the Measurement Invariance of the Gratitude Questionnaire–5 in Chinese and American Adolescents

Published online by Cambridge University Press:  22 March 2021

Yu Ling*
Affiliation:
Hunan Normal University (China)
Qin Yang
Affiliation:
No.3 Middle School of Yongzhou (China)
Yifang Zeng
Affiliation:
Texas Tech University (US)
E. Scott Huebner
Affiliation:
University of South Carolina (US)
*
Correspondence concerning this article should be addressed to Yu Ling. Hunan Normal University. 410081Changsha (China). E-mail: ponylingyu17@aliyun.com
Rights & Permissions [Opens in a new window]

Abstract

Given the possibility of cultural differences in the meaning and levels of gratitude among children, we evaluated the measurement invariance of the Gratitude Questionnaire–5 (GQ–5) and differences in latent means across adolescents from two distinct cultures, China and America. Data were obtained from 1,991 Chinese and 1,685 American adolescents. Confirmatory factor analysis and multigroup confirmatory factor analysis were performed to examine the factor structure and the measurement equivalence across Chinese and American adolescents. The Cronbach’s alpha and Item-total Correlations of the GQ–5 were also evaluated. Results of confirmatory factor analyses provided support for the expected one-factor structure. Also, a series of multi-group confirmatory factor analyses supported full configural invariance, full metric invariance, and partial scalar invariance between the two groups. Furthermore, the findings suggested that the GQ–5 is suitable for conducting mean level comparisons. The subsequent comparison of latent means revealed that the Chinese adolescents reported significantly lower gratitude than American adolescents.

Type
Research Article
Copyright
© Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2021

Research on gratitude has increased substantially during the past decade, especially within the context of positive psychology research. Gratitude has been defined as “a generalized tendency to recognize and respond with grateful emotion to the roles of other people’s benevolence in the positive experiences and outcomes that one obtains” (Mccullough et al., Reference Mccullough, Emmons and Tsang2002). According to McCullough et al. (Reference Mccullough, Tsang and Emmons2004), gratitude has been described as the greatest virtue, providing the foundation for all other virtues. In McCullough’s theory, gratitude is regarded as a moral barometer (i.e., indicating the value of the relationship with the benefactor), a moral motive (i.e., prompting grateful people to show prosocial behavior) and a moral reinforcer (i.e., influencing the benefactor to provide gifts in the future) (Mccullough, Kilpatrick, Emmons, & Larson, Reference Mccullough, Kilpatrick, Emmons and Larson2001). These three functions of gratitude result in positive emotions by creating a positive interaction between the beneficiary and the benefactor (Magno & Orillosa, Reference Magno and Orillosa2012).

There is a growing body of empirical evidence linking gratitude and other health-related variables. For example, scholars have demonstrated a negative relation between gratitude and depressive symptoms (Lambert et al., Reference Lambert, Fincham and Stillman2012). Gratitude has also been positively related to personality traits, such as agreeableness, responsibility, and extraversion (Alarcón & Morales de Isasi, Reference Alarcón and Morales de Isasi2012; Mccullough et al., Reference Mccullough, Emmons and Tsang2002). In studies of adolescents, previous research has revealed that gratitude is associated with life satisfaction (Datu & Mateo, Reference Datu and Mateo2015), optimism, happiness, hope (Mccullough et al., Reference Mccullough, Emmons and Tsang2002), subjective well-being, and prosocial behavior (Tian et al., Reference Tian, Du and Huebner2015), as well as better mental health and school performance (Bono et al., Reference Bono, Froh, Furlong, Gilman and Huebner2009). Also, lower levels of gratitude relate to pessimism (Cohen, Reference Cohen2006), materialism (Lambert et al., Reference Lambert, Fincham, Stillman and Dean2009), and narcissistic personality (Mccullough et al., Reference Mccullough, Kilpatrick, Emmons and Larson2001). Thus, gratitude may help adolescents foster positive outcomes and protect against negative outcomes (Gilman et al., Reference Gilman, Huebner, Furlong, Furlong, Gilman and Huebner2014), Adolescents are in a unique developmental period of understanding benefactors’ intentionality and expressing gratitude to their benefactors in appropriate ways (Liang, Reference Liang2017). Therefore, a full understanding of the development of gratitude in adolescence would be valuable in facilitating optimal psychological growth in youth. Nevertheless, compared to that of adults, the research on gratitude in children and adolescents lags far behind.

Several measures have been developed to measure gratitude, including: The Gratitude Resentment and Appreciation scale (GRAT; Watkins et al., Reference Watkins, Woodward, Stone and Kolts2003); The Gratitude Adjective Checklist (GAC; Mccullough et al., Reference Mccullough, Emmons and Tsang2002); The Gratitude Questionnaire–20 items (GQ–20; Bernabé-Valero et al., Reference Bernabé-Valero, García-Alandete and Gallego-Pérez2014); and The Gratitude Scale (Alarcón & Morales de Isasi, Reference Alarcón and Morales de Isasi2012). However, the most widely used questionnaire that is appropriate for adolescents is the Gratitude Questionnaire (GQ–6). The GQ–6, which was developed by McCullough et al. (Reference Mccullough, Emmons and Tsang2002), is a one-factor self-report questionnaire with six items, two of which are reverse-keyed. Contrary to what has been found in the existing literature, Chen et al. (Reference Chen, Chen, Kee and Tsai2009) proposed that a 5-item version (omitting Item 6) is more suitable for adolescents than the 6-item version, because the scores from the 6-item scale yielded poor fit indices, with Item 6 showing a particularly low factor loading, which may reflect the fact that it was reported to be difficult to understand by adolescents. Similarly, Valdez et al. (Reference Valdez, Yang and Datu2017) and Langer et al. (Reference Langer, Ulloa, Aguilar-Parra, Araya-Véliz and Brito2016) examined the psychometric properties of the GQ–6 and GQ–5 in samples of Chilean and Filipino adolescents, and they found that the scores from the GQ–5 yielded a better fit than the GQ–6. To date, the GQ–5 has been translated into several languages and evidence for its validity has been provided in numerous countries, such as China (Chen et al., Reference Chen, Chen, Kee and Tsai2009; Zeng et al., Reference Zeng, Ling, Huebner, He and Lei2017), America (Froh et al., Reference Froh, Fan, Emmons, Bono, Huebner and Watkins2011), Chile (Langer et al., Reference Langer, Ulloa, Aguilar-Parra, Araya-Véliz and Brito2016), Turkey (Yüksel & Oguz Duran, Reference Yüksel and Oguz Duran2012), and the Philippines (Datu, Reference Datu2014; Valdez et al., Reference Valdez, Yang and Datu2017; Valdez & Chu, Reference Valdez and Chu2020).

Gratitude, as a virtue, has been valued in many cultures. Given that gratitude necessarily involves thinking and acting autonomously and displaying perspective taking, cross-cultural research is particularly important because the effects of cultural nuances on adolescents’ perceptions of gratitude may vary across cultures (Corona et al., Reference Corona, Senft, Campos, Chen, Shiota and Chentsova-Dutton2020; Liang, Reference Liang2017). Investigating differences in gratitude among adolescents from different cultures could provide a fuller understanding of the development, nature, and consequences of gratitude in adolescents.

Previous studies have provided evidence for cultural differences in adolescents’ expressions of gratitude. For example, Wang and colleagues (Reference Wang, Wang and Tudge2015) found that, as compared with adolescents in America, Chinese children were more likely to express connective gratitude, which is considered the most sophisticated type of gratitude as the benefactor’s feelings and wishes are taken into account by the beneficiary. Corona et al. (Reference Corona, Senft, Campos, Chen, Shiota and Chentsova-Dutton2020) also reported differences among gratitude reports of individuals from different groups of adolescents, with gratitude experience, expression, and disposition differing significantly among European American, Latino American and East Asian Americans, with European and Latino Americans reporting higher levels of gratitude than East Asian Americans. Finally, Layous et al. (Reference Layous, Lee, Choi and Lyubomirsky2013) found that expressing gratitude toward a benefactor (i.e., writing a letter to someone to whom the participant felt grateful) did not contribute equally to individual wellbeing across the North American and the South Korean samples.

Differences in gratitude levels may be influenced by differing cultural values as reflected in the distinctions between collectivistic–individualistic cultural orientations, which are notably different between East Asian and North American cultures. Individualistic cultures, such as America, emphasize the independence of self and competition with others for resources, including social resources, via asserting one’s superiority (Yokota, Reference Yokota2012). In contrast, collectivist cultures, such as Japan and China, emphasize interdependence, obtaining social resources via reciprocity in social interactions, and exchanging favors and affection according to implicit rules in relationships (Cheung et al., Reference Cheung, Cheung, Leung, Ward and Leong2003). Even within collectivistic cultures, some differences may be observed. Corona et al. (Reference Corona, Senft, Campos, Chen, Shiota and Chentsova-Dutton2020) noted that although Latinos and East Asians both emphasize cultural interdependence, they differ in the expression of positive emotions. Latinos value open expression of positive emotions, whereas East Asians value suppressing emotions, including positive emotions, to promote social harmony. Such differing values may yield differences in the nature and mean levels of gratitude among differing cultural groups.

Relative to the study of such possible cultural differences, researchers have argued persuasively that the cross-cultural equivalence of psychological measures of interest should be investigated before studying cross-cultural differences in the levels and correlates associated with the measures (van der Vijver & Tanzer, Reference Van de Vijver and Tanzer2004; Zeng et al., Reference Zeng, Ling, Huebner, He and Lei2017). Thus, our interest in studying gratitude in Chinese and American adolescents required consideration of the equivalence of scores on the GQ–5 prior to examining any differences in mean levels or correlates for the two groups. The reasons are several. Differences in gratitude may be due to actual cross-cultural differences. As noted above, one useful, major cultural difference may reflect the individualism-collectivism continuum (Sinha, Reference Sinha and Sinha2014; Triandis, Reference Triandis1989). In particular, having a different way of thinking about oneself—as more collectivistic cultures like China do compared with more individualistic cultures like America (Markus & Kitayama, Reference Markus and Kitayama1991)—may impact how one thinks about and expresses gratitude.

Additionally, group differences could be due to differences in measurement. As noted above, measurement invariance is a prerequisite to comparisons of the mean levels or correlates of a measure for a measure of a psychological construct. Measurement invariance refers to “whether or not, under different conditions of observing and studying phenomena, measurement operations yield measures of the same attribute” (Horn & Mcardle, Reference Horn and Mcardle1992). Only when measurement invariance has been demonstrated can the results of a comparative analysis be considered valid. If a measure is interpreted differently across cultures and is applied without sufficient consideration of cultural influences, errors are likely to occur, which may result in unreliable or invalid measurements. Thus, the structure of the original theoretical model should represent the same concepts and meanings across the different cultural contexts in order to further investigate gratitude levels and correlates.

The primary objective of the study was thus to assess the measurement invariance of the GQ–5 in Chinese (i.e., a relatively collectivistic population) and American (i.e., a relatively individualistic population) adolescents. Based on the theoretical model, we expected to demonstrate invariance of the measure across the two groups. If measurement invariance was demonstrated, a secondary objective of the study was to investigate possible differences in the mean levels of gratitude in the two groups. Given previous research, we expected that Chinese adolescents would report a lower mean level of gratitude compared to the American adolescents.

In order to test for measurement equivalence, we used Multi-group Confirmatory Factor Analysis (MGCFA), a widely used approach, (Wu et al., Reference Wu, Lu, Tan, Yao, Steca, Abela and Hankin2012; Zeng et al., Reference Zeng, Ling, Huebner, He and Lei2017). This approach has not been used to date for comparisons of GQ–5 scores across Chinese and American adolescents.

Method

Participants

Chinese sample. The Chinese sample consisted of 1,991 Chinese adolescents (934 males, 1,057 females) from four middle schools in China. The age of the participants ranged from 11 to 16 years (M = 12.91, SD = 1.09). Of the 1991 adolescents sampled, 29% were from Grade 6, 37.80% were from Grade 7, and 33.20% were from Grade 8. Most (95.80%) students were Han, the predominant ethnic group in China, and the remainder was from various ethnic minority groups.

American sample. The American sample consisted of 1,685 American adolescents (864 males, 821 females) from four middle schools in a southeastern state in the USA. The age of the participants ranged from 11 to 15 years (M = 12.45, SD = 0.96). Of the 1,685 adolescents sampled, 27.96% were from Grade 6, 34.40% were from Grade 7, and 37.68% were from Grade 8. Most students were Caucasian (56.10%) followed by African American (22.50%) and Hispanic adolescents (8.60%).

Measures

Procedure

All procedures performed in our study involving human participants were in accordance with the ethical standards of the Department of Psychology, Hunan Normal University Institutional Review Board and with the 1964 Helsinki declaration as well as its later amendments or comparable ethical standards.

In China, prior to participation, participants were informed about the purpose of the research, and consent forms were sent to their parents. Adolescents participated only if they provided written parental consent and student assent. The GQ–5 was subsequently administered in the classroom to groups of students by trained research assistants during the school day. The participants took about 10 minutes to complete the measure and retained the right to participate or withdraw at any time during the research. To ensure the rights of participants’ confidentiality and anonymity in this study, participants were assigned and identified by a unique code known only to the investigators.

For the American sample, we used an archival dataset provided by four middle schools in one southeastern American state, which was collected as part of an annual school-wide survey of school climate and student well-being. Demographic information was collected through self-report items on the survey. Data collection was performed in a single session. School personnel administered the surveys during the American students’ regular class time. The data were de-identified before being received by the researchers.

Gratitude Questionnaire–5. The GQ–5 is a 5-item self-report scale with a one-factor structure. Each item was rated on a 7-point Likert-type scale (1 = strongly disagree and 7 = strongly agree), and the third item was negatively keyed (e.g., ‘When I look at the world, I don’t see much to be grateful for’). Possible scores ranged from 5 to 35, with higher scores indicating a higher level of gratitude. This scale was adapted from the GQ–6, which was developed by McCullough et al. (Reference Mccullough, Emmons and Tsang2002). The survey instrument was designed in both English and Chinese versions so that students in China took the Chinese version and those in America took the English one. Specifically, the translation of the GQ was originally conducted by a postgraduate student majoring in psychology who had mastered both Chinese and English. After the GQ–5 was translated into Chinese, a second translator back-translated the items into English. Both Chinese and English items were also evaluated by the authors to ensure equivalence in meaning and comparability. In previous studies, the Cronbach’s alpha of the GQ–5 among adolescents ranged from .73 to .80 (Chen et al., Reference Chen, Chen, Kee and Tsai2009; Langer et al., Reference Langer, Ulloa, Aguilar-Parra, Araya-Véliz and Brito2016; Yüksel & Oguz Duran, Reference Yüksel and Oguz Duran2012). In this study, the alpha coefficient of the GQ–5 for the Chinese sample and American sample was 0.74 and 0.77, respectively. The Omega coefficient for the GQ–5 was 0.72 for the Chinese sample and 0.69 for the American sample, respectively. The Cronbach’s alpha values and Omega coefficients indicated that Chinese and American early adolescents’ scores on the scale demonstrated acceptable internal consistency reliability for research purposes.

Data Analysis

Confirmatory factor analysis (CFA) and multi-group confirmatory factor analysis (MGCFA) were conducted in Mplus 7.4. The SPSS Statistics 17.0 was used to calculate the descriptive statistics and internal consistency of the GQ–5. The robust maximum likelihood (MLR) estimator was chosen. We made this decision carefully, because the results of Kolmogorov-Smirnov test showed significant skewness and kurtosis for each item (p < .01), which indicated nonnormality of our data. According to Satorra and Bentler (Reference Satorra and Bentler2001), the MLR estimator with a mean adjusted chi-square (Satorra–Bentler χ2) statistic and robust standard errors yields unbiased goodness-of-fit indices that are robust to non-normal data.

Our data analyses were carried out in three steps. As a first step, two separate CFAs were performed to examine the factorial structure of the GQ–5 for each country. Because of the sensitivity of the χ2 statistic to sample size (i.e., statistically significant χ2 s are often found in large samples, Karl, Reference Karl1996), we utilized multiple indices, such as the standardized root mean square residual (SRMR), non-normal fit index (NNFI/TLI), comparative fit index (CFI), and root mean square error of approximation (RMSEA) to evaluate the model fit. NNFI/TLI and CFI values above 0.95 and SRMR and RMSEA values of less than .08 were considered good (Hu & Bentler, Reference Hu and Bentler1999).

In the second step, MGCFA procedures were used subsequently to examine whether the CHS demonstrated measurement invariance across the Chinese and American students. Measurement invariance tests were done in a hierarchical fashion by conducting an initial analysis (Model 1) in which the only invariance constraint was that the same parameters existed for both groups (configural invariance). When configural invariance was confirmed, subsequent analyses added the additional invariance constraint of equivalent factor loadings to test for metric invariance (Model 2). When metric invariance was met, we imposed constraints on both factor loadings and item intercepts to test for scalar invariance (Model 3). In order to evaluate invariance between different consecutive models, the ΔCFI index and the Bayesian information criterion (BIC) value were used to evaluate invariance among difference consecutive models. According to Cheung and Rensvold (Reference Cheung and Rensvold2002), a ΔCFI ≤ 0.01 supplemented by a smaller BIC value was considered evidence of equivalence (Cheung & Rensvold, Reference Cheung and Rensvold2002). As for BIC, a 0 to 2 difference between two models indicated weak evidence; a 2 to 6 difference indicated positive evidence; a 6 to 10 difference represented strong evidence and if the BIC values differed by more than 10, the difference indicated very strong evidence (Raftery, Reference Raftery1995).

In efforts to identify intercepts of those items found to be invariant and those found to be non-invariant across countries, modification indices (MI) were used to determine which parameters should be freed within the context of partial scalar invariance (Gregorich, Reference Gregorich2006).

Because there were some items that were non-invariant in Model 3, we carried out a subsequent level of analysis to examine the impact of non-invariant items on latent mean differences between the Chinese and American adolescents. In the structural means model, the Chinese group was selected as the reference group and the latent mean of the Chinese group was constrained to 0, while the American group was estimated freely. The critical ratio (CR) was chosen as the index to evaluate whether the latent means were different across groups (Tsaousis & Kazi, Reference Tsaousis and Kazi2013). If the CR > 1.96 or < –1.96, the estimate of equality was rejected. Moreover, positive CR values indicated a higher latent mean for the comparison group relative to the reference group, while negative values indicated a lower latent mean for the comparison group.

Results

Descriptive Statistics, and Item-total Correlations

Table 1 presents descriptive statistics and item-total correlations of the GQ–5 for the Chinese sample and American sample. All statistics presented in Table 1 are standardized.

Table 1. Descriptive Statistics, and Standardized Factor Loadings the GQ–5 in the Two Samples

Note. SD = standard deviation; ITC = item total correlation.

Confirmatory Factor Analyses

The fit indexes of the GQ–5 are summarized in Table 2. As can be observed, all the indexes in the two samples met the criteria. The CFI and TLI values were all above 0.90, and both the RMSEA and the SRMR were less than .08, which suggested that the one-factor model provided a good fit to the Chinese and American data sets. As a result, this model served as the baseline model for the subsequent tests of measurement invariance.

Table 2. Fit Indices for the GQ–5 in the Two Samples

Note. S-Bχ2 = Satorra-Bentler scaled χ2; df = degrees of freedom; CFI = comparative fit index, TLI = non-normal fit index; SRMR = standardized root mean square residual; RMSEA = root mean square error of approximation; 90% CI = limits of the 90% confidence interval for RMSEA.

*** p < .001.

Measurement Invariance across Cultural Groups

We analyzed the invariance of the GQ–5 by computing a multi-group confirmatory analysis through structural equation modeling. Table 3 presents the summary fit indices of five nested models for the multi-group confirmatory factor analysis.

Table 3. Fit Indices (with Corrected Robust Estimation) for Invariance Tests of the GQ–5

Note. Model 1 = Configural invariance model; Model 2 = Metric model; Model 3a = Full scalar invariance model; Model 3b = Scalar invariance model without item 5; Model 3c = Scalar invariance model without item 3 and 5; BIC = Bayesian information criterion.

The configural invariance model, as the baseline model, testing the factorial structure of the measure across two countries with no constraints imposed, displayed adequate fit with the data and supported configural invariance across different cultural groups. With regard to metric invariance, testing the invariance of factor loadings across countries, our results revealed that the model also fit the data very well across cultures. When we compared Model 2 to Model 1, the ΔCFI and the decrease of the BIC supported metric invariance across groups.

Consequently, we proceeded to test for scalar invariance, testing the invariance of the intercepts in the equations for predicting items in addition to factor loadings, and our finding demonstrated that although the scalar invariance model yielded adequate values for the fit indices, full scalar invariance was not observed, given an unsatisfactory ΔCFI and an increased BIC. When we allowed the intercepts of item 5 to vary between Chinese and American samples according to the modification indices (MI = 117.89), we found a ΔCFI = 0.01 and a relatively increased BIC value. Then, we also freed the intercepts of Item 3 on the basis of the highest modification indices of 53.16, and partial invariance was obtained with a ΔCFI = 0.00.

Latent Mean Difference Based on Observed Full Scalar Invariance or Partial Scalar Invariance

Factor means can be compared as long as at least two intercepts are found to be invariant across groups (Steenkamp & Baumgartner, Reference Steenkamp and Baumgartner1998), and such a comparison also has been suggested to provide some insight into the comparability of the mean-level differences comparing full and partial invariance (Byrne & van de Vijver, Reference Byrne and van de Vijver2010). Consequently, we conducted the latent means analyses across culture based on all five items and latent mean analyses across culture based on the two items that showed invariance. Using the five-item model, Chinese adolescents reported significantly lower gratitude scores than American adolescents (SE = 0.04, CR = 17.15, p < .001). With regard to the two-item model, Chinese adolescents also reported a lower level of gratitude than American adolescents (SE = 0.05, CR = 5.24, p < .001).

Discussion

Increasing attention has been paid to the importance of measurement invariance in cross-culture comparisons. Consistent with such attention, this research is the first to test the measurement invariance of the GQ–5 and compare latent means between samples of Chinese and American adolescents. Before testing the measurement invariance of the GQ–5, factor loadings, descriptive statistics, item-total correlations, and CFAs were calculated. The results of tests of factor loadings and item-total correlations provided evidence that all five items could be utilized in this study. Furthermore, the results of the CFAs indicated that the expected one-factor structure fit the data well for both the Chinese and American adolescent samples.

Investigating differences in gratitude among different cultures should provide a fuller understanding of the development, nature, and consequences of gratitude. Our results supported full configural invariance, full metric invariance, and partial scalar invariance of the GQ–5 across the samples from the two countries. Consistent with what had been expected, results of the partial scalar invariance analyses indicated that observed mean differences on the GQ–5 items could not be fully explained by the mean differences in the latent factor. It also suggested being cautious when comparing cross-cultural differences of gratitude between Chinese and American adolescents with the GQ–5, although the final results of the latent mean difference analysis based on full scalar invariance and based on partial scalar invariance were similar. The findings revealed that the Chinese adolescents in our study reported a lower level of gratitude than the American adolescents. Our finding was consistent with Corona et al. (Reference Corona, Senft, Campos, Chen, Shiota and Chentsova-Dutton2020)’s findings, showing that the GQ–5 reports of East Asian adults were lower than Latino and European American adults.

The reasons for the significant group difference remain unclear. One possibility is the influence of collectivism and individualism on children’s level of gratitude. For example, as noted above, persons from more collectivist cultures, like China, are more prone to experience and report other-focused emotions (e.g., sympathy), whereas persons from more individualistic nations are less prone to do so (Markus & Kitayama, Reference Markus and Kitayama1991). For another example, in order to maintain harmony, individuals from collectivistic nations also encourage the suppression of emotions, including positive emotions, more than individuals from individualistic nations (Ruby et al., Reference Ruby, Falk, Heine, Villa and Silberstein2012). Furthermore, Ruby and colleagues (Reference Ruby, Falk, Heine, Villa and Silberstein2012) also reported that individuals from individualistic backgrounds value high-activation positive emotions (e.g., excited, enthusiastic) more than individuals from collectivist backgrounds (Ruby et al., Reference Ruby, Falk, Heine, Villa and Silberstein2012). Therefore, Chinese individuals tend to be more modest than Americans, which may contribute to American adolescents scoring higher than Chinese adolescents in their level of gratitude.

Research has also revealed various culture influence differences in the expression of gratitude specifically. For example, Chinese children are more likely to express connective gratitude and less likely to express verbal and concrete gratitude than American children (Liang, Reference Liang2017). Layous et al. (Reference Layous, Lee, Choi and Lyubomirsky2013) also found that expressing gratitude did not promoting individual well-being equally well, with individuals from collectivistic nations benefitting significantly less from gratitude interventions than the participants from individualistic nations. This finding may be due to the differences in cultural traditions and philosophy, as collectivistic participants reported feelings of indebtedness and guilt along with grateful feelings.

Furthermore, different parental values may influence the level of adolescents’ gratitude. Young children start to gain an understanding of what gratitude means and when expressing gratitude is appropriate by watching their role models (e.g., parents) saying “thank you” and repaying their benefactors when they receive benefits (Liang, Reference Liang2017). Parents in western societies, such as America, attach high value to autonomy and separation, which fosters children’s adaptation to their particular societies. From Kağıtçıbaşı’s (Reference Kağıtçıbaşı2017) perspective, western parents encourage children to think and act autonomously and to consider others’ feelings, thus they may express gratitude by taking the benefactor’s wishes into consideration and repaying the benefactor autonomously (Kağıtçıbaşı, Reference Kağıtçıbaşı2017). In contrast, values, such as family interdependence, relatedness, and obedience, are highly endorsed in Chinese cultures (Yu, Reference Yu2011), which may lead Chinese adolescents to regard the expression of gratitude as a duty instead of an autonomous expression of appreciation. In addition, cultural norms for parent-child relationships may also influence the expression of gratitude. Given that Chinese adolescents appear to bear heavier burdens in a major life domain (i.e., school) than western adolescents (Zhao et al., Reference Zhao, Zhu and Ma2009). And high academic expectations from Chinese parents can therefore easily lead to high academic burdens and pressures on their adolescents (Sun et al., Reference Sun, Dunne and Hou2012). Thus, the relationships between Chinese parents and adolescents are more strained than American adolescents (Zhou, Reference Zhou2015), which may lead Chinese adolescents less gratitude expression.

Finally, the culture of gratitude is highly valued, structured and emotion laden in America, with its celebration of family, home and nation (Siskind, Reference Siskind1992) on Thanksgiving Day. According to Xiangdian (Reference Xiangdian2011), the schools in America provide conditions supporting higher levels of gratitude, such as religious freedom, allowing students to go to churches for religious worship at specific times. In addition, unlike circumstances in Chinese middle schools, American middle school students who are not able to participate in volunteer activities may not only graduate, but also enter high quality institutions to further their education (Xiangdian, Reference Xiangdian2011). Such individualistic cultures may prioritize gratitude for adolescents more in daily life than collectivistic cultures do for Chinese adolescents. Thus, American adolescents would be more likely to report high levels of gratitude than Chinese adolescents.

In reviewing the results of this study, several limitations should be taken into consideration. One limitation of the study was that although large samples were utilized and were quite similar in terms of age, education, and gender breakdown, neither sample was nationally representative, which may limit the generalizability of the findings. Another limitation of the study was that our study employed only one country each to represent individualistic and collectivistic nations, perhaps also limiting the generalizability of the findings. Finally, the current study lacked the inclusion of criterion measures that could have offered more nuanced insights into how gratitude relates to theoretically relevant constructs both in the United States and China. Such comparisons should be examined in the future.

Although our findings provided some preliminary support for the use of the one-factor model of the GQ–5 with American and Chinese adolescents, they provided only partial support for scalar invariance. Thus, our findings suggested that studies of the correlates of GQ–5 scores in American and Chinese adolescents may yield meaningful, but tentative results. Further research is needed to address the generalizability of these findings with GQ–5 scores. Given the possible cultural differences, the finding of partial invariance in our study may not be altogether surprising. Future research will be needed to determine possible subtle differences in the meaning of gratitude across the cultures (e.g., to what extent do Chinese adolescents differentiate gratitude from other related constructs compared to American adolescents). Studies of the comparability of various convergent and discriminant validity matrices for the scores should provide insight into the utilization of the GQ–5 and the nature and development of gratitude in Chinese and American adolescents.

Footnotes

Funding Statement: This research was supported by the Scientific Research Foundation of Hunan Provincial Education Department (Grant No. 19A315) awarded to Dr. Yu Ling.

Conflict of Interest: None.

References

Alarcón, R., & Morales de Isasi, C. (2012). Relaciones entre gratitud y variables de personalidad [Relationship between gratitude and personality variables]. Acta de Investigación Psicológica, 2(2), 699712. http://doi.org/10.22201/fpsi.20074719e.2012.2.183CrossRefGoogle Scholar
Bernabé-Valero, G., García-Alandete, J., & Gallego-Pérez, J. F. (2014). Construcción de un cuestionario para la evaluación de la gratitud: El Cuestionario de Gratitud–20 ítems (G–20) [Construction of a questionnaire for the evaluation of gratitude: The Gratitude Questionnaire – 20 items (G–20)]. Anales de Psicología/Annals of Psychology, 30(1), 278286.Google Scholar
Bono, G., & Froh, J. (2009). Gratitude in school: Benefits to students and schools. In Furlong, M. J., Gilman, R., & Huebner, E. S., (Eds.) Handbook of positive psychology in schools (pp. 95106). Routledge.Google Scholar
Byrne, B. M., & van de Vijver, F. J. R. (2010). Testing for measurement and structural equivalence in large-scale cross-cultural studies: Addressing the issue of nonequivalence. International Journal of Testing, 10(2), 107132. http://doi.org/10.1080/15305051003637306CrossRefGoogle Scholar
Chen, L. H., Chen, M.-Y., Kee, Y. H., & Tsai, Y.-M. (2009). Validation of the Gratitude Questionnaire (GQ) in Taiwanese undergraduate students. Journal of Happiness Studies, 10(6), Article 655. http://doi.org/10.1007/s10902-008-9112-7CrossRefGoogle Scholar
Cheung, F. M., Cheung, S. F., Leung, K., Ward, C., & Leong, F (2003). Clinical validation of the chinese personality assessment inventory. Psychological Assessment, 15(1), 89100. http://doi.org/10.1037/1040-3590.15.1.89.CrossRefGoogle ScholarPubMed
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233255. http://doi.org/10.1207/S15328007SEM0902_5.CrossRefGoogle Scholar
Cohen, A. B. (2006). On gratitude. Social Justice Research, 19(2), 254276. http://doi.org/10.1007/s11211-006-0005-9.CrossRefGoogle Scholar
Corona, K., Senft, N., Campos, B., Chen, C., Shiota, M., & Chentsova-Dutton, Y. E. (2020). Ethnic variation in gratitude and well-being. Emotion, 20, 518524. http://doi.org/10.1037/emo0000582CrossRefGoogle ScholarPubMed
Datu, J. A. D. (2014). Forgiveness, gratitude and subjective well-being among Filipino adolescents. International Journal for the Advancement of Counselling, 36(3), 262273. http://doi.org/10.1007/s10447-013-9205-9CrossRefGoogle Scholar
Datu, J. A. D., & Mateo, N. J. (2015). Gratitude and life satisfaction among Filipino adolescents: The mediating role of meaning in life. International Journal for the Advancement of Counselling, 37(2), 198206. http://doi.org/10.1007/s10447-015-9238-3CrossRefGoogle Scholar
Froh, J. J., Fan, J., Emmons, R. A., Bono, G., Huebner, E. S., & Watkins, P. (2011). Measuring gratitude in youth: Assessing the psychometric properties of adult gratitude scales in children and adolescents. Psychological Assessment, 23(2), 311. http://doi.org/10.1037/a0021590CrossRefGoogle ScholarPubMed
Gilman, R., Huebner, E. S., & Furlong, M. J. (2014). Toward a science and practice of positive psychology in schools: A conceptual framework. In Furlong, M. J., Gilman, R., & Huebner, E. S. (Eds.) Handbook of positive psychology in schools (pp. 1119). Routledge.Google Scholar
Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11), S78S94. http://doi.org/10.1097/01.mlr.0000245454.12228.8fCrossRefGoogle ScholarPubMed
Horn, J. L., & Mcardle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18(3–4), 117144. http://doi.org/10.1080/03610739208253916CrossRefGoogle ScholarPubMed
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 155. http://doi.org/10.1080/10705519909540118.CrossRefGoogle Scholar
Kağıtçıbaşı, Ç. (2017). Family, self, and human development across cultures: Theory and applications. Routledge.CrossRefGoogle Scholar
Karl, G. (1996). LISREL 8: User’s reference guide. Chicago Scientific Software International.Google Scholar
Lambert, N. M., Fincham, F. D., & Stillman, T. F. (2012). Gratitude and depressive symptoms: The role of positive reframing and positive emotion. Cognition & Emotion, 26(4), 615633. http://doi.org/10.1080/02699931.2011.595393CrossRefGoogle ScholarPubMed
Lambert, N. M., Fincham, F. D., Stillman, T. F., & Dean, L. R. (2009). More gratitude, less materialism: The mediating role of life satisfaction. The Journal of Positive Psychology, 4(1), 3242. http://doi.org/10.1080/17439760802216311CrossRefGoogle Scholar
Langer, Á. I., Ulloa, V. G., Aguilar-Parra, J. M., Araya-Véliz, C., & Brito, G. (2016). Validation of a Spanish translation of the Gratitude Questionnaire (GQ–6) with a Chilean sample of adults and high schoolers. Health and Quality of Life Outcomes, 14(1), Article 53. http://doi.org/10.1186/s12955-016-0450-6CrossRefGoogle ScholarPubMed
Layous, K., Lee, H., Choi, I., & Lyubomirsky, S. (2013). Culture matters when designing a successful happiness-increasing activity: a comparison of the United States and south Korea. Journal of Cross-Cultural Psychology, 44(8), 12941303. http://doi.org/10.1177/0022022113487591CrossRefGoogle Scholar
Liang, Y. (2017). Children’s expressions of gratitude and their relations with parental values and parenting: Insights from China and the United States [Doctoral dissertation, The University of North Carolina at Greensboro]. NC Docks. http://libres.uncg.edu/ir/uncg/f/Liang_uncg_0154D_12350.pdfGoogle Scholar
Magno, C., & Orillosa, J. (2012). Gratitude and achievement emotions. Phillipines Journal of Counseling Psychology, 14(1), 2943.Google Scholar
Markus, H. R., & Kitayama, S. (1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98(2), 224253. http://doi.org/10.1037/0033-295X.98.2.224CrossRefGoogle Scholar
Mccullough, M. E., Emmons, R. A., & Tsang, J.-A. (2002). The grateful disposition: A conceptual and empirical topography. Journal of Personality & Social Psychology, 82(1), 112127. http://doi.org/10.1037/0022-3514.82.1.112CrossRefGoogle ScholarPubMed
Mccullough, M. E., Kilpatrick, S. D., Emmons, R. A., & Larson, D. B. (2001). Is gratitude a moral affect? Psychological Bulletin, 127(2), 249266. http://doi.org/10.1037/0033-2909.127.2.249CrossRefGoogle ScholarPubMed
Mccullough, M. E., Tsang, J. A., & Emmons, R. A. (2004). Gratitude in intermediate affective terrain: links of grateful moods to individual differences and daily emotional experience. Journal of Personality & Social Psychology, 86(2), 295309. http://doi.org/10.1037/0022-3514.86.2.295CrossRefGoogle ScholarPubMed
Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111163. https://doi.org/10.2307/271063CrossRefGoogle Scholar
Ruby, M. B., Falk, C. F., Heine, S. J., Villa, C., & Silberstein, O. (2012). Not all collectivisms are equal: Opposing preferences for ideal affect between East Asians and Mexicans. Emotion, 12(6), 12061209. http://doi.org/10.1037/a0029118CrossRefGoogle ScholarPubMed
Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66(4), 507514. http://doi.org/10.1007/BF02296192CrossRefGoogle Scholar
Sinha, J. B. P. (2014). Collectivism and individualism. In Sinha, J. B. P. (Ed.), Psycho-social analysis of the Indian mindset (pp. 2751). Springer.Google Scholar
Siskind, J. (1992). The invention of Thanksgiving: A ritual of American nationality. Critique of Anthropology, 12(2), 167191. https://doi.org/10.1177/0308275X9201200205CrossRefGoogle Scholar
Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78107. https://doi.org/10.1086/209528CrossRefGoogle Scholar
Steenkamp, J.E.M. & Baumgartner, H. (1998), Assessing measurement invariance in cross-national consumer research, Journal of Consumer Research, 25(1), 7890. https://doi.org/10.1086/209528CrossRefGoogle Scholar
Sun, J., Dunne, M. P., & Hou, X.-Y. (2012). Academic stress among adolescents in China. Australasian Epidemiologist, 19(1), 912.Google Scholar
Tian, L., Du, M., & Huebner, E. S. (2015). The effect of gratitude on elementary school students’ subjective well-being in schools: The mediating role of prosocial behavior. Social Indicators Research, 122(3), 887904. http://doi.org/10.1007/s11205-014-0712-9CrossRefGoogle Scholar
Triandis, H. C. (1989). The self and social behavior in differing cultural contexts. Psychological Review, 96(3), 506520. https://doi.org/10.1037/0033-295X.96.3.506CrossRefGoogle Scholar
Tsaousis, I., & Kazi, S. (2013). Factorial invariance and latent mean differences of scores on trait emotional intelligence across gender and age. Personality and Individual Differences, 54(2), 169173. http://doi.org/10.1016/j.paid.2012.08.016CrossRefGoogle Scholar
Valdez, J. P. M., & Chu, S. K. W. (2020). Examining the psychometric validity of the five-item gratitude questionnaire: An item-response theory approach. Journal of Psychoeducational Assessment, 38, 529536. http://doi.org/10.1177/0734282918816542CrossRefGoogle Scholar
Valdez, J. P. M., Yang, W., & Datu, J. A. D. (2017). Validation of the Gratitude Questionnaire in Filipino secondary school students. The Spanish Journal of Psychology, 20, E45. http://doi.org/10.1017/sjp.2017.51CrossRefGoogle ScholarPubMed
Van de Vijver, F., & Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology, 54(2), 119135.http://doi.org/10.1016/j.erap.2003.12.004CrossRefGoogle Scholar
Wang, D., Wang, Y. C., & Tudge, J. R. H. (2015). Expressions of gratitude in children and adolescents: Insights from China and the United States. Journal of Cross-Cultural Psychology, 46(8), 10391058. http://doi.org/10.1177/0022022115594140CrossRefGoogle Scholar
Watkins, P. C., Woodward, K., Stone, T., & Kolts, R. L. (2003). Gratitude and happiness: Development of a measure of gratitude, and relationships with subjective well-being. Social Behavior and Personality: An International Journal, 31(5), 431451. http://doi.org/10.2224/sbp.2003.31.5.431CrossRefGoogle Scholar
Wu, W., Lu, Y., Tan, F., Yao, S., Steca, P., Abela, J. R. Z., & Hankin, B. L. (2012). Assessing measurement invariance of the children’s depression inventory in Chinese and Italian primary school student samples. Assessment, 19(4), 506516. http://doi.org/10.1177/1073191111421286CrossRefGoogle ScholarPubMed
Xiangdian, M. (2011). Characteristics of US-Korea’s Thanksgiving Culture and the enlightenment to gratitude education in China [J]. Journal of Zhejiang Shuren University (Humanities and Social Sciences), 11(6), 114117.Google Scholar
Yokota, K. (2012). The validity of a three-factor model in PPI-R and social dominance orientation in Japanese sample. Personality and Individual Differences, 53(7), 907911. https://doi.org/10.1016/j.paid.2012.07.006CrossRefGoogle Scholar
Yu, J. J. (2011). Reciprocal associations between connectedness and autonomy among Korean adolescents: Compatible or antithetical? Journal of Marriage and Family, 73(4), 692703. http://doi.org/10.1111/j.1741-3737.2011.00839.xCrossRefGoogle Scholar
Yüksel, A., & Oguz Duran, N. (2012). Turkish adaptation of the gratitude questionnaire. Eurasian Journal of Educational Research, 46, 199215.Google Scholar
Zeng, Y., Ling, Y., Huebner, E. S., He, Y., & Lei, X. (2017). The psychometric properties of the 5-item gratitude questionnaire in Chinese adolescents. Journal of Psychiatric & Mental Health Nursing, 24(4), 203210. http://doi.org/10.1111/jpm.12372CrossRefGoogle ScholarPubMed
Zhao, X., Zhu, S., & Ma, G. (2009). Comparison study on basic rights between Chinese, Japanese, Korean, and American high school students. China Youth Study, 6, 17.Google Scholar
Zhou, H. (2015). Longitudinal effect of parent-child interactions on psychological well-being during the transition from adolescence to young adulthood. Chinese Journal of Psychology, 57(1), 6789.Google Scholar
Figure 0

Table 1. Descriptive Statistics, and Standardized Factor Loadings the GQ–5 in the Two Samples

Figure 1

Table 2. Fit Indices for the GQ–5 in the Two Samples

Figure 2

Table 3. Fit Indices (with Corrected Robust Estimation) for Invariance Tests of the GQ–5