The focal article (Grand et al., 2018) addresses one of the most important issues across virtually all areas of science (Goldstein, 2010): the trustworthiness and credibility of a scientific discipline. Once these attributes are lost, it is difficult to regain them within a reasonable time frame, if ever. In contrast to previous articles on this topic (e.g., Kepes & McDaniel, 2013), the authors of the focal article provide a detailed review of the stakeholders surrounding industrial and organizational (I-O) psychology, including their potential effect on the robustness and trustworthiness of our scientific discipline. In essence, the focal article describes I-O psychology's ecosystem responsible for fostering robust and credible science. The authors should be commended for their comprehensive undertaking, and we have no substantive disagreements. However, implicitly, as with most articles on this vital topic, the focal article tends to take a bottom-up approach to decision making and change. The bottom-up approach is an emergent process where the individuals involved in the day-to-day activities are primarily responsible for the decision-making process and resulting change (Kindler, 1979). Thus, changes resulting from this process are incremental and typically involve making minor adjustments to existing processes (Bartunek & Moch, 1987).

Aguinis and Glavas (2013) ask, “When and why does CSR lead to positive outcomes for employees, organizations, and society?” Although the concept of corporate social responsibility (CSR) is elusive and comprises a wide range of definitions, there is convergence on the voluntary nature of these actions. But who implements these voluntary initiatives? CSR will take effect, as Aguinis and Glavas point out, at micro levels, through the actions of lower-level units and employees. Thus, there is a need to specify mechanisms by which macro-level CSR policies result in microlevel outcomes.

Relying on work described by Jackson (2003), Ree, Carretta, and Teachout (2015) recommended researchers use the first unrotated principal component associated with a principal components analysis (PCA) to estimate the strength of a general factor. Arguably, such a recommendation is based on rather old work. Furthermore, it is not a method that can be relied on to yield an accurate solution. For example, it is well known that the first component extracted from a correlation matrix of the Wechsler intelligence subtests is biased toward the verbal comprehension subtests (Ashton, Lee, & Vernon, 2001).

We agree with the authors of the focal article that too little attention is paid to sampling in industrial–organizational (I-O) psychology research. Upon reflection and in response to the focal article by Landers and Behrend (2015), we answer three primary questions: (a) What is it about our training, science, and practice as I-O psychologists that has led to less focus on sampling issues? (b) Does it matter? (c) If so, then what should we do about it?

Various solutions have been proposed to “fix” performance management (PM) over the last several decades. Pulakos, Mueller Hanson, Arad, and Moye (2015) have presented a holistic approach to improving PM in organizations. Although this approach addresses several key elements related to the social context of PM, namely the buy-in of organizational stakeholders, timely and regular feedback, and future-directed feedback, we believe that several robust findings from the PM research literature could further improve this process. Are Pulakos et al. looking at the forest but missing the trees? In the following commentary, we offer several reasons that performance judgments and perhaps even informal ratings are still operating and occurring in the proposed holistic system. Therefore, advancements in other areas of PM research may offer additional ways to fix PM.

Although we echo Lievens and Motowidlo's (2016) view that situational judgment test (SJT) research should subscribe to the construct-driven approach, we disagree with their argument on two counts. First, we question whether measuring general domain knowledge represents the only way to advance SJT research. Second, we question whether it is appropriate to downplay the importance of situations in SJTs. In this commentary, we first briefly review construct-driven SJT studies and then share our own experience in developing an SJT for integrity in China using the construct-driven approach. Based on the review and reflection, we come to two major conclusions: (a) construct-driven SJT research has progressed well so far without the reconceptualization of SJTs as measures of general domain knowledge, and (b) specific situations are an important feature of SJTs that should not yet be dismissed.

Although I wholeheartedly agree with Gloss, Carr, Reichman, Abdul-Nasiru, and Oestereich (2017) that a focus on those living in the deepest forms of poverty is sorely needed in industrial and organizational (I-O) psychology, the real issue is not so much who we serve but how we serve, and specifically how we continue to neglect the systemic failures of capitalism at the root of poverty. Ultimately, it is this global market system that determines not only the distribution of wealth but also how wealth is often achieved at the expense of another's poverty. Moreover, it is this system that constrains and undermines capabilities. For these reasons, I am skeptical of the authors’ proposal for mitigating the pervasive POSH bias in our field, especially because this bias seems premised on a pervasive neglect of capitalism the authors fail to fully address.

In their focal article, Tett, Hundley, and Christiansen (2017) stated in multiple places that if there are good reasons to expect moderating effect(s), the application of an overall validity generalization (VG) analysis (meta-analysis) is “moot,” “irrelevant,” “minimally useful,” and “a misrepresentation of the data.” They used multiple examples and, in particular, a hypothetical example about the relationship between agreeableness and job performance. Four noteworthy problems with the above statements, other similar statements elsewhere in Tett et al.’s article, and their underlying assumptions are discussed below along with alternative perspectives.