Hostname: page-component-745bb68f8f-b95js Total loading time: 0 Render date: 2025-02-07T03:39:32.276Z Has data issue: false hasContentIssue false
  • English
  • Français

Climbing the Higher Mountain: The Challenges of Multilevel, Multisource, and Longitudinal Research Designs

Published online by Cambridge University Press:  02 February 2015

Carol T. Kulik
Carol T. Kulik*
Affiliation:
University of South Australia, Australia
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Management researchers are being encouraged to collect multilevel, multisource, and longitudinal (MML) data. In this essay, I identify the barriers that researchers might encounter in gaining university ethics committee approval for MML designs and the challenges researchers face when conducting MML research in organizations. I offer suggestions to overcome these challenges. I further discuss some long-term consequences of MML designs for researchers' relationships with organizations and the progress of the management field as a whole.

Keywords

longitudinalmultilevelmultisourcepublishingresearch ethics纵向多层次多来源出版研究伦理
Type
Forum Articles
Information
Management and Organization Review , Volume 7 , Issue 3 , November 2011 , pp. 447 - 460
Copyright
Copyright © International Association for Chinese Management Research 2011

References

Arthur, J. B., & Boyles, T. 2007. Validating the human resource system structure: A levels-based strategic HRM approach. Human Resource Management Review, 17(1): 77–92.CrossRefGoogle Scholar
Ashkanasy, N. M. 2010. Publishing today is more difficult than ever. Journal of Organizational Behavior, 31(1): 1–3.CrossRefGoogle Scholar
Azar, B. 2002. Ethics at the cost of research? Psychological Society Observer, 33(2): 38.Google Scholar
Bartram, T. 2005. Small firms, big ideas: The adoption of human resource management in Australian small firms. Asia Pacific Journal of Human Resources, 43(1): 137–154.CrossRefGoogle Scholar
Bartunek, J. M., & Rynes, S. L. 2010. The construction and contributions of ‘implications for practice’: What's in them and what might they offer? Academy of Management Learning & Education, 9(1): 100–117.Google Scholar
Blau, P. M. 1964. Exchange and power in social life. New York, NY: Wiley.Google Scholar
Button, S. B. 2001. Organizational efforts to affirm sexual diversity: A cross-level examination. Journal of Applied Psychology, 88(1): 17–28.CrossRefGoogle Scholar
Cropanzano, R., & Mitchell, M. S. 2005. Social exchange theory: An interdisciplinary review. Journal of Management, 31(6): 874–900.CrossRefGoogle Scholar
Cycyota, C. S., Harrison, D. A., & Stahl, A. S. 2002. Enhancing response rates at the executive level: Are employee- or consumer-level techniques effective? Journal of Management, 28(2): 163–189.CrossRefGoogle Scholar
Dougherty, D. W., & Kramer, M. W. 2005. Organizational power and the institutional review board. Journal of Applied Communication Research, 33(3): 277–284.CrossRefGoogle Scholar
Felps, W., Mitchell, T. R., Hekman, D. R., Lee, T. W., Holtom, B.C., & Harman, W. S. 2009. Turnover contagion: How coworkers' job embeddedness and job search behaviors influence quitting. Academy of Management Journal, 52(3): 545–561.Google Scholar
Gonzalez, J. A., & DeNisi, A. S. 2008. Cross-level effects of demography and diversity climate on organizational attachment and firm effectiveness. Journal of Organizational Behavior, 30(1): 21–40.Google Scholar
Hamilton, A. 2005. The development and operation of TRBs: Medical regulations and social science. Journal of Applied Communication Research, 33(3): 189–203.CrossRefGoogle Scholar
Herdman, A., & McMillan-Capehart, A. 2010. Establishing a diversity program is not enough: Exploring the determinants of diversity climate. Journal of Business and Psychology, 25(1): 39–53.CrossRefGoogle Scholar
House, R., Rousseau, D. M., & Thomas-Hunt, M. 1995. The meso paradigm: A framework for the integration of micro and macro organizational behavior. Research in Organizational Behavior, 17: 71–114.Google Scholar
Hox, J. J. 2010. Multilevel analysis: Techniques and applications (2nd ed.). New York: Routledge.CrossRefGoogle Scholar
Hulin, C. 2001. Applied psychology and science: Differences between research and practice. Applied Psychology: An International Review, 50(2): 201–251.Google Scholar
Jehn, K. A., Rispens, S., & Thatcher, S. M. B. 2010. The effects of conflict asymmetry on work group and individual outcomes. Academy of Management Journal, 53(3): 596–616.CrossRefGoogle Scholar
Kozlowski, S. W. J. 2009. Editorial. Journal of Applied Psychology, 94(1): 1–4.CrossRefGoogle ScholarPubMed
Kulik, C. T. 2005. Editorial: On editing in an international context. Journal of Management, 31(2): 162–166.CrossRefGoogle Scholar
Liu, X., & Batt, R. 2010. How supervisors influence performance: A multilevel study of coaching and group management in technology-mediated services. Personnel Psychology, 63(2): 265–298.CrossRefGoogle Scholar
Malouff, J. M., & Schutte, N. S. 2005. Academic psychologists' perspectives on the human research ethics review process. Australian Psychologist, 40(1): 57–62.CrossRefGoogle Scholar
Matsui, K., Lie, R. K., & Kita, Y. 2007. Two methods of obtaining informed consent in a genetic epidemiological study: Effects on understanding. Journal of Empirical Research on Human Research Ethics, 2(3): 39–48.CrossRefGoogle Scholar
McKay, P. F., Avery, D. R., & Morris, M. A. 2008. Mean racial-ethnic differences in employee sales performance: The moderating role of diversity climate. Personnel Psychology, 61(2): 349–374.CrossRefGoogle Scholar
Nishii, L. H., & Mayer, D. M. 2009. Do inclusive leaders help to reduce turnover in diverse groups? The moderating role of leader-member exchange in the diversity to turnover relationship. Journal of Applied Psychology, 94(6): 1412–1426.Google Scholar
OB-List. 2010. Lucky draws and ethics reviews. [Last accessed 11 April 2011.] Available from URL: http://aomlists.pacc.edu/archives/ob.html Google Scholar
Ostroff, C., & Harrison, D. A. 1999. Meta-analysis, level of analysis, and best estimates of population correlations: Cautions for interpreting meta-analytic results in organizational behavior. Journal of Applied Psychology, 84(2): 260–270.CrossRefGoogle Scholar
Ployhart, R. E., & Vandenberg, R.J. 2010. Longitudinal research: The theory, design, and analysis of change. Journal of Management, 36(1): 94–120.CrossRefGoogle Scholar
Pugh, S. D., Dietz, J., Brief, A. P., & Wiley, J. W. 2008. Looking inside and out: The impact of employee and community demographic composition on organizational diversity climate. Journal of Applied Psychology, 93(6): 1422–1428.CrossRefGoogle ScholarPubMed
Rogelberg, S. G., Luong, A., Sederburg, M. E., & Cristol, D. S. 2000. Employee attitude surveys: Examining the attitudes of noncompliant employees. Journal of Applied Psychology, 85(2): 284–293.CrossRefGoogle ScholarPubMed
Rousseau, D. M., & House, R.J. 1994. Meso organizational behavior: Avoiding three fundamental biases. In Cooper, C. L. & Rousseau, D. M. (Eds.), Trends in organizational behavior (Vol. 1): 13–30. London: Wiley.Google Scholar
Rupp, D. 2011. Ethical issues faced by editors and reviewers. Management and Organization Review, 7(3): 481–493.CrossRefGoogle Scholar
Ryncs, S. L., & McNatt, D. B. 2001. Bringing the organization into organizational research: An examination of academic research inside organizations. Journal of Business and Psychology, 16(1): 3–19.Google Scholar
Ryncs, S. L., Bartunek, J. M., & Daft, R. L. 2001. Across the great divide: Knowledge creation and transfer between practitioners and academics. Academy of Management Journal, 44(2): 340–355.Google Scholar
Rynes, S. L., Colbert, A. E., & Brown, K. G. 2002. HR professionals’ beliefs about effective human resource practices: Correspondence between research and practice. Human Resource Management, 41(2): 149–174.Google Scholar
Sanders, R. M. 2003. Medical research ethics committees and social work research: A hurdle too far? Social Work Education, 22(1): 113–114.Google Scholar
Schwartz, N. 1999. Self-Reports: How the questions shape the answers. American Psychologist, 54(2): 93–105.Google Scholar
Scott, C. R. 2005. Anonymity in applied communication research: Tensions between IRBs, researchers, and human subjects. Journal of Applied Communication Research, 33(3): 242–257.CrossRefGoogle Scholar
Sieber, J. E. 2000. Planning research: Basic ethical decision-making. In Sales, B. D. & Folkman, S. (Eds.), Ethics in research with human participants: 13–26. Washington, DC: American Psychological Association.Google Scholar
Sieber, J. E. 2004. Empirical research on research ethics. Ethics & Behavior, 14(4): 397–412.Google Scholar
Wasti, S. A., & Robert, C. 2004. Out of touch? An evaluation of the correspondence between academic and practitioner concerns in IHRM. Advances in International Management, 15: 207–239.Google Scholar