Introduction
Major depression (a.k.a., major depressive disorder) is the second leading cause of years lived with disability (YLDs) and mental health burden both in Australia and across the globe (Murray et al. Reference Murray, Vos, Lozano, Naghavi, Flaxman, Michaud, Ezzati, Shibuya, Salomon, Abdalla, Aboyans, Abraham, Ackerman, Aggarwal, Ahn, Ali, Alvarado, Anderson, Anderson, Andrews, Atkinson, Baddour, Bahalim, Barker-Collo, Barrero, Bartels, Basanez, Baxter, Bell, Benjamin, Bennett, Bernabe, Bhalla, Bhandari, Bikbov, Bin Abdulhak, Birbeck, Black, Blencowe, Blore, Blyth, Bolliger, Bonaventure, Boufous, Bourne, Boussinesq, Braithwaite, Brayne, Bridgett, Brooker, Brooks, Brugha, Bryan-Hancock, Bucello, Buchbinder, Buckle, Budke, Burch, Burney, Burstein, Calabria, Campbell, Canter, Carabin, Carapetis, Carmona, Cella, Charlson, Chen, Cheng, Chou, Chugh, Coffeng, Colan, Colquhoun, Colson, Condon, Connor, Cooper, Corriere, Cortinovis, de Vaccaro, Couser, Cowie, Criqui, Cross, Dabhadkar, Dahiya, Dahodwala, Damsere-Derry, Danaei, Davis, De Leo, Degenhardt, Dellavalle, Delossantos, Denenberg, Derrett, Des Jarlais, Dharmaratne, Dherani, Diaz-Torne, Dolk, Dorsey, Driscoll, Duber, Ebel, Edmond, Elbaz, Ali, Erskine, Erwin, Espindola, Ewoigbokhan, Farzadfar, Feigin, Felson, Ferrari, Ferri, Fevre, Finucane, Flaxman, Flood, Foreman, Forouzanfar, Fowkes, Fransen, Freeman, Gabbe, Gabriel, Gakidou, Ganatra, Garcia, Gaspari, Gillum, Gmel, Gonzalez-Medina, Gosselin, Grainger, Grant, Groeger, Guillemin, Gunnell, Gupta, Haagsma, Hagan, Halasa, Hall, Haring, Haro, Harrison, Havmoeller, Hay, Higashi, Hill, Hoen, Hoffman, Hotez, Hoy, Huang, Ibeanusi, Jacobsen, James, Jarvis, Jasrasaria, Jayaraman, Johns, Jonas, Karthikeyan, Kassebaum, Kawakami, Keren, Khoo, King, Knowlton, Kobusingye, Koranteng, Krishnamurthi, Laden, Lalloo, Laslett, Lathlean, Leasher, Lee, Leigh, Levinson, Lim, Limb, Lin, Lipnick, Lipshultz, Liu, Loane, Ohno, Lyons, Mabweijano, MacIntyre, Malekzadeh, Mallinger, Manivannan, Marcenes, March, Margolis, Marks, Marks, Matsumori, Matzopoulos, Mayosi, McAnulty, McDermott, McGill, McGrath, Medina-Mora, Meltzer, Mensah, Merriman, Meyer, Miglioli, Miller, Miller, Mitchell, Mock, Mocumbi, Moffitt, Mokdad, Monasta, Montico, Moradi-Lakeh, Moran, Morawska, Mori, Murdoch, Mwaniki, Naidoo, Nair, Naldi, Narayan, Nelson, Nelson, Nevitt, Newton, Nolte, Norman, Norman, O'Donnell, O'Hanlon, Olives, Omer, Ortblad, Osborne, Ozgediz, Page, Pahari, Pandian, Rivero, Patten, Pearce, Padilla, Perez-Ruiz, Perico, Pesudovs, Phillips, Phillips, Pierce, Pion, Polanczyk, Polinder, Pope, Popova, Porrini, Pourmalek, Prince, Pullan, Ramaiah, Ranganathan, Razavi, Regan, Rehm, Rein, Remuzzi, Richardson, Rivara, Roberts, Robinson, De Leon, Ronfani, Room, Rosenfeld, Rushton, Sacco, Saha, Sampson, Sanchez-Riera, Sanman, Schwebel, Scott, Segui-Gomez, Shahraz, Shepard, Shin, Shivakoti, Singh, Singh, Singh, Singleton, Sleet, Sliwa, Smith, Smith, Stapelberg, Steer, Steiner, Stolk, Stovner, Sudfeld, Syed, Tamburlini, Tavakkoli, Taylor, Taylor, Taylor, Thomas, Thomson, Thurston, Tleyjeh, Tonelli, Towbin, Truelsen, Tsilimbaris, Ubeda, Undurraga, van der Werf, van Os, Vavilala, Venketasubramanian, Wang, Wang, Watt, Weatherall, Weinstock, Weintraub, Weisskopf, Weissman, White, Whiteford, Wiebe, Wiersma, Wilkinson, Williams, Williams, Witt, Wolfe, Woolf, Wulf, Yeh, Zaidi, Zheng, Zonies, Lopez, AlMazroa and Memish2012; Ferrari et al. Reference Ferrari, Charlson, Norman, Patten, Freedman, Murray, Vos and Whiteford2013). Implementing strategies to reduce the burden of major depression has, in turn, become a top mental health priority (Pirkis et al. Reference Pirkis, Hickie, Young, Burns, Highet and Davenport2005; WHO, 2012). Conventional treatments for major depression (e.g., antidepressant drugs and psychological therapy) are efficacious and cost-effective (Whiteford et al. Reference Whiteford, Harris and Diminic2013), but are constrained in their capacity to reduce the population burden of major depression (Andrews et al. Reference Andrews, Issakidis, Sanderson, Corry and Lapsley2004; Jorm, Reference Jorm2014). For example, Andrews et al. (Reference Andrews, Issakidis, Sanderson, Corry and Lapsley2004) found that around 66% of the overall burden of major depression would remain unaverted by evidence-based treatments despite an optimal effective coverage of 100%. This highlights the importance of disease prevention as an alternate strategy for reducing the burden of major depression.
Most depressive disorders have their initial onset during the formative years of childhood and adolescence (Thapar et al. Reference Thapar, Collishaw, Pine and Thapar2012; Patton et al. Reference Patton, Coffey, Romaniuk, Mackinnon, Carlin, Degenhardt, Olsson and Moran2014). In turn, schools are increasingly being recognised as an important platform for the widespread delivery of preventive mental health interventions (Fazel et al. Reference Fazel, Hoagwood, Stephan and Ford2014a , Reference Fazel, Patel, Thomas and Tol b ). School-based prevention interventions for depression typically involve delivering a series of modules that have been adapted from conventional psychotherapeutic interventions (usually cognitive-behavioural therapy or CBT) and are categorised according to the target population (Stockings et al. Reference Stockings, Degenhardt, Dobbins, Lee, Erskine, Whiteford and Patton2016). These include: (1) ‘universal prevention’ which targets everyone in the population regardless of underlying risk; (2) ‘selective prevention’ which targets population subgroups with an elevated risk profile (e.g., children of parents with a mental illness or pregnant women at risk of perinatal depression); and (3) ‘indicated prevention’ which targets high-risk individuals with subthreshold symptoms that fall just below the diagnostic threshold for a mental disorder (Mrazek & Haggerty, Reference Mrazek and Haggerty1994).
A recent review demonstrated that school-based psychological interventions are cost-effective in preventing the onset of depressive disorders in youth (Mihalopoulos & Chatterton, Reference Mihalopoulos and Chatterton2015). Likewise, an Australian study by Mihalopoulos et al. (Reference Mihalopoulos, Vos, Pirkis and Carter2012) found that delivering a school-based indicated prevention intervention to youth aged 11–17 years was cost-effective. Since the publication of these studies, however, there have been several advances in the literature with regards to: (1) the epidemiology of depression (Slade et al. Reference Slade, Johnston, Oakley Browne, Andrews and Whiteford2009; Vos et al. Reference Vos, Barber, Bell, Bertozzi-Villa, Biryukov, Bolliger, Charlson, Davis, Degenhardt, Dicker, Duan, Erskine, Feigin, Ferrari, Fitzmaurice, Fleming, Graetz, Guinovart, Haagsma, Hansen, Hanson, Heuton, Higashi, Kassebaum, Kyu, Laurie, Liang, Lofgren, Lozano, MacIntyre, Moradi-Lakeh, Naghavi, Nguyen, Odell, Ortblad, Roberts, Roth, Sandar, Serina, Stanaway, Steiner, Thomas, Vollset, Whiteford, Wolock, Ye, Zhou, Ãvila, Aasvang, Abbafati, Ozgoren, Abd-Allah, Aziz, Abera, Aboyans, Abraham, Abraham, Abubakar, Abu-Raddad, Abu-Rmeileh, Aburto, Achoki, Ackerman, Adelekan, Ademi, Adou, Adsuar, Arnlov, Agardh, Al Khabouri, Alam, Alasfoor, Albittar, Alegretti, Aleman, Alemu, Alfonso-Cristancho, Alhabib, Ali, Alla, Allebeck, Allen, AlMazroa, Alsharif, Alvarez, Alvis-Guzman, Ameli, Amini, Ammar, Anderson, Anderson, Antonio, Anwari, Apfel, Arsenijevic, Artaman, Asghar, Assadi, Atkins, Atkinson, Badawi, Bahit, Bakfalouni, Balakrishnan, Balalla, Banerjee, Barker-Collo, Barquera, Barregard, Barrero, Basu, Basu, Baxter, Beardsley, Bedi, Beghi, Bekele, Bell, Benjet, Bennett, Bensenor, Benzian, Bernabe, Beyene, Bhala, Bhalla, Bhutta, Bienhoff, Bikbov, Abdulhak, Blore, Blyth, Bohensky, Basara, Borges, Bornstein, Bose, Boufous, Bourne, Boyers, Brainin, Brauer, Brayne, Brazinova, Breitborde, Brenner, Briggs, Brooks, Brown, Brugha, Buchbinder, Buckle, Bukhman, Bulloch, Burch, Burnett, Cardenas, Cabral, Nonato, Campuzano, Carapetis, Carpenter, Caso, Castaneda-Orjuela, Catala-Lopez, Chadha, Chang, Chen, Chen, Chiang, Chimed-Ochir, Chowdhury, Christensen, Christophi, Chugh, Cirillo, Coggeshall, Cohen, Colistro, Colquhoun, Contreras, Cooper, Cooper, Cooperrider, Coresh, Cortinovis, Criqui, Crump, Cuevas-Nasu, Dandona, Dandona, Dansereau, Dantes, Dargan, Davey, Davitoiu, Dayama, De la Cruz-Gongora, de la Vega, De Leo, del Pozo-Cruz, Dellavalle, Deribe, Derrett, Des Jarlais, Dessalegn, deVeber, Dharmaratne, Diaz-Torne, Ding, Dokova, Dorsey, Driscoll, Duber, Durrani, Edmond, Ellenbogen, Endres, Ermakov, Eshrati, Esteghamati, Estep, Fahimi, Farzadfar, Fay, Felson, Fereshtehnejad, Fernandes, Ferri, Flaxman, Foigt, Foreman, Fowkes, Franklin, Furst, Futran, Gabbe, Gankpe, Garcia-Guerra, Geleijnse, Gessner, Gibney, Gillum, Ginawi, Giroud, Giussani, Goenka, Goginashvili, Gona, de Cosio, Gosselin, Gotay, Goto, Gouda, Guerrant, Gugnani, Gunnell, Gupta, Gupta, Gutierrez, Hafezi-Nejad, Hagan, Halasa, Hamadeh, Hamavid, Hammami, Hankey, Hao, Harb, Haro, Havmoeller, Hay, Hay, Hedayati, Pi, Heydarpour, Hijar, Hoek, Hoffman, Hornberger, Hosgood, Hossain, Hotez, Hoy, Hsairi, Hu, Hu, Huang, Huang, Huiart, Husseini, Iannarone, Iburg, Innos, Inoue, Jacobsen, Jassal, Jeemon, Jensen, Jha, Jiang, Jiang, Jonas, Joseph, Juel, Kan, Karch, Karimkhani, Karthikeyan, Katz, Kaul, Kawakami, Kazi, Kemp, Kengne, Khader, Khalifa, Khan, Khan, Khang, Khonelidze, Kieling, Kim, Kim, Kimokoti, Kinfu, Kinge, Kissela, Kivipelto, Knibbs, Knudsen, Kokubo, Kosen, Kramer, Kravchenko, Krishnamurthi, Krishnaswami, Defo, Bicer, Kuipers, Kulkarni, Kumar, Kumar, Kwan, Lai, Lalloo, Lam, Lan, Lansingh, Larson, Larsson, Lawrynowicz, Leasher, Lee, Leigh, Leung, Levi, Li, Li, Li, Liang, Lim, Lin, Lind, Lindsay, Lipshultz, Liu, Lloyd, Ohno, Logroscino, Looker, Lopez, Lopez-Olmedo, Lortet-Tieulent, Lotufo, Low, Lucas, Lunevicius, Lyons, Ma, Ma, Mackay, Majdan, Malekzadeh, Mapoma, Marcenes, March, Margono, Marks, Marzan, Masci, Mason-Jones, Matzopoulos, Mayosi, Mazorodze, McGill, McGrath, McKee, McLain, McMahon, Meaney, Mehndiratta, Mejia-Rodriguez, Mekonnen, Melaku, Meltzer, Memish, Mensah, Meretoja, Mhimbira, Micha, Miller, Mills, Mitchell, Mock, Moffitt, Ibrahim, Mohammad, Mokdad, Mola, Monasta, Montico, Montine, Moore, Moran, Morawska, Mori, Moschandreas, Moturi, Moyer, Mozaffarian, Mueller, Mukaigawara, Murdoch, Murray, Murthy, Naghavi, Nahas, Naheed, Naidoo, Naldi, Nand, Nangia, Narayan, Nash, Nejjari, Neupane, Newman, Newton, Ng, Ngalesoni, Nhung, Nisar, Nolte, Norheim, Norman, Norrving, Nyakarahuka, Oh, Ohkubo, Omer, Opio, Ortiz, Pandian, Panelo, Papachristou, Park, Parry, Caicedo, Patten, Paul, Pavlin, Pearce, Pedraza, Pellegrini, Pereira, Perez-Ruiz, Perico, Pervaiz, Pesudovs, Peterson, Petzold, Phillips, Phillips, Phillips, Piel, Plass, Poenaru, Polanczyk, Polinder, Pope, Popova, Poulton, Pourmalek, Prabhakaran, Prasad, Qato, Quistberg, Rafay, Rahimi, Rahimi-Movaghar, Rahman, Raju, Rakovac, Rana, Razavi, Refaat, Rehm, Remuzzi, Resnikoff, Ribeiro, Riccio, Richardson, Richardus, Riederer, Robinson, Roca, Rodriguez, Rojas-Rueda, Ronfani, Rothenbacher, Roy, Ruhago, Sabin, Sacco, Ksoreide, Saha, Sahathevan, Sahraian, Sampson, Sanabria, Sanchez-Riera, Santos, Satpathy, Saunders, Sawhney, Saylan, Scarborough, Schoettker, Schneider, Schwebel, Scott, Seedat, Sepanlou, Serdar, Servan-Mori, Shackelford, Shaheen, Shahraz, Levy, Shangguan, She, Sheikhbahaei, Shepard, Shi, Shibuya, Shinohara, Shiri, Shishani, Shiue, Shrime, Sigfusdottir, Silberberg, Simard, Sindi, Singh, Singh, Skirbekk, Sliwa, Soljak, Soneji, Soshnikov, Speyer, Sposato, Sreeramareddy, Stoeckl, Stathopoulou, Steckling, Stein, Stein, Steiner, Stewart, Stork, Stovner, Stroumpoulis, Sturua, Sunguya, Swaroop, Sykes, Tabb, Takahashi, Tan, Tandon, Tanne, Tanner, Tavakkoli, Taylor, Te Ao, Temesgen, Have, Tenkorang, Terkawi, Theadom, Thomas, Thorne-Lyman, Thrift, Tleyjeh, Tonelli, Topouzis, Towbin, Toyoshima, Traebert, Tran, Trasande, Trillini, Truelsen, Trujillo, Tsilimbaris, Tuzcu, Ukwaja, Undurraga, Uzun, van Brakel, van de Vijver, Dingenen, van Gool, Varakin, Vasankari, Vavilala, Veerman, Velasquez-Melendez, Venketasubramanian, Vijayakumar, Villalpando, Violante, Vlassov, Waller, Wallin, Wan, Wang, Wang, Wang, Warouw, Weichenthal, Weiderpass, Weintraub, Werdecker, Wessells, Westerman, Wilkinson, Williams, Williams, Woldeyohannes, Wolfe, Wong, Wong, Woolf, Wright, Wurtz, Xu, Yang, Yano, Yenesew, Yentur, Yip, Yonemoto, Yoon, Younis, Yu, Kim, Zaki, Zhang, Zhao, Zhao, Zhu, Zonies, Zunt, Salomon and Murray2015); (2) the efficacy of universal school-based prevention (Merry et al. Reference Merry, Hetrick, Cox, Brudevold-Iversen, Bir and McDowell2011); and (3) internet-based delivery of psychological interventions as an alternative to face-to-face delivery (Andrews & Titov, Reference Andrews and Titov2010; Calear & Christensen, Reference Calear and Christensen2010). To date, no study has concurrently analysed the population cost-effectiveness of universal and indicated prevention interventions among youth, delivered via the internet or face-to-face. Our study will build upon previous work undertaken by Mihalopoulos et al. (Reference Mihalopoulos, Vos, Pirkis and Carter2012) which examined the cost-effectiveness of indicated prevention for depression in Australian school students. It aims to: (1) examine the population cost-effectiveness (i.e., value for money) of delivering indicated and universal prevention services to youth in the population aged 11–17 years via primary and secondary schools in Australia; and (2) compare the comparative cost-effectiveness of delivering these interventions using face-to-face and internet-based delivery mechanisms.
Methods
Analytic approach
This economic evaluation used a standardised approach for assessing cost-effectiveness (ACE) previously developed for evaluating health care interventions in the Australian context (Carter et al. Reference Carter, Vos, Moodie, Haby, Magnus and Mihalopoulos2008; Mihalopoulos et al. Reference Mihalopoulos, Carter, Pirkis and Vos2013). We reviewed literature on the prevention of depression to identify all interventions targeting youth aged 5–17 years that: (1) would be suitable for implementation in Australia; and (2) had evidence of efficacy to support analysis. Multiple studies of the same type of intervention were combined in a meta-analysis. We excluded studies that were too heterogeneous to: enable a precise definition of the intervention and comparator; or accurate measurement of resources used. Interventions were selected based on the strength of evidence of effectiveness (internal validity) and generalisability of the setting/population to the Australian context (external validity).
We developed a decision-analytic model to calculate the costs and benefits of implementing chosen interventions in the Australian context among youth aged 11–17 years (see Section 1.2 of the supplementary appendix for rationale). The baseline analysis modelled intervention pathways using best available information on costs and benefits from a range of data sources for demography, disease epidemiology and burden, health system costs and cost offsets that best describe services in the Australian context. In the absence of Australia-specific information, we used data from intervention trials to inform decision modelling. Assumptions were made to fill data gaps for several model parameters, which were tested in subsequent univariate sensitivity analyses. Detailed inclusion criteria for input model parameters are shown in Section 1 of the supplementary appendix. This study adopted a ‘health and education’ sector perspective, which encompassed the cost and health consequences accruing to: students and parents; school staff; health care providers; and third-party payers. Productivity costs (i.e., decreased labour productivity and/or absenteeism attributable to poor health) fall beyond the health/education sector and were thus excluded. Time and travel costs of intervention participants were excluded from the baseline analysis, but included in a sensitivity analysis.
We conducted a cost-utility analysis, which evaluated health outcomes using Disability-adjusted Life Years (DALYs), rather than the Quality-adjusted Life Year (QALY) measure. These were calculated using disability weights that employ a standardised set of weights across all diseases (Salomon et al. Reference Salomon, Haagsma, Davis, de Noordhout, Polinder, Havelaar, Cassini, Devleesschauwer, Kretzschmar, Speybroeck, Murray and Vos2015). We developed a cost-effectiveness model using Microsoft Excel 2013 to calculate incremental cost-effectiveness ratios (ICERs), which were evaluated with respect to a willingness-to-pay threshold of $50 000 per DALY averted commonly used in Australia (Harris et al. Reference Harris, Hill, Chin, Li and Walkom2008; Vos et al. Reference Vos, Carter, Barendregt, Mihalopoulos, Veerman, Magnus, Cobiac and Bertram2010). The costs and benefits of the intervention were both discounted at a rate of 3% per annum with respect to a 2013 reference year. Health price deflators from the Australian Institute of Health and Welfare (AIHW) were used to convert costs into 2013 Australian dollars (AIHW, 2014). This study conforms to Consolidated Health Economic Evaluation Reporting Standards (CHEERS) (Husereau et al. Reference Husereau, Drummond, Petrou, Carswell, Moher, Greenberg, Augustovski, Briggs, Mauskopf, Loder and Force2013).
Intervention effect sizes for face-to-face delivery
A meta-review by Stockings et al. (Reference Stockings, Degenhardt, Dobbins, Lee, Erskine, Whiteford and Patton2016) collected data from randomised control trials (RCTs) comparing the efficacy of interventions preventing the onset of major depression in youth aged 5–18 years relative to no intervention, placebo or usual care. The inclusion criteria for our model encompassed RCT studies evaluating changes to the number of incident cases of major depression regardless of whether they are measured using structured clinical interviews or cut-offs on a depression symptom rating scale. We excluded RCT studies evaluating outcomes with respect to changes in the mean score on a depression symptom rating scale. This was due to methodological difficulties in determining how changes to a mean score on a depression scale translate into corresponding changes to the number of incident cases.
We found sufficient evidence to meta-analyse three face-to-face intervention types: (1) universal prevention involving group-based psychological interventions delivered to all participating school students; (2) indicated prevention involving group-based psychological interventions delivered to students with subthreshold depression; and (3) indicated prevention involving self-help bibliotherapy delivered to students with subthreshold depression. Group-based psychological interventions typically involve: a teacher or external facilitator; delivering a series of intervention modules based on psychotherapeutic approaches such as CBT; to a group of students in the classroom setting. By contrast, self-help bibliotherapy involves students reading a book containing adapted psychotherapeutic modules.
We calculated pooled intervention effect sizes (expressed as a risk ratio) for each intervention type at: post-intervention, 6-month follow-up, 1-year follow-up and 2-year follow-up. Intervention outcomes were meta-analysed using the ‘quality effects’ (QE) model – which gives greater weight to studies that have a lower risk of bias, as measured using the Cochrane Collaboration's Risk of Bias tool (Doi et al. Reference Doi, Barendregt, Khan, Thalib and Williams2015). All meta-analyses were conducted using MetaXL 3.0, an Excel add-in developed by EpiGear International Pty Ltd (EpiGear, 2015).
Intervention effect sizes for internet-based delivery
The policy relevance of internet-delivered prevention interventions (Calear & Christensen, Reference Calear and Christensen2010; Reyes-Portillo et al. Reference Reyes-Portillo, Mufson, Greenhill, Gould, Fisher, Tarlow and Rynn2014; O'Dea et al. Reference O'Dea, Calear and Perry2015) provided a clear rationale for modelling online prevention interventions. However, two relevant RCTs identified in the meta-review, which examine the efficacy of internet-delivered prevention interventions (Calear et al. Reference Calear, Christensen, Mackinnon, Griffiths and O'Kearney2009; Wong et al. Reference Wong, Kady, Mewton, Sunderland and Andrews2014), were excluded as they reported changes to mean scores on a depression scale. A way of modelling online prevention interventions would involve assuming that their effect sizes would be equal to some proportion of the pooled intervention effect sizes calculated for face-to-face prevention interventions. This assumption is somewhat reasonable as treatment interventions for adult mental disorders have comparable efficacy when delivered through either face-to-face or internet-delivered modalities (Calear & Christensen, Reference Calear and Christensen2010; Cuijpers et al. Reference Cuijpers, Donker, van Straten, Li and Andersson2010; Andersson et al. Reference Andersson, Cuijpers, Carlbring, Riper and Hedman2014). However, we deemed this assumption too heroic and excluded internet-based prevention interventions from the baseline model; choosing instead to model them in a sensitivity analysis.
Modelling intervention pathways
In the baseline analysis, we chose to model intervention pathways for which we derived pooled intervention effect sizes that reached the 5% level of significance. Universal and indicated psychological interventions were included in the baseline model, while indicated bibliotherapy was excluded (see Section 2 of the supplementary appendix). The structure of the model was based on intervention pathways adapted from the intervention literature. The steps for modelling universal and indicated psychological prevention broadly involved: (1) identifying the population eligible to receive the intervention; (2) estimating health benefits occurring in hypothetical ‘intervention’ and ‘comparator’ scenarios; and (3) calculating the costs associated with each scenario. A comparative analysis was conducted whereby we evaluated the total health impacts and costs that accrue under an intervention scenario with reference to a ‘no intervention’ counterfactual scenario. The intervention scenario simulated how the widespread delivery of universal and indicated prevention would impact on the incidence of depression in the eligible population.
Eligible population
The population eligible for intervention differed between universal and indicated prevention interventions. Both intervention pathways start with youth aged 11–17 years in the 2013 Australian population. In the case of universal prevention, the eligible population involved youth: (1) who attend a participating school; and (2) whose parent's/guardian's provide consent for their children to participate in the intervention. Ambiguity around the true likelihood of school participation in the population led us to assume a 100% participation rate (an assumption we tested in a sensitivity analysis); while the proportion of students who obtain parental consent was based on available data extracted from intervention studies. The eligible population for indicated prevention encompassed students with subthreshold depression. Identifying these students involved: (1) screening students at participating schools for elevated depressive symptoms; and (2) conducting further diagnostic testing to identify students without a depression diagnosis. Like universal prevention, we assumed a 100% school participation rate (the impact of which was tested in a sensitivity analysis). The intervention pathway next involved screening for subthreshold depression by assuming in-class dissemination of the Center for Epidemiologic Studies Depression Scale (CES-D). Students who scored above a CES-D cut-off of 16 would be invited to undergo a diagnostic clinical interview with a psychologist. Those subsequently failing to meet diagnostic criteria for major depression were identified as having subthreshold depression. The student participation rate was, once again, calculated using available data from intervention studies. Detailed methods describing the calculation of the eligible population (partitioned by age and sex) are presented in Section 3 of the supplementary appendix.
Health benefit modelling
We developed a multiple cohort Markov model to simulate disease dynamics that would occur with/without the delivery of universal and indicated prevention interventions (Habbema et al. Reference Habbema, Boer, Barendregt, Killewo, Heggenhougen and Quah2010; Lee et al. Reference Lee, Veerman and Barendregt2013). An adapted DisMod 2 model was used to simulate how a population cohort moves between three health states over time – i.e., healthy, diseased and dead (Barendregt et al. Reference Barendregt, Van Oortmarssen, Vos and Murray2003). In the universal prevention scenario, the ‘healthy’ and ‘diseased’ health states respectively correspond with those in the at-risk population and those with major depression. For indicated prevention, the ‘healthy’ state was substituted by a ‘subthreshold depression’ state encompassing the eligible population with subthreshold depression. Transitions between health states correspond with known epidemiological parameters (i.e., incidence, remission, case fatality and other mortality). Diagrams of these models are presented in Section 4.1 of the appendix. Our model calculated annual transitions between health states for each age-sex cohort over a 10-year time horizon – which is sufficient to evaluate the health impacts of preventive interventions (Tan-Torres Edejer et al. Reference Tan-Torres Edejer, Baltussen, Adam, Hutubessy, Acharya, Evans and Murray2003). The model assumed that all interventions are fully implemented and operate under ‘steady state’ conditions – i.e., trained staff and necessary infrastructure are available to deliver all interventions, which operate in accordance with their effectiveness potential (Carter et al. Reference Carter, Moodie, Markwick, Magnus, Vos, Swinburn and Haby2009; Vos et al. Reference Vos, Carter, Barendregt, Mihalopoulos, Veerman, Magnus, Cobiac and Bertram2010).
In the baseline analysis, we modelled intervention effect sizes for follow-up points that reached a 5% level of significance; assuming a null intervention effect size (i.e., no effect) for follow-up points that did not reach statistical significance. The impact of modelling non-significant intervention effect sizes and extrapolating intervention effects using an exponential decay function over the longer term was tested in a sensitivity analysis. Previous meta-analyses included RCTs that measure the number of incident cases using cut-offs on a depression rating scale (Merry et al. Reference Merry, Hetrick, Cox, Brudevold-Iversen, Bir and McDowell2011). There are, however, criticisms regarding the diagnostic validity of depression rating scales (Stockings et al. Reference Stockings, Degenhardt, Lee, Mihalopoulos, Liu, Hobbs and Patton2015). As such, we conducted a sensitivity analysis to test the impact of modelling pooled intervention effect sizes that only include RCTs using a structured clinical interview. In the baseline model, we also meta-analysed RCTs regardless of whether they used an intention-to-treat (ITT) approach or not. A subsequent assumption in the model was that pooled effect sizes account for imperfect adherence (i.e., non-compliance and loss to follow-up) based on an ITT approach. A sensitivity analysis was conducted to test the validity of this assumption by modelling pooled intervention effect sizes based solely on RCTs using an ITT approach.
Our model calculated the total life years lived under the intervention and comparator scenarios, whereby the impact of prevention involved reductions in the current incidence of major depression – i.e., multiplying the incidence rate with the risk ratio of intervention efficacy at applicable time points over the 10-year time horizon. Mitigating the number of healthy (or subthreshold) people who transition to the depressed health state leads to: fewer prevalent YLDs; and a greater number of life years lived via a reduction in excess deaths attributable to major depression. The joint impacts on morbidity and mortality, in turn, lead to a greater number of DALYs averted in the intervention population relative to the comparator. The approach used by this model to simulate the transition from being at-risk to becoming depressed differs from that used by Mihalopoulos et al. (Reference Mihalopoulos, Vos, Pirkis and Carter2012) – which used transition probability data derived from RCT studies, rather than population incidence rates.
Prevalent YLDs were calculated by multiplying the prevalence rate calculated by the model with an appropriate disability weight. In the baseline analysis, we derived a composite disability weight for major depression by calculating the weighted average of GBD 2013 disability weights for mild, moderate and severe depression (Salomon et al. Reference Salomon, Haagsma, Davis, de Noordhout, Polinder, Havelaar, Cassini, Devleesschauwer, Kretzschmar, Speybroeck, Murray and Vos2015). This weighted average was based on a severity distribution derived from the GBD study (Ferrari et al. Reference Ferrari, Charlson, Norman, Patten, Freedman, Murray, Vos and Whiteford2013); which calculated the comorbidity-adjusted proportion of mild, moderate and severe depression using validated SF-12 cut-offs from the 1997 National Survey of Mental Health and Wellbeing (NSMHWB) (Burstein et al. Reference Burstein, Fleming, Haagsma, Salomon, Vos and Murray2015). We conducted a sensitivity analysis to test the impact of using an alternative severity distribution based on DSM-IV diagnostic algorithms for mild, moderate and severe depression in the 1997 NSMHWB – as used in the previous study by Mihalopoulos et al. (Reference Mihalopoulos, Vos, Pirkis and Carter2012). In addition, we conducted a sensitivity analysis to test the impact of using utility weights, in the place of disability weights, to calculate QALYs. We sourced data from a meta-analysis by Mohiuddin & Payne (Reference Mohiuddin and Payne2014) which calculated pooled utility weights for the most common direct and indirect valuation methods used to elicit utilities for major depression – i.e., standard gamble (direct) and EuroQol-5-dimension (EQ-5D) (indirect). Input epidemiologic parameters are briefly outlined in Table 1, with detailed methods presented in Section 4 of the supplementary appendix.
Table 1. Input parameters and uncertainty ranges for health benefit modelling
95% CI, Confidence Interval; CES-D, Center for Epidemiologic Studies Depression Scale; GBD, Global Burden of Disease study; NSMHWB, National Survey of Mental Health and Wellbeing; s.e., standard error.
**Effect size p-value < 0.05.
a Values for the 13-year-olds used for the 11- and 12-year-olds.
b Incidence reflects average depressive episode duration of 29.9 weeks. See Online Supplementary Appendix for detailed methods on how GBD 2013 incidence estimates were adjusted to reflect an average episode duration of 29.9 weeks.
c This is the weighted average of disability weights for mild, moderate and severe depression which were combined using a severity distribution (i.e., proportion of mild, moderate and severe cases) derived from the GBD study.
Costing analysis
The baseline model assumed that intervention delivery would occur via the public sector. The costs for face-to-face universal prevention involved intervention delivery through secondary school teachers who are trained by a salaried psychologist to teach intervention material during class hours. By contrast, the costs for face-to-face indicated prevention included: (1) using trained secondary school teachers to disseminate CES-D questionnaires to screen for elevated symptoms of depression; (2) having salaried psychologists offer further diagnostic testing to identify cases of subthreshold depression in students with depressive symptoms; and (3) intervention delivery through a psychologist who offers group-based sessions.
In the sensitivity analysis, internet-based delivery of universal psychological prevention was modelled on the assumption that eligible participants completed online modules during class hours under minimal teacher supervision (i.e., the teacher supervises the students but does not actively facilitate the completion of modules); while internet-based delivery of indicated psychological prevention involved eligible participants completing internet modules (potentially outside of the classroom setting). Both forms of internet-delivery are considered unmoderated (i.e., do not involve active therapeutic supervision from a clinician or trained facilitator). For completeness, we also modelled the cost-effectiveness of internet-delivered prevention when it is clinician-moderated (i.e., self-directed completion of modules by students with periodic monitoring by a health professional or clinician).
Cost offsets (i.e., treatment costs averted through prevention) were included in the baseline analysis. Time and travel costs were excluded at baseline, but considered in a sensitivity analysis. A full description of intervention pathways and associated costs is provided in Section 5 of the supplementary appendix. Resource use parameters and unit costs are shown in Table 2.
Table 2. Input parameters and uncertainty ranges for costing analysis
ABS, Australian Bureau of Statistics; AIHW, Australian Institute of Health and Welfare; DISC-IV, Diagnostic Interview Schedule for Children; MBS, Medicare Benefits Schedule; N/A, Not applicable; RRP, Recommended Retail Price; s.e., Standard Error.
a Assumed 30% on-costs for all salaries/wages to account for additional employee overheads (e.g., superannuation and leave entitlements). On-costs were not applied to MBS-items.
b Estimate of time spent administering the DISC-IV modules for depression and anxiety only.
c Here we assume that an initial one-on-one visit to a psychologist (costed using the relevant MBS items) is required for orientation prior to the student participating in group-based indicated prevention sessions.
d Here we assume that universal prevention is delivered to a group in-class by a trained teacher, while indicated prevention is delivered in a group setting by a psychologist costed using relevant MBS items.
e The average cost for unmoderated internet-based prevention was used in the baseline analysis, while the average cost of clinician-moderated internet-based prevention was used in the sensitivity analysis.
f Only two universal prevention studies contained data on the total number and duration of internet-delivered sessions. As such, we assumed that this was similar across both indicated and universal prevention delivered via the internet.
g Time and travel costs were not applicable to the universal prevention intervention as the intervention was conducted in schools (i.e., no additional travel required by parents apart from usual travel to transport children to and from school).
h This parameter was calculated by multiplying the total number of group sessions offered by the average duration for each group session. The precise number of group-based sessions is dependent on the input parameter entitled, ‘Total no. of face-to-face intervention sessions offered to students’, where the total reported here is based on an approximate average of 10 group sessions (i.e., 9.9 rounded to the nearest whole number).
Uncertainty and sensitivity analysis
We conducted uncertainty analyses alongside baseline cost-effectiveness models to evaluate the impact of parameter uncertainty on the final results. We used Ersatz (version 1.31, Sunrise Beach, Australia; available at: http://www.epigear.com/) to perform Monte Carlo simulation with 3000 iterations and produce 95% UI for DALY's averted, net costs and ICERs. Uncertainty parameters are presented in Tables 1 and 2.
We also conducted a series of univariate sensitivity analyses to evaluate the impact of: (1) excluding cost offsets; (2) including time and travel costs; (3) assuming a school participation rate of 50%; (4) modelling non-significant intervention effect sizes and extrapolating an exponential decay rate over time; (5) modelling effect sizes based on RCTs using structured clinical interviews; (6) modelling effect sizes based on RCTs using an ITT analysis; (7) using a weighted average disability weight based on a severity distribution derived from DSM-IV algorithms for mild, moderate and severe depression; (8) using pooled standard gamble and EQ-5D utility weights; (9) modelling internet-delivered intervention pathways when assuming 100/50% efficacy relative to face-to-face interventions and unmoderated/clinician-moderated cost profiles; and (10) applying different discount rates to costs and benefits. In the sensitivity analysis of internet-delivered intervention pathways, we conducted a threshold analysis to test the impact of: (1) varying the relative efficacy of universal and indicated prevention, when assuming unmoderated and clinician-moderated internet-delivery pathways; and (2) varying the average intervention cost of indicated and universal internet prevention, when adopting an effect size of 100 and 50% relative to face-to-face intervention.
Results
Baseline cost-effectiveness results are shown in Table 3. We found that universal and indicated prevention interventions delivered to students via face-to-face intervention pathways were both cost-effective relative to a $50 000 per DALY threshold. Baseline sensitivity analysis results are shown in Table 4. Across the majority of scenarios, we observed that cost-effectiveness results were either consistent or more favourable relative to baseline. For instance, cost-effectiveness results differed little from baseline when: assuming a 50% school participation rate; and using different permutations of discount rates. The cost-effectiveness of universal and indicated prevention improved greatly when modelling non-significant effect sizes and long-term health impacts. Lower ICERs were also observed when: using an alternative severity distribution to calculate a composite disability weight for depression; and using utility weights based on either standard gamble (direct) or EQ-5D (indirect) valuation methods. The exclusion of cost offsets led to marginally higher ICERs compared with baseline; while the addition of time and travel costs led to indicated prevention having a lower probability of being cost-effective.
Table 3. Results of the baseline model examining the cost-effectiveness of indicated and universal psychological interventions delivered via face-to-face intervention pathways
95% UI, 95% uncertainty interval; AU$, Australian dollars; DALYs, disability-adjusted life years; ICER, incremental cost-effectiveness ratio.
Table 4. Results of univariate sensitivity analyses
95% UI, 95% uncertainty interval; EQ-5D, EuroQol-5-dimension; ICER, incremental cost-effectiveness ratio; ITT, intention-to-treat; N/A, not applicable; RCT, randomised control trial.
* A sizeable proportion of uncertainty iterations for indicated bibliotherapy lie in both the northwest and southeast quadrants of the cost-effectiveness plane – signifying that there is a dual likelihood of indicated bibliotherapy being either a dominating or dominated intervention.
Modelling intervention effect sizes based on RCTs using structured clinical interviews led to lower ICERs for universal and indicated prevention relative to baseline. The ICER for indicated prevention remained stable when modelling intervention effect sizes based on RCTs using ITT analysis; though a higher ICER was observed for universal prevention. Internet-delivered indicated prevention had a high probability of being cost-effective, even when assuming clinician-moderated pathways and 50% efficacy relative to face-to-face. Alternatively, internet-delivered universal prevention was only cost-effective when modelling it as an unmoderated intervention.
Figure 1 presents the results of the baseline model on a cost-effectiveness plane, alongside the sensitivity analysis modelling non-significant effect sizes over the long-term. In the baseline model, we observed that most uncertainty iterations for universal and indicated prevention interventions lie below the $50 000 per DALY threshold (i.e., high probability of cost-effectiveness). When modelling non-significant effect sizes we observed improvements in cost-effectiveness for universal and indicated prevention interventions (i.e., the uncertainty cloud moves downwards), alongside an increase in uncertainty around health benefits along the x-axis. Indicated bibliotherapy was cost-effective; however, we observed wide UI that intersected both the southeast and northwest quadrants of the cost-effectiveness plane – i.e., bibliotherapy can be either cost-saving or uneconomical.
Fig. 1. Cost-effectiveness plane of: (a) the baseline analysis and (b) the sensitivity analysis modelling non-significant effect sizes over the long-term.
Figure 2 presents results of threshold analyses conducted to test the impact of varying the relative efficacy and average intervention cost of internet-delivered prevention. Internet-delivered indicated prevention (both unmoderated and clinician-moderated) remained cost-effective relative to the $50 000 per DALY threshold despite substantial variations in imputed efficacy and the average intervention cost. For instance, the ICER for clinician-moderated indicated prevention remained below the threshold despite assuming an effect size that is 70% lower than that of face-to-face delivery. Likewise, increasing the average intervention cost of indicated prevention up to $400 per person still resulted in an ICER below the threshold. By contrast, the cost-effectiveness of internet-delivered universal prevention was highly sensitive to variations in cost, where small changes to the average cost per person can lead to large changes in the resulting ICER. For instance, internet-delivered universal prevention (assuming 100% efficacy) was no longer cost-effective when the average intervention cost became greater than $90 per person.
Fig. 2. Threshold analysis of internet-delivered prevention interventions conducted to examine the impact of varying: (a) the effect size and (b) the average intervention cost per person.
Discussion
Summary of findings and comparison with previous studies
The results of our study represent a scenario where prevention interventions are assumed to be properly implemented with high fidelity. We found that universal and indicated prevention interventions for youth are cost-effective when delivered through face-to-face intervention pathways. Despite available RCT studies only demonstrating significant intervention effects up to 6 months of follow-up (and not beyond), our baseline model provides support for the cost-effectiveness of universal and indicated prevention interventions delivered in schools. While this study is Australia-specific, the model can act as a template for cost-effectiveness studies on the prevention of mental disorders in other countries.
We conducted univariate sensitivity analyses to test the impact of several model assumptions. Overall, we found that ICERs were similar to or more favourable (i.e., lower) than ICERs calculated in the baseline model. For instance, using a 50% school participation rate did not affect resulting ICERs as net costs in the numerator and total benefits in the denominator are both reduced proportionally – i.e., costs and benefits both halve, while the ratio between the two remains constant. The true school participation rate is an implementation issue and, while 100% participation may be unlikely, these results represent the maximal distribution of costs and benefits in the Australian population; which can be adjusted to reflect a more appropriate coverage rate. Baseline assumptions regarding the meta-analysis of intervention effect sizes were found to be robust to changes in the scope of pooled RCT studies (i.e., whether they involved ITT analysis or used structured clinical interviews). Assuming different permutations of discount rates also had a minimal impact on resulting ICERs as intervention effect sizes are limited to the first year post-intervention.
The only scenario in which ICERs increased substantially involved the inclusion of time and travel costs when calculating the ICER for indicated prevention. A higher ICER was also observed for universal prevention when modelling intervention effect sizes based on ITT analysis only; though this remained well below the $50 000 per DALY threshold. In the scenario modelling non-significant effect sizes, indicated bibliotherapy was found to be cost-effective. However, caution should be applied when interpreting this result given the wide UI (i.e., there is a high probability that this intervention is inefficacious and, in turn, uneconomical).
The sensitivity analysis involving internet-based intervention pathways provides preliminary support for the implementation of internet-delivered prevention interventions in schools. The threshold analysis demonstrated that unmoderated, internet-delivered prevention interventions (both universal and indicated) were cost-effective relative to a $50 000 per DALY threshold despite an 80% reduction in the effect size relative to face-to-face intervention. Furthermore, internet-delivered indicated prevention moderated by a clinician remained cost-effective even after a 70% reduction in the relative effect size. While clinician-moderated universal prevention was not deemed cost-effective, it is likely that the unmoderated intervention pathway would be implemented in practice. These results suggest a high probability of internet-based prevention interventions being cost-effective, even despite lower effect sizes relative to face-to-face modalities.
Our baseline model generated higher ICERs for face-to-face indicated prevention than that observed in the prior study by Mihalopoulos et al. (Reference Mihalopoulos, Vos, Pirkis and Carter2012); which calculated an ICER of $5400 per DALY averted (95% uncertainty interval (UI): 1400–32 000). This divergence is attributable to major changes in model assumptions, parameters and the overall modelling structure. The sensitivity analysis modelling non-significant effect sizes into the long-term calculated an ICER of $6671 per DALY averted (95% UI: dominates – 29 980). It follows that the results of this sensitivity analysis best represent the model developed by Mihalopoulos et al. (Reference Mihalopoulos, Vos, Pirkis and Carter2012); which also modelled intervention effectiveness up to 12 months (based on the literature available at the time) followed by a linear decay rate over 5 years. From this, it appears that the choice of model assumptions – rather than changes to the overall model structure – explains observed differences in study findings.
The baseline ICER for indicated prevention was larger than a previous study by Lynch et al. (Reference Lynch, Hornbrook, Clarke, Perrin, Polen, O'Connor and Dickerson2005) which found an ICER of $9275 (95% CI dominates – $45 641) when evaluating the cost-effectiveness of a group-based psychological intervention delivered to adolescent offspring of depressed parents in the U.S. Interestingly, our findings for universal prevention contradict a recent economic evaluation conducted alongside a large-scale RCT of universal prevention among schools in the UK (Anderson et al. Reference Anderson, Ukoumunne, Sayal, Phillips, Taylor, Spears, Araya, Lewis, Millings, Montgomery and Stallard2014). Despite high levels of fidelity and adherence, this study found that classroom-based CBT did not lead to clinically significant reductions in depressive symptoms (measured using the Short Mood and Feelings Questionnaire or SMFQ) and led to a negligible mean difference in QALYs (measured using the EQ-5D) when compared with usual school provision. It is unclear why the universal intervention did not work in this study, or if there were particular contextual or study design factors that adversely impacted on the findings. The results in this solitary study are contrary to our meta-analysis of eight universal RCT studies, which measured changes in the onset of diagnosed depression later in life and included studies involving structured clinical interviews. It could be that the EQ-5D is less sensitive in picking up changes to depression status (Mihalopoulos et al. Reference Mihalopoulos, Chen, Iezzi, Khan and Richardson2014), though this does not explain the null effect observed in relation to outcomes on the SMFQ.
System-level implementation of school-based prevention interventions can democratise access to mental health interventions in countries with compulsory education (Fazel et al. Reference Fazel, Hoagwood, Stephan and Ford2014a ). Internet-based delivery of these interventions is particularly advantageous due to its relative ease of implementation compared with face-to-face delivery. There are, however, several implementation issues that can adversely impact on the cost-effectiveness of school-based prevention. For instance, we were agnostic as to whether indicated prevention was delivered during or after school hours. This distinction is, however, important from an implementation perspective given the risk of stigma due to labelling students with subthreshold depression. Nonetheless, preliminary empirical evidence suggests that a low risk of stigma is possible in a well-implemented programme delivered during school hours (Rapee et al. Reference Rapee, Wignall, Sheffield, Kowalenko, Davis, McLoone and Spence2006). Our study found little evidence on the precise cost of internet-based prevention in schools. For example, while economies of scale may arise when using a common IT infrastructure to deliver internet-based prevention (e-Mental Health Alliance, 2014), it is unclear what the true costs will be when accounting for the large-scale expansion of existing IT infrastructure. In addition, there are issues around intervention adherence, uptake and the suitability of internet-based intervention modalities to consumers (Christensen et al. Reference Christensen, Griffiths and Farrer2009; e-Mental Health Alliance, 2014).
There are arguments both for and against the involvement of teachers in the face-to-face delivery of school-based prevention. Delivering intervention material through teachers can facilitate the promotion of mental health literacy in the broader school setting as teachers are better educated to deal with mental health issues. Conversely, teachers may be too overworked and undermotivated to properly engage with intervention material (Han & Weiss, Reference Han and Weiss2005). In a sensitivity analysis, we assumed that the fidelity of internet-based prevention was comparable with face-to-face intervention delivery. It is possible that internet-based delivery leads to better fidelity as the intervention is highly structured and less susceptible to facilitators departing from the intervention material (i.e., intervention drift) (Calear & Christensen, Reference Calear and Christensen2010). There are, however, concerns that self-directed completion of internet-based modules may lead to poorer rates of adherence (Christensen et al. Reference Christensen, Griffiths and Farrer2009) – though this may be less relevant in the context of compulsory education. Evaluating the cost-effectiveness of treating students diagnosed with major depression following indicated prevention screening was beyond our study scope. Though Mihalopoulos et al. (Reference Mihalopoulos, Vos, Pirkis and Carter2012) note that cases of major depression are unlikely to be ignored after being identified through screening, suggesting that screening and treatment can be effective for both prevention and treatment.
Strengths and limitations
Strengths of our study include: utilising the latest data on intervention efficacy and depression epidemiology; employing similar methods to concurrently evaluate face-to-face and internet-based delivery of universal and indicated prevention interventions; applying conservative assumptions, where possible; and conducting extensive testing of model parameters and assumptions. There are, however, several limitations. First, our study narrowly focussed on health benefits linked to the prevention of incident depression only. Current evidence suggests that school-based prevention programmes can have benefits across the continuum of internalising disorders (Stockings et al. Reference Stockings, Degenhardt, Dobbins, Lee, Erskine, Whiteford and Patton2016) and lead to potential improvements in: education outcomes among students (Dix et al. Reference Dix, Slee, Lawson and Keeves2012); and mental health outcomes in teachers (Tyson et al. Reference Tyson, Roberts and Kane2009). Second, our study excluded evidence from RCT studies assessing continuous changes on depression symptom rating scales. It is unlikely that this would have biased our study results as: we conducted a separate meta-analysis of RCTs measuring changes in depressive symptoms which also found universal and indicated prevention interventions to be efficacious (Stockings et al. Reference Stockings, Degenhardt, Dobbins, Lee, Erskine, Whiteford and Patton2016); and there was comparable risk of bias between studies measuring depression outcomes and those measuring depressive symptoms. Third, our model assumed that preventive interventions for depression led to a reduction in depression incidence based on the outcomes of meta-analysed RCT studies. However, short study timeframes (up to 2-years follow-up) mean that it is unclear whether such interventions actually prevent the incidence of depression or merely delay its onset (van Zoonen et al. Reference van Zoonen, Buntrock, Ebert, Smit, Reynolds, Beekman and Cuijpers2014). These short study timeframes should not, however, adversely affect our baseline results given that we only modelled statistically significant intervention effect sizes occurring between post-intervention and 1-year follow-up (extrapolation of intervention effect sizes was constrained to the sensitivity analysis).
We sought to obtain the best available evidence to inform model parameters (see Section 1.3 of the supplementary appendix). Nevertheless, there were several data limitations, which we will briefly outline below. First, we modelled intervention pathways for indicated prevention using estimates from the 1997–1998 National Survey for Mental Health and Wellbeing – Child and Adolescent component (Sawyer et al. Reference Sawyer, Arney, Baghurst, Clark, Graetz, Kosky, Nurcombe, Patton, Prior, Raphael, Rej, Whaites and Zubrick2000); as the latest 2013–2014 population survey of mental disorders among youth in Australia (Lawrence et al. Reference Lawrence, Johnson, Hafekost, Boterhoven de Haan, Sawyer, Ainley and Zubrick2015) did not contain usable data to determine subthreshold depression cases via screening for elevated depression symptoms. According to Lawrence et al. (Reference Lawrence, Johnson, Hafekost, Boterhoven de Haan, Sawyer, Ainley and Zubrick2015), the prevalence of major depression increased from 2.1% in 1998 to 3.2% in 2013–2014. It is, however, unlikely that this increase would alter the final ICER for indicated prevention as it would only impact the coverage of eligible students (cf. school participation rate). Second, we used data from intervention studies to impute intervention participation rates, which may differ in the Australian population. Third, we modelled the cost-effectiveness of interventions by assuming that interventions are fully implemented and their effectiveness corresponded with pooled intervention efficacy. Implementation factors can, however, adversely impact on the actual cost-effectiveness of these interventions. Fourth, universal prevention studies generally had a higher risk of bias than indicated prevention studies; and were less likely to conduct an ITT analysis or use structured clinical interviews to measure depression outcomes. Fifth, the results of the sensitivity analysis modelling the cost-effectiveness of internet-delivered prevention interventions should be interpreted with caution given the paucity of information on the efficacy and cost of these intervention pathways. Further evidence is needed to better understand the costs and efficacy of internet-delivered prevention interventions in schools.
Conclusion
Our study found that system-level implementation of indicated and universal school-based prevention interventions represents value for money. Nonetheless, the cost-effectiveness of these interventions is ultimately dependent on overcoming several implementation issues beyond the scope of this study. Further evaluation of the cost-effectiveness of school-based prevention will be required as evidence regarding system-level implementation of these programmes is refined.
Supplementary material
The supplementary material for this article can be found at http://dx.doi.org/10.1017/S2045796016000469.
Acknowledgements
The authors would like to acknowledge the conceptual contributions of Ron Rapee, Sally Merry, Helen Christensen, Aliza Werner-Seidler and Yael Perry.
Financial Support
This project was funded through the Australian Government National Health and Medical Research Council (NHMRC) Centre of Research Excellence in Mental Health Systems Improvement (CREMSI) (grant no. APP1041131). The views expressed in this manuscript are solely those of the authors and do not reflect the views of the NHMRC. Furthermore, the funding source had no involvement in: the study design; the collection, analysis or interpretation of data; in the writing of the report; or in the decision to submit the paper for publication. C. M. is supported by an NHMRC Early Career Fellowship (grant no. APP1035887). G. A. P. is supported by an NHMRC Senior Principal Research Fellowship (grant no. APP 1019887). Y. Y. L., A. J. F. and H. A. W. are affiliated with the Queensland Centre for Mental Health Research which receives its core funding from Queensland Health. E. A. S. is affiliated with the National Drug and Alcohol Research Centre at the University of New South Wales which is supported by funding from the Australian Government under the Substance Misuse Prevention and Service Improvements Grants Fund. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.
Conflicts of Interest
J. J. B. owns Epigear International, which sells the Ersatz software used in the analysis. The other authors declare no conflicts of interest.
Ethical Standard
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.
