Hostname: page-component-7b9c58cd5d-nzzs5 Total loading time: 0 Render date: 2025-03-17T05:30:27.069Z Has data issue: false hasContentIssue false

Learn or react? An experimental study of preventive health decision making

Published online by Cambridge University Press:  14 March 2025

Günther Fink*
Affiliation:
Swiss Tropical and Public Health Institute and University of Basel, Socinstrasse 59, 4051 Basel, Switzerland
Margaret McConnell
Affiliation:
Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Boston, MA, USA
Bich Diep Nguyen
Affiliation:
Faculty of Business and Economics, University of Basel, Basel, Switzerland
Rights & Permissions [Opens in a new window]

Abstract

Despite public health efforts, uptake of preventive health technologies remains low in many settings. In this paper, we develop a formal model of prevention and test it through a laboratory experiment. In the model, rational agents decide whether to take up health technologies that reduce, but do not eliminate the risk of adverse health events. As long as agents are sufficiently risk averse and priors are diffuse, we show that initial uptake of effective technologies will be limited. Over time, the model predicts that take-up will decline as users with negative experiences revise their effectiveness priors towards zero. In our laboratory experiments, we find initial uptake rates between 65 and 80% for effective technologies with substantial declines over time, consistent with the model’s predictions. We also find evidence of decision-making not consistent with our model: subjects respond most strongly to the most recent health outcomes, and react to negative health outcomes by increasing their willingness to invest in prevention, even when health risks without prevention are known by all subjects. Our findings suggest that high uptake of preventive technologies should only be expected if the risk of adverse health outcomes without prevention is high, or if preventive technologies are so effective that the risk of adverse outcomes is negligible with prevention.

Type
Original Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s) 2020

1 Introduction

A growing body of literature has highlighted the low, and somewhat unpredictable uptake of preventive technologies (Dupas Reference Dupas2011). In the United States, uptake of sunscreen (Holman et al. Reference Holman, Berkowitz, Guy, Hawkins, Saraiya and Watson2015) and tooth brushing (American Dental Association Reference Association2010) remains far from universal. Despite substantial evidence that physical exercise can forestall numerous non-communicable and chronic diseases, nearly 40% of individuals in high-income countries report engaging in insufficient physical activity (Guthold et al. Reference Guthold, Stevens, Riley and Bull2018). While there have been a number of advances in technologies that screen for colorectal cancer, screening for colorectal cancer remains low (Daskalakis et al. Reference Daskalakis, DiCarlo, Hegarty, Gudur, Vernon and Myers2020). Other evidence suggests that adherence to statins prescribed as primary prevention for heart disease is also sub-optimal, with non-adherence to regular pill taking observed for more than half of individuals prescribed a statin within just 1 year (Ofori-Asenso et al. Reference Ofori-Asenso, Jakhu, Zomer, Curtis, Korhonen and Nelson2018).

Individuals choosing to experiment with health prevention technologies (whether it be a drug or lifestyle change such as increased physical activity) may update their priors based on their experiences. Preventive health investments do not eliminate the chance of adverse events, but rather reduce the likelihood of adverse outcomes from a given baseline risk to a smaller non-zero probability. The specific risk reduction offered by preventative health technologies are unlikely to be known by users, and are not typically provided as part of public health campaigns in practice. Therefore, individuals may use their own experience and the experience of others to learn about the costs and benefits of investing in preventive health technologies.

Learning, however, cannot fully rationalize all behavior patterns observed in the empirical literature on preventive health investment. Learning about risk and effectiveness should decrease with age, which has not been found in the literature (Jin and Koch Reference Jin and Koch2018). If updating of priors was the primary mechanism, we should also see similar impacts for information campaigns and disease outbreaks, which is generally not the case (Oster Reference Oster2018), and we would not expect to see very large responses to temporary shocks (Jin and Koch Reference Jin and Koch2018; Oster Reference Oster2018).

In this paper, we develop a formal learning model of prevention to describe the conditions under which expected-utility-maximizing Bayesian learners take up prevention with unknown protective effects but known costs. We show that only those agents whose prior on a preventive health technology’s effectiveness exceeds a certain threshold will prevent, and that for any initial distribution of priors, preventive uptake will likely decline over time. We also show that in higher risk environments, agents respond less strongly to the failure of a preventive measure.

We then test the predictions of this model through a series of incentivized decision experiments in the lab. In our experiment, subjects were fully informed about the risk of getting sick without prevention and introduced to a range of preventive health technologies that lowered their probability of falling sick and losing their income in each period. After each adoption decision, health outcomes were stochastically determined as a function of the chosen strategy, and subjects were informed about their health outcome and resulting income.

In order to observe the impact of subjective experiences on uptake in different environments, we randomly assigned subjects to different levels of technology effectiveness and different levels of baseline risk. We also randomly assigned subjects to receive public health messages encouraging adoption. We hypothesized that these messages would lead to increased expectations about the effectiveness of the technology and encourage prevention initially, but this effect would fade over time as subjects updated their priors to more accurately reflect the true effectiveness of the technology.

Consistent with prevention patterns observed empirically in various settings (Dupas Reference Dupas2011) we find that a substantial fraction of subjects (20–40%) do not take up prevention. We also find that average prevention rates decline over time and that subjects with negative preventive outcomes revise their effectiveness prior downwards. Revisions of priors are weaker in higher risk environments where failures are expected to happen more frequently. The declining willingness to invest into prevention (as a private good) over time is similar to recent experimental evidence on behavior in public goods provision (Burton-Chellew et al. Reference Burton-Chellew, Nax and West2015).

Messages encouraging adoption have a small positive effect, increasing prevention by about 10%. This effect is stronger with the first technology subjects get exposed to but dissipates once a new technology is introduced.

We also see evidence of behaviors that are less consistent with rational learning models. Experimental subjects react more strongly to their most recent experiences than to experiences in the past, and tend to immediately switch out of prevention if they experience a negative outcome, even if they had multiple successful rounds before.

This immediate “reactivity” is even more obvious when it comes to behavioral responses to outcomes that do not reveal any information. Specifically, a rational learning model would predict no updating from stochastic health outcomes experienced when not using the prevention technology. However, we find that subjects who chose not to prevent are much more likely to switch to prevention in the following round after a negative health outcome than after a positive health outcome. Given that subjects were perfectly informed about the risks of adverse events without prevention, this suggests that some of the observed switching is the result of a behavioral response (“reacting”) to undesired outcomes rather than learning.

The results presented in this paper contribute to a growing literature on the role of learning and learning algorithms in understanding the adoption of new technologies more generally. An extensive experimental economics literature has focused on understanding learning processes over repeated decisions (see Erev and Haruvy (Reference Erev, Haruvy, Kagel and Roth2016) for an overview). In the context of agriculture, several studies suggest that levels of experimentation with new technologies are inefficiently low (Conley and Udry Reference Conley and Udry2010; Foster and Rosenzweig Reference Foster and Rosenzweig1995). The results of this study suggest that low initial uptake should be expected in settings where priors are diffuse and agents are risk-averse. Our model also predicts that uptake of technologies will likely decline rapidly over time in settings where poor outcomes with the technology are common due to random external events such as rainfall or pest.

Several explanations for low adoption have been proposed in the literature, including lack of information, high (effort) cost associated with learning (Chassang et al. Reference Chassang, Padró i Miquel and Snowberg2012), aversion to risk (Anderson and Mellor Reference Anderson and Mellor2009), aversion to ambiguity (Bryan Reference Bryan2010; Engle-Warnick et al. Reference Engle-Warnick, Escobal and Laszlo2007), problems with self-control (Dupas Reference Dupas2011), disagreements at the household level (Ashraf et al. Reference Ashraf, Field and Lee2014) and difficulties changing customs (Mobarak et al. Reference Mobarak, Dwivedi, Bailis, Hildemann and Miller2012). These explanations may partially explain why subjects are reluctant to try out preventive technologies, but cannot fully capture some of the more complex behavioral patterns empirically observed.

Studies from low income settings suggest that the problem with new health technologies is not the initial uptake of products, but rather the continued use of these technologies over time. Many people seem willing to try out new technologies such as cook stoves, fortified foods and water treatment, but very few of them engage in preventive efforts on a continued basis (Banerjee et al. Reference Banerjee, Barnhardt and Duflo2018; Hanna et al. Reference Hanna, Duflo and Greenstone2016; Luoto et al. Reference Luoto, Najnin, Mahmud, Albert, Islam, Luby and Levine2011; Miller and Mobarak Reference Miller and Mobarak2015).

The same logic can also be applied to other settings and decisions that require regular small investments, but cannot fully preempt negative outcomes, such as annual car checkups, or firm investment in quality-improvement technologies. Investment in such programs will only be attractive if anticipated adverse event probability reductions are sufficiently large, and will likely end in many cases if sufficient negative events occur.

The remainder of the paper proceeds as follows. Section 2 lays out a theoretical framework for learning in the context of preventive health technologies. Section 3 describes the experiment. Section 4 provides the results of the experiment. We discuss the main results and present the main conclusions of the paper in Sect. 5.

2 Theoretical model

We develop a theoretical model of preventive health technology adoption in this section. Preventive technologies have two salient features: they are associated with an upfront effort or financial cost, and they lower (but do not eliminate) the likelihood of adverse outcomes. Daily tooth-brushing and flossing reduce the likelihood of cavities, healthy diets (or baby aspirins) lower the likelihood of cardiac problems and colorectal cancer screenings reduce the likelihood of advanced colorectal cancer. Irrespective of the efforts made, the chance of adverse outcomes is never zero: children drinking treated water still get diarrhea at times, cavities can emerge even with excellent dental hygiene, and people still discover advanced colorectal cancer even when they engage in regular screening.

This imperfect link between individual preventive actions and health outcomes—which makes preventive technologies different from standard insurance contracts—is at the core of the model. We assume that an individual’s probability of contracting a disease is known to the agents but the effectiveness of a new technology is unknown to them. This assumption reflects the fact that people often have some knowledge of their own susceptibility to a disease but are uncertain about the true effectiveness of the preventive technology, either because they lack information or because the technology effectiveness is perceived to vary across individuals.

Conceptually the decision of whether or not to invest in preventive technology corresponds to a choice between two lotteries: lottery A0—not preventing—which offers high income Y 0 H with probability (1 − p) and low income Y 0 L with probability p, and lottery A 1 —preventing—which lowers the probability of falling sick by e * but is also associated with a fixed cost C which needs to be paid independent of realized health outcomes. For simplicity, we exclude the possibility of probabilistic side effects of preventive technologies (Böhm et al. Reference Böhm, Betsch and Korn2016).

Denote the utility from not preventing as U 0 H and U 0 L , where U 0 H = U ( Y 0 H ) and U 0 L = U ( Y 0 L ) . Denote the utility from preventing as U 1 H and U 1 L , where U 1 H = U Y 1 H = U ( Y 0 H - C ) and U 1 L = U Y 1 L = U ( Y 0 L - C ) . A utility-maximizing agent will decide to invest in prevention as long as:

(1) 1 - p + e U 1 H + p - e U 1 L > 1 - p U 0 H + p U 0 L
(2) e U 1 H - U 1 L > 1 - p U 0 H - U 1 H + p U 0 L - U 1 L

This expression is intuitive: rational agents will invest into prevention as long as the expected utility increases from the more likely high income state are at least as large as the expected utility losses generated by the premium payment in case of high and low income states. This means that the agent will prevent if the technology is sufficiently effective:

(3) e > 1 - p U 0 H - U 1 H + p U 0 L - U 1 L U 1 H - U 1 L

2.1 Technology uptake

We assume that the true effectiveness of the technology is not known to agents, but they have an initial belief about it and update their belief once they try the technology. Assume that the agent i’s prior regarding the technology at time t can be described as a distribution f i , t ( e ) of potential technology effectiveness rates e, with an expected value of e ¯ i , t and variance σ i , t 2 . In the discrete case, e ¯ i , t = j e j f i , t ( e j ) . In the continuous case, e ¯ i , t = e f i , t e d e . Here we present the discrete case. The continuous case is analogous. Since the utility derived from the four states does not depend on their relative likelihood, the expected utility from preventing can be directly expressed as a function of the expected value of e ¯ i , t , i.e.,

(4) E i , t ( U 1 ) = 1 - p U 1 H + p U 1 L + e ¯ i , t U 1 H - U 1 L

Proof

(5) E i , t ( U 1 ) = j [ ( 1 - p + e j ) f i , t ( e j ) U 1 H + ( p - e j ) f i , t ( e j ) U 1 L ] = 1 - p U 1 H j f i , t e j + p U 1 L j f i , t e j + U 1 H - U 1 L j e j f i , t e j = 1 - p U 1 H + p U 1 L + e ¯ i , t U 1 H - U 1 L

Therefore, for any prior f i , t e the agent chooses prevention if

(6) 1 - p U 1 H + p U 1 L + e ¯ i , t U 1 H - U 1 L > 1 - p U 0 H + p U 0 L
(7) e ¯ i , t > 1 - p U 0 H - U 1 H + p U 0 L - U 1 L U 1 H - U 1 L

If we assume a standard constant relative risk aversion (CCRA) utility function

(8) u = c 1 - ρ - 1 1 - ρ

where ρ measures the degree of risk aversion, agents will choose prevention if:

(9) e ¯ i , t > Y 0 H 1 - ρ - Y 1 H 1 - ρ Y 1 H 1 - ρ - Y 1 L 1 - ρ - p Y 0 H 1 - ρ - Y 1 H 1 - ρ - Y 0 L 1 - ρ + Y 1 L 1 - ρ Y 1 H 1 - ρ - Y 1 L 1 - ρ = e i c ρ , p

Define e i c as the critical value of expected prior above which the agent decides to adopt the technology. The critical value e i c is subject specific, and determined by ρ, which we assume to be heterogeneous across subjects. The relationship between ρ and e i c is non-linear and negative in general. To illustrate this, we show critical values for the priors for three risk environments in Fig. 1: a low risk environment (p = 0.3), a medium risk environment (p = 0.5) and a high risk environment (p = 0.7).

Fig. 1 Critical values for the absolute risk reduction, represented by e c, above which prevention is the optimal strategy for expected utility maximizing agents in the experiment. Figure shows critical value e c, the level of absolute risk reduction above which agents with a constant relative risk aversion utility function prefer prevention to non-prevention. All calculations are made under the assumption that agents maximize a CRRA utility function, that incomes in the high and low states are 20 and 10, respectively, and that the cost of prevention is 1. The risk levels in the low, medium and high risk environments are 0.3, 0.5, and 0.7, respectively

Two things are worth highlighting in the patterns displayed in Fig. 1. First, for a given absolute risk reduction (effectiveness), uptake of prevention decreases with the absolute level of risk. It is straightforward to see from inequality (2) that this must always be the case. For any concave utility function, the absolute utility cost of losing one unit of income in the bad state is strictly larger than the cost in the good state; higher absolute risk means that the relative likelihood of more costly utility state increases, which pushes agents towards not adopting the technology.

Second, a higher degree of risk aversion does not necessarily imply a higher likelihood of investing in prevention. In medium and high risk environments, at the same level of risk without prevention, more risk-averse agents demand more effective technology. However, there is a U-shaped relationship between risk-aversion level and critical value in terms of the prior about technology effectiveness in a low risk environment.

2.2 Prior updating

We assume that the probability of getting sick without prevention is known to agents. If agents decide to adopt prevention, they can directly test and experience its effectiveness, and subsequently update their beliefs about its effectiveness. Let e ¯ i , t be the agent’s prior. If agents are Bayesian, they revise their beliefs about the effectiveness of the technology after a prevention outcome (either sick or healthy) O { P S , P H } according to the formula:

(10) f i , t + 1 e j = P e j | O = P O | e j f t e j k P O | e k f t e k

In the case of a preventive failure, the revised belief will be:

(11) f i , t + 1 e j = P e j | P S = p - e j f i , t e j i p - e f i , t e i = p - e j f i , t e j p - e ¯ i , t
(12) e ¯ i , t + 1 = j e j f t + 1 e j = j e j p - e j f i , t + 1 e j p - e ¯ 0 = p e ¯ i , t - E i , t e 2 p - e ¯ i , t

where E i , t ( e 2 ) is the expectation of e 2 before new information arrives.

Negative experiences (preventive failure) will lead to weakly negative adjustment in beliefs:

(13) Δ e ¯ i , t + 1 = e ¯ i , t + 1 - e ¯ i , t = p e ¯ i , t - E i , t e 2 p - e ¯ i , t - e ¯ i , t = - σ i , t 2 p - e ¯ i , t 0

In the case of a prevention success, the revised belief will be:

(14) f i , t + 1 e j = P e j | P H = 1 - p + e j f i , t e j 1 - p + e ¯ i , t
(15) e ¯ i , t + 1 = e ¯ i , t - p e ¯ i , t + E i , t e 2 1 - p + e ¯ i , t

The adjustment in belief will be weakly positive:

(16) Δ e ¯ i , t + 1 = e ¯ i , t + 1 - e ¯ i , t = σ i , t 2 1 - p + e ¯ i , t 0

In the experiment, subjects could test each technology over multiple time periods. Consider a sequence of R prevention outcomes O = ( O 1 , O 2 , , O R ) with S failures and H successes where S + H = R. The agent’s updated belief will be:

(17) f i , t + R e j = p - e j S 1 - p + e j H f i , t e j k p - e k S 1 - p + e k H f i , t e k
(18) e ¯ i , t + R = j p - e j S 1 - p + e j H e j f i , t e j k p - e k S 1 - p + e k H f i , t e k

Proof

The agent iteratively revises his belief after each outcome:

(19) f i , t + 1 e j = P e j | O 1 = P O 1 | e j f i , t e j k P O 1 | e k f i , t e k
(20) f i , t + 2 e j = P e j | O 2 = P O 2 | e j f i , t + 1 e j k P O 2 | e k f i , t + 1 e k = P O 2 | e j P O 1 | e j f i , t e j k P O 2 | e k P O 1 | e k f i , t e k

Similarly,

(21) f i , t + R e j = P e j | O R = P O R | e j f i , t + R - 1 e j k P O R | e k f i , t + R - 1 e k = r P O r | e j f i , t e j k r P O r | e k f i , t e k

Plugging P O r | e j = p - e j if O r = P S and P O r | e j = 1 - p + e j if O r = P H into Eq. (21), we have Eq. (17). Equation (18) follows.

Expression (18) is fairly intuitive: at any given time point (round), agents’ belief about the effectiveness of the technology depends on the risk level, their initial prior, and the number of prevention successes and failures they have experienced, independent of the temporal ordering of these outcomes.

2.3 Bayesian learning predictions

For any preventive technology setting with sequential updating over time, a rational expected-utility maximizing agent model with Bayesian learning generates the following predictions:

Hypothesis H1

Average prevention rates decline over time.

At the beginning of the game, agents decide whether to adopt the technology based on their prior belief about its effectiveness. Anyone whose belief is higher than the critical value e i c ( ρ , p ) defined in Eq. (9) chooses to prevent while the others do not. Those who adopt the technology subsequently revise their belief about its effectiveness as they observe the outcomes of prevention. For any given prior, positive experiences with the technology will lead to upward revisions of the prior, while negative experiences will lead to downward adjustments. Agents who have their prior revised upwards will always continue preventing until their priors drops below e i c. Any agent with a prior below e i c will never prevent again unless new information is provided. Given these dynamics, the proportion of agents preventing can never increase, and will decline as long as at least one agent’s prior is lowered below the critical threshold in any given round.

Hypothesis H2

Messages increase prevention rates initially, but the effect fades over time as subjects gain more personal experience.

Public health messaging usually communicates rather strongly that prevention improves health outcomes. This type of communication should shift the initial prior up as long as the value of information from this message is given any weight in the formation of the prior, and thus increase prevention rates initially. As agents gain more experience with the technology and update their beliefs, the effect of messages should decline and differences in preventive uptake from receiving messages should fade over time.

Hypothesis H3

Response to a prevention failure is weaker in higher risk environments.

As shown in Eq. (13), Δ e ¯ i , t + 1 is decreasing in p. Intuitively, in higher risk environments, prevention failures are expected to happen more frequently, therefore, each prevention failure contains less information. Agents adjust their priors less in response to a prevention failure.

In reality, individual’s initial distribution of priors may be linked to the risk level, most likely both the expectation and the variance are positively related to risk. As Δ e ¯ i , t + 1 is decreasing in p but increasing in e ¯ i , t and σ i , t 2 (Eq. 13), the relationship between risk level and responses to prevention failures depends on which effect dominates. This results in ambiguity in the direction of the relationship in the initial periods. However, over time, we expect the distribution of prior to become more similar across risk environments. This is because adjustments in expectation and variance of the distribution of prior are larger the more disperse the initial distribution (see Appendix A in Online Resource for a more detailed discussion). If this is the case, then the negative relationship between the risk level and the strength of response to a prevention failure should be more pronounced in later periods.

Hypothesis H4

The behavioral response to adverse outcomes in any given round should be the same as the response to adverse outcomes in previous rounds.

As shown in Eqs. (17) and (18), at any round, agents’ belief about the effectiveness of the technology depends on the number of prevention successes and failures they have experienced, but is independent of where these outcomes happen in the sequence. Note that their revised belief in this case is similar to what their belief would be if they updated their prior on multiple events simultaneously, given that these events are conditionally independent of each other. Therefore, all these outcomes should be weighted equally. Empirically this is an easily testable prediction because it implies that the outcome in the most recent round must be given the same weight as the outcomes in other rounds before it.

Hypothesis H5

Outcomes from non-prevention contain no information, and thus should not produce any updating.

  • H5a: For any given technology, agents that do not choose prevention in the first round will never choose prevention in subsequent rounds.

  • H5b: For any given technology, agents choosing prevention in the first round but switching strategy later will never adopt prevention again.

  • H5c: Beliefs about the effectiveness of health technologies assessed after experiencing the technology will not depend on non-prevention outcomes.

Given that the risk of getting sick without prevention is known to subjects in the experiment, and given that not-preventing does not reveal any information about the relative effectiveness of the preventive technology, experienced outcomes from not-preventing should not have an impact on agents’ assessment of the effectiveness of the technology and on their subsequent choices.

3 Experimental design

In order to test our model predictions, we set up a lab experiment in which subjects were asked to decide whether to invest in a set of technologies lowering their risk exposure. In each round of the experiment, individuals had to decide whether to make an upfront investment into a preventive health technology, which would reduce the odds of falling sick, but not fully protect subjects against sickness. Subjects were asked whether they wanted to invest US$1 into prevention at the beginning of each period. If the player stayed healthy, the period income was 10 without prevention, and 9 with prevention; if the player fell sick, the period income was zero with prevention, and − 1 with prevention. While this full income loss may appear somewhat stark, health shocks are found to have an impoverishing impact in both developed and developing countries, even where the entire population is officially covered by a health insurance scheme (Wagstaff et al. Reference Wagstaff, Flores, Smitz, Hsu, Chepynoga and Eozenou2018; Wagstaff and van Doorslaer Reference Wagstaff and van Doorslaer2003). In the United States, sick days and basic medical expenses easily exceed monthly disposable incomes for uninsured populations (Dobkin et al. Reference Dobkin, Finkelstein, Kluender and Notowidigdo2018); even for populations with insurance, the utility loss associated with having to stay in bed for a week or having to undergo surgery may exceed the utility derived from a typical monthly income.

Each subject played 3 matches of 15 rounds each. Throughout the entire 45-round session, the risk environment was kept constant, while the effectiveness of the preventive technologies (called technologies A, B, and C) was separately randomized for each of the three matches. Complete instructions used in the lab are provided in Appendix B (Online Resource). Each player was informed about the probability of getting sick without prevention and that this risk level was constant throughout the entire session; we randomly exposed players to three risk settings: p = 0.3 (low risk), p = 0.5 (medium risk) and p = 0.7 (high risk).

Players were informed that the preventive technology “lower[ed] the probability of falling sick”, and that the three technologies were independent of each other and differed with respect to their effectiveness. Since the main idea of the experiment was to assess individual behavior in settings where prevention was effective but the exact effectiveness uncertain, the absolute risk reductions used in the lab were randomized between 0.12 and 0.20 across players and matches. Under both scenarios, prevention was designed to be welfare-improving: with the more moderate risk reduction of 0.12, the net expected benefit (or expected returns on investment) per round was 20 cents (a 12% increase of getting US$10 minus the US$1 upfront cost); with the larger risk reduction of 0.20, the net expected benefit of prevention was US$1 per round of play, which corresponds to an expected return on investment of 100%. We later refer to these as more and less effective prevention technologies.

Each subject was randomized into one of five message treatments, which was kept constant throughout the experiment, as outlined in Table 1 below. Individuals in the control treatment were informed that the technology decreased the probability of being sick but they were not informed that the technology had positive expected returns. Two treatments provided messages, but no information on actual probabilities, similar to the messages commonly used by public health professionals to encourage the adoption of new technologies, which tend not to give specific information about risk reduction. One of the treatments was strongly worded, the other acknowledged that preventive technology would fail when insurance was incomplete. In two other treatments, subjects received messages that revealed the effectiveness of the technology.

Table 1 Messages and information

No messagea

Balanced message

Strong message

Diffuse prior on probabilitiesb

No additional text

“On average, prevention pays. There is still some risk to you that you will get sick even if you pay to prevent”

“On average, prevention pays. We strongly encourage you to buy this product”

Common prior on probabilitiesb

No additional text

With prevention, the probability of getting sick will be either <p − 0.2> or <p − 0.12>, with both being equally likely. There is still some risk to you that you will get sick even if you pay to prevent

With prevention, the probability of getting sick will be either <p − 0.2> or <p − 0.12>, with both being equally likely. We strongly encourage you to buy this product

aAll subjects received the message “[]…you will be playing this game for 15 periods. In each period you will earn an income of US$ 10 if you stay healthy and an income of zero if you fall sick. The probability of falling sick in each period is constant at p = [x] (a [x] in 10 chance) over the game period. In each period you can invest in a preventive health technology for $1 which lowers the probability of falling sick”

bIn the diffuse prior setting, subjects were only informed that the technology would lower the probability of falling sick; in the common prior, they were informed that the probability would either be p − 0.2 or p − 0.12 with equal probability (see full text above)

Both the risk environment and message treatment were kept the same for each subject throughout the full session (individual-level randomization). Because we wanted subjects to experience different technologies, technology effectiveness was randomized at the match level (i.e. 3 random effectiveness draws for each subject).

In the first two matches, subjects made decisions independently and could not observe others’ outcomes. In the third match, subjects were able to communicate with other players in their randomly assigned group. We limit our analysis to the first two matches in which subjects could not communicate their experiences. Analysis of the effects of communication on prevention decisions can be found in other work (Saran et al. Reference Saran, Fink and McConnell2018).

All subjects received a show-up fee of US$10. Subjects were informed that they would receive additional payments corresponding to the outcomes of one randomly selected round in each of three matches, where they would be sampling a different technology in each match. Across the three matches, subjects could thus earn an additional income between − 3 (prevented and got sick all three rounds) and + 30 (no prevention, never sick). Subjects were paid in cash at the end of the experiment. After completing all experimental games, subjects completed a comprehensive questionnaire shown in Appendix C (Online Resource). Besides demographic and socio-economic indicators, the questionnaire included questions about health behaviors in realistic health settings, a risk aversion module (Holt and Laury Reference Holt and Laury2002), a delay discounting module (Kirby et al. Reference Kirby, Petry and Bickel1999) and a financial literacy and sophistication questionnaire (Lusardi and Mitchell Reference Lusardi, Mitchell, Mitchell and Lusardi2011). We did not include ambiguity aversion measures though this would be useful to measure in future work.

The experiment was conducted at the Harvard Decision Sciences Laboratory with a total of 679 participants. All subjects were reminded that the laboratory does not allow any deception of subjects. As shown in Table 2, approximately 50% of all participants were assigned to the low risk environment (p = 0.3), which we considered the most likely scenario from a health perspective; the remaining 50% were split roughly equally across the medium (p = 0.5) and high risk (p = 0.7) settings; common priors treatments were only implemented for the high and low risk settings. Message and risk treatments were compared across subjects. Effective or non-effective technologies were randomly assigned in each “round” of play and therefore involve within subject comparisons. Table 3 shows a breakdown of participant characteristics by risk environments and by message treatments. The randomization process was fairly successful in balancing participant characteristics across treatments. However, statistically significant differences were observed for the p = 0.7 treatment which was introduced in the final stage of the experiment and was thus affected by differences in the subject pool over time. To address imbalance concerns, we control for subject characteristics in all regression models. We also show regression results without the p = 0.7 treatment condition in Appendix D of the online materials.

Table 2 Allocation of experimental treatments

Message treatment

Risk environmenT

p = 0.3

p = 0.5

p = 0.7

No message

112

50

56

Balanced, diffuse priors

76

20

Strong, diffuse priors

90

28

Balanced, common priors

41

63

31

Strong, common priors

33

39

40

Total

352

152

175

Based on a total of 679 subjects. All risk and message treatments were held constant across the 45 rounds (15 rounds with each of the three technologies offered) played by each subject. Message and risk treatments are randomized across subjects. More and less effective technologies are randomized within subjects

Table 3 Summary statistics on experiment subjects

Variables

All

Risk environments

F statistic (ANOVA)

Message treatments

F statistic (ANOVA)

p = 0.3

p = 0.5

p = 0.7

No message

Balanced, diffuse priors

Strong, diffuse priors

Balanced, common priors

Strong, common priors

Age in years

31.2

33.0

33.0

26.1

18.04***

30.2

33.7

32.7

29.9

31.2

1.79

(13.6)

(14.0)

(13.4)

(11.4)

(14.0)

(13.4)

(13.8)

(12.2)

(13.8)

Female

0.48

0.50

0.47

0.47

0.35

0.47

0.45

0.53

0.50

0.48

0.49

White

0.54

0.57

0.53

0.48

1.84

0.54

0.53

0.60

0.49

0.54

0.81

African American

0.14

0.12

0.15

0.17

1.03

0.14

0.15

0.11

0.19

0.11

1.25

Asian American

0.14

0.13

0.11

0.17

1.28

0.12

0.17

0.15

0.11

0.15

0.63

Hispanic

0.06

0.04

0.08

0.07

1.77

0.08

0.04

0.03

0.07

0.05

0.87

College (some or completed)

0.63

0.62

0.55

0.71

4.74***

0.64

0.63

0.58

0.65

0.63

0.49

Graduate education

0.29

0.32

0.34

0.21

4.46**

0.26

0.32

0.37

0.26

0.29

1.47

Currently a student

0.53

0.47

0.46

0.70

15.19***

0.57

0.46

0.50

0.53

0.54

0.93

Currently married

0.11

0.11

0.14

0.09

1.13

0.09

0.15

0.14

0.13

0.08

0.79

Has children

0.14

0.14

0.18

0.09

3.44**

0.15

0.14

0.11

0.15

0.13

0.34

Height (cm)

171.4

171.2

171.7

171.5

0.12

171.6

172.3

169.7

172.0

171.0

1.01

(11.1)

(11.1)

(10.8)

(11.5)

(11.2)

(11.1)

(10.1)

(10.9)

(12.2)

Weight (kg)

72.0

72.6

72.6

70.3

1.07

71.7

74.7

70.3

72.7

71.4

0.97

(17.8)

(18.1)

(18.6)

(16.2)

(17.9)

(18.8)

(17.0)

(18.6)

(16.2)

Overweight ( BMI 25 )

0.35

0.37

0.34

0.34

0.28

0.34

0.45

0.34

0.35

0.31

1.19

Obese ( BMI 30 )

0.11

0.13

0.13

0.07

2.49*

0.10

0.13

0.14

0.13

0.10

0.37

Currently smoking

0.13

0.14

0.16

0.11

0.87

0.13

0.09

0.14

0.15

0.14

0.44

Currently taking vitamins

0.43

0.41

0.48

0.43

1.01

0.38

0.44

0.46

0.45

0.48

1.00

Flu shot in the last 12 months

0.47

0.44

0.49

0.51

1.23

0.51

0.43

0.47

0.44

0.44

0.89

Dentist visit in the last 12 months

0.78

0.78

0.76

0.79

0.15

0.78

0.77

0.81

0.79

0.71

0.91

Uses sunscreen regularly

0.39

0.40

0.45

0.31

3.26**

0.35

0.31

0.44

0.44

0.40

1.68

Attention score

1.34

1.31

1.15

1.55

5.11***

1.31

1.33

1.43

1.25

1.40

0.50

(1.17)

(1.15)

(1.14)

(1.20)

(1.17)

(1.13)

(1.14)

(1.20)

(1.18)

Financial literacy score

3.95

3.91

4.05

3.94

0.60

3.89

3.84

3.90

4.11

4.01

0.82

(1.38)

(1.45)

(1.25)

(1.33)

(1.44)

(1.52)

(1.26)

(1.35)

(1.28)

Risk aversion score

4.87

4.90

4.84

4.83

0.06

4.75

4.90

4.92

4.90

4.99

0.24

(2.33)

(2.44)

(2.33)

(2.13)

(2.36)

(2.40)

(2.41)

(2.39)

(2.09)

Kirby discounting score

10.72

11.08

10.47

10.21

1.49

10.61

11.34

10.18

11.12

10.51

0.75

(5.81)

(5.79)

(5.66)

(5.98)

(6.08)

(6.04)

(5.86)

(5.50)

(5.43)

Observations

679

352

152

175

218

96

118

135

112

The table displays means and standard deviations (in parentheses) unless indicated otherwise

***p < 0.01; **p < 0.05; *p < 0.1

In order to understand how experimental subjects learned about and evaluated the “quality” of the health technology, all subjects were asked to answer three simple questions regarding the technology at the end of each match of 15 rounds: whether respondents tried out the technology, if yes, how respondents would rate the technology effectiveness on a scale from 1 (“Bad”) to 4 (“Very good”), and whether respondents would recommend the technology observed to others.

3.1 Study population

Study subjects were recruited using flyers and emails from the larger Boston area. As shown in Table 3 below, about 50% of subjects were students; the remaining 50% were recruited off-campus, resulting in an age mix from 17 to 82 years. The resulting sample was ethnically diverse with 54% of subjects indicated to be White, while 14% indicated African and Asian American ethnicities, respectively. On average, study participants were highly educated: 63% of subjects either were currently in college or had attended college previously and an additional 29% of subjects had received graduate education, which means that only 8% of subjects had no exposure to higher education. The average young age and high levels of education were also reflected in the relatively low prevalence of obesity (11%) and smoking (13%), respectively.

We also collected data on self-reported preventive behavior in everyday life. As Table 3 shows, 43% of subjects reported the consumption of vitamin pills, 47% reported a flu shot within the last 12 months,Footnote 1 and 78% reported a visit to the dentist. Self-reported use of sunscreen appears low in comparison, with only 39% of subjects reporting to use sunscreen on a regular basis.

Study participants on average scored 1.34 out of 3 on attention/sophistication and 3.95 out of 6 on financial literacy. About 50% of subjects were classified as risk-averse (choosing safe options more than 4 times in the 10 questions asked), 23% as risk-neutral (choosing safe options 4 times) and 27% as risk-loving (choosing safe options less than 4 times). The average number of safe options chosen across the entire sample was 4.87. In the Kirby discounting questionnaire, subjects on average chose immediate rewards 10.9 times in the 21 questions asked, which corresponds to an annual discounting rate of 248–253%, or annual hyperbolic discounting parameter k in the range of 2.80–3.26.

4 Empirical specifications and results

Overall, a high proportion of subjects chose to prevent in the experiment. In the first two matches, the average prevention rate was 70%, differing slightly across risk environments. In the low-risk environment, the prevention rate was 70%. In the medium- and high-risk environments, the prevention rates were 67% and 74%, respectively. Subjects were more likely to adopt prevention when assigned more effective technologies. The corresponding prevention rates with more effective and less effective technologies were 72% and 68%. As shown in Fig. 2, the difference in prevention rates between those who received more effective and those who received less effective technologies emerged gradually within the first five rounds and remained clearly visible in the following rounds.

Fig. 2 Average prevention rates with more effective and less effective technologies

In Table 4 we show average preventive behavior during the laboratory experiment for subjects reporting and not-reporting each specific preventive behavior. For all of the behaviors except using sunscreen, we see that individuals who engaged in lab prevention had higher rates of self-reported prevention than individuals who did not prevent in the lab. These findings suggest that our experiment was capturing a tendency to engage in health prevention that is relevant across a variety of health domains.

Table 4 Self-reported preventive behavior and preventive behavior in the lab

Percentage of subjects reporting activity

Average rate of lab prevention among those reporting activities (“preventers”)

Average rate of lab prevention among those not reporting activities (“non-preventers”)

p value for t-test of differences between “preventers” and “non-preventers”

Currently taking vitamins

0.433

0.735

0.687

0.023

Flu shot in the last 12 months

0.468

0.730

0.688

0.046

Dentist visit in the last 12 months

0.776

0.723

0.656

0.008

Uses sunscreen regularly

0.389

0.722

0.689

0.286

All statistics are at the individual level, representing 679 study participants

Sending subjects health messages has a positive effect on prevention behaviors, raising the average technology adoption rate from 66.13 to 72.21%. Strong messages which do not reveal technology effectiveness seem to have the strongest effect—the average adoption rate in this treatment was 74.38%. The adoption rates in the other message treatments were 71.46%, 71.16%, and 71.85% for balanced messages without probabilities, balanced messages with probabilities, and strong messages with probabilities, respectively (Table 5).

Table 5 Prevention rates across treatments

All

Risk environments

Message treatments

p = 0.3

p = 0.5

p = 0.7

No message

Balanced, diffuse priors

Strong, diffuse priors

Balanced, common priors

Strong, common priors

Average prevention rate

0.703

0.700

0.666

0.741

0.661

0.715

0.744

0.712

0.718

On average, in each match, about 53% of participants rated the technology as effective (either “quite effective” or “highly effective”). Subjects were eleven percentage point more likely to think the technology was effective if the absolute risk reduction was 0.2 rather than 0.12. They were also two percentage points more likely to rate the technology positively in the second match than they were in the first match.

We start our empirical investigation by analyzing our first theoretical prediction (Hypothesis H1), which states that population level prevention rates should weakly decline with rational updating of priors over time. Figure 3 shows that this is generally true. In the first match, initially about 79% of all subjects chose prevention; however, the prevention rate dropped to roughly 66% by round 15. In the second match, the decline in prevention rate was more gradual, from 75% in the first round to 69% in the fifteenth round.

Fig. 3 Average prevention rates over time

We hypothesized that messages would increase prevention rates initially, but the effect would fade over time as subjects gained more personal experience (Hypothesis H2). We test this hypothesis by estimating

(22) P r e v e n t s i , r , g = β 0 + β 1 M e s s a g e i + β 2 M e s s a g e i R o u n d r + β 3 R o u n d r + β 4 M e d i u m R i s k i + β 5 H i g h R i s k i + β 6 E f f e c t i v e i , g + γ x i + δ g + ε i , r , g

to estimate message impact differences across rounds, and by estimating

(23) P r e v e n t s i , r , g = β 0 + β 1 M e s s a g e i + β 2 M e s s a g e i M a t c h g + β 3 M e d i u m R i s k i + β 4 H i g h R i s k i + β 5 E f f e c t i v e i , g + γ x i + δ g + ε i , r , g

to analyze differences between matches. In both models, β 1 captures the immediate message effect; β 2 captures the changes in messaging effects over time. Prevents is a binary indicator for whether or subject i decided to invest into prevention in round r of match g; Message is an indicator variable indicating that any “public health” message was received, Round indicates round number; MediumRisk and HighRisk capture p = 0.5 and p = 0.7; Effective is a binary indicator for effective technology (probability reduction of 0.20 rather than 0.12), x i is a vector of subject characteristics (age, sex, ethnicity, education, marital status, risk aversion score, discounting score,…) and δ g is match (1–2) fixed effects (with match 1 as reference category).

Table 6 shows the results of this estimation. Columns 1–2 shows the effect of messages in the first five rounds and in the last ten rounds of both matches, columns 4–5 shows the effect of messages in the first and the second matches separately. Columns 3 and 6 directly test the models above, showing the interaction between message and round (column 3) and the interaction between message and match (column 6). Confirming our hypothesis, we find that messages have a positive impact on average, boosting prevention by about 6 percentage points. Columns 3 and 6 indicate that, although prevention rates tend to decrease round-by-round, the effect of messages does not fade within the match. Interestingly, we find much weaker and insignificant effects of public messaging in match 2, which could be interpreted as evidence for public health messages losing importance over time as subjects receive highly similar (or identical) messages with different technologies.

Table 6 Effects of messages

Variables

Rounds 1–5

Rounds 6–15

All rounds

Match 1

Match 2

Both matches

(1)

(2)

(3)

(4)

(5)

(6)

Any message

0.056**

0.055**

0.049*

0.088***

0.022

0.084***

(0.024)

(0.024)

(0.026)

(0.025)

(0.025)

(0.025)

Any message*Round

0.001

(0.002)

Round

− 0.005***

(0.002)

Any message*Match 2

− 0.059***

(0.021)

Match 2

0.007

0.012

0.010

0.050***

(0.012)

(0.012)

(0.010)

(0.018)

Observations

6790

13,580

20,370

10,185

10,185

20,370

R-squared

0.038

0.045

0.042

0.042

0.045

0.042

Robust standard errors in parentheses clustered at the individual level. All estimations control for subject characteristics (age group: 17–25, 18–40, 41–60, 61 and above, sex, ethnicity, education, whether the subject is a student, marital status, whether the subject is a parent, attention score, financial literacy score, risk aversion score, Kirby discounting score), and include fixed effects for risk levels and technology effectiveness (not reported)

***p < 0.01; **p < 0.05; *p < 0.1

We continue by testing Hypothesis H3, which states that in higher risk environments agents respond less to a preventive failure. We do this empirically by testing the following model:

(24) P r e v e n t s i , r , g = β 0 + β 1 T e c h n o l o g y F a i l u r e R a t e i , r , g + β 2 T e c h n o l o g y F a i l u r e R a t e i , r , g M e d i u m R i s k i + β 3 T e c h n o l o g y F a i l u r e R a t e i , r , g H i g h R i s k i + β 4 P r e v e n t i o n A v e r a g e i , r , g + β 5 M e d i u m R i s k i + β 6 H i g h R i s k i + β 7 E f f e c t i v e i , g + β 8 M e s s a g e i + γ x i + δ g + ε i , r , g

where TechnologyFailureRate is the rate of technology failures the subject has experienced in the previous rounds, PreventionAverage is the subject’s average rate of prevention in previous rounds, calculated by dividing the number of rounds with prevention by the number of rounds played. All other variables are defined as before.

Table 7 shows the main results from these regressions. Columns 1–3 show behavioral responses in low, medium and high risk environments separately. In all risk environments, agents reduce their prevention because of sickness experienced when prevention was chosen in previous rounds; however, this response is smaller in medium and high risk environments. In columns 4–6 we test the pooled model with interaction terms outlined in Eq. (24). Column 4 shows the results for the initial rounds 2–5, column 5 for the last rounds 6–15, and column 6 shows the results for all rounds 2–15. Despite the somewhat mixed pattern during the first few rounds, we find the anticipated positive interaction effects between observed prevention outcomes and medium risk and high risk levels in later rounds. A ten percentage point increase in technology failure rate in the previous rounds reduced the likelihood of preventing in the following round by about 3.71 percentage points in the low risk environment. The same effect is 2.67 and 2.40 percentage points in the medium and high risk environments, respectively, both effects are statistically significant. For all rounds, this interaction effect is smaller.

Table 7 Risk levels and prior updating

Variables

Low risk

Medium risk

High risk

All risk environments

Rounds 2–15

Rounds 2–15

Rounds 2–15

Rounds 2–5

Rounds 6–15

Rounds 2–15

(1)

(2)

(3)

(4)

(5)

(6)

Prevention average of previous rounds

0.763***

0.711***

0.754***

0.608***

0.798***

0.758***

(0.024)

(0.041)

(0.035)

(0.032)

(0.021)

(0.018)

Technology failure rate in previous rounds

− 0.263***

− 0.231***

− 0.189***

− 0.126***

− 0.371***

− 0.258***

(0.026)

(0.033)

(0.028)

(0.036)

(0.040)

(0.026)

Technology failure rate in previous rounds*Medium risk

− 0.039

0.104*

0.039

(0.051)

(0.062)

(0.039)

Technology failure rate in previous rounds*High risk

− 0.013

0.131**

0.067*

(0.045)

(0.058)

(0.037)

Medium risk

0.015

0.005

0.006

(0.019)

(0.022)

(0.015)

High risk

0.052***

0.051*

0.045***

(0.019)

(0.027)

(0.017)

Effective

− 0.010

0.008

0.017

0.011

− 0.008

0.000

(0.011)

(0.020)

(0.014)

(0.012)

(0.010)

(0.008)

Any message

0.021

0.027

0.017

0.048***

0.011

0.022**

(0.013)

(0.02)

(0.016)

(0.014)

(0.011)

(0.010)

Observations

8861

3946

4732

4646

12,893

17,539

R-squared

0.292

0.235

0.272

0.166

0.307

0.272

Robust standard errors in parentheses clustered at the individual level. All estimations control for subject characteristics (age group: 17–25, 26–40, 41–60, 61 and above, sex, ethnicity, education, whether the subject is a student, marital status, whether the subject is a parent, attention score, financial literacy score, risk aversion score, Kirby discounting score), and include fixed effects for matches 1–2 (not reported)

***p < 0.01; **p < 0.05; *p < 0.1

Hypothesis H4 looks more directly at updating of priors, and states that the behavioral response to adverse outcomes in any given round should be the same as the response to adverse outcomes in previous rounds. We test this hypothesis by using two alternative empirical models:

(25) P r e v e n t s i , r , g = β 0 + β 1 a d j L a s t P S i , r , g + β 2 T e c h n o l o g y F a i l u r e R a t e i , r - 1 , g + β 3 P r e v e n t i o n A v e r a g e i , r , g + β 4 M e d i u m R i s k i + β 5 H i g h R i s k i + β 6 E f f e c t i v e i , g + β 7 M e s s a g e i + γ x i + δ g + ε i , r , g

and

(26) P r e v e n t s i , r , g = β 0 + β 1 L a s t P S i , r , g + β 2 L a s t P S 2 i , r , g + β 3 P r e v e n t i o n A v e r a g e i , r , g + β 4 M e d i u m R i s k i + β 5 H i g h R i s k i + β 6 E f f e c t i v e i , g + β 7 M e s s a g e i + γ x i + δ g + ε i , r , g

where LastPS and LastPS2 are indicators for whether technology failure happened last round and the round preceding it, respectively; TechnologyFailureRate i,r-1,g is the technology failure rate in the previous rounds excluding the last round; adjLastPS is LastPS adjusted for (divided by) the number of previous rounds where technology was chosen (excluding the last round) to make β 1 and β 2 comparable.

The first model compares response to the most recent outcome with response to all other previous outcomes among those who prevented last round. The second model compares response to the most recent outcome with response to the outcome just preceding it among those who prevented in the two previous rounds.

Table 8, column 1, reports the effect of technology failure occurring in the last (preceding) round and the effect of all other previous technology failures in the match. Both variables are adjusted by the number of previous rounds with prevention. The probability of preventing drops by about 1.4 percentage points following a ten percentage point increase in technology failure rate in all previous rounds excluding the last round. The response to sickness experienced with prevention in the immediate past is also negative but substantially (and statistically) larger in magnitude ( F = 24.04 , p < 0.01 ). Column 2 compares the effect of sickness in the previous round with sickness two rounds before among those who prevented in both rounds. The response to sickness in the preceding round is once again much larger than the response to sickness experienced two rounds before ( F = 7.12 , p < 0.01 ).

Table 8 Weighting of outcomes

Variables

All individuals

Individuals preventing in the last 2 rounds

(1)

(2)

Technology failure in the preceding round

− 0.323***

(adjusted for number of previous rounds where prevention chosen)

(0.034)

Technology failure rate in previous rounds

− 0.137***

(0.023)

Technology failure in the preceding round

− 0.091***

(0.009)

Technology failure 2 rounds before

− 0.059***

(0.008)

Prevention average of previous rounds

0.641***

0.598***

(0.029)

(0.038)

Medium risk

0.015

− 0.003

(0.012)

(0.012)

High risk

0.057***

0.036***

(0.012)

(0.010)

Effective

0.002

0.001

(0.008)

(0.007)

Any message

0.014

0.013

(0.009)

(0.009)

Observations

12,348

10,547

R-squared

0.186

0.130

Robust standard errors in parentheses clustered at the individual level. All estimations control for subject characteristics (age group: 17–25, 26–40, 41–60, 61 and above, sex, ethnicity, education, whether the subject is a student, marital status, whether the subject is a parent, attention score, financial literacy score, risk aversion score, Kirby discounting score), and include fixed effects for matches 1–2 (not reported)

***p < 0.01; **p < 0.05; *p < 0.1

Finally, we test Hypothesis H5, which says that outcomes from non-prevention contain no information, and thus should not result in any updating. This hypothesis has three directly testable predictions. First, agents who opt against prevention in the first round should never choose prevention in subsequent rounds (H5a). Figure 4 shows the percentage of agents who did not prevent in the first round switched to prevention for the first time in later rounds. The percentage of subjects switching declines over time, but remains above zero in most rounds.

Fig. 4 Percentage of subjects not preventing in the first round switching to prevention for the first time in each round

Another important implication of rational prior updating is subjects who switch out of prevention due to negative experiences should never adopt prevention again because non-prevention contains no information about effectiveness (H5b). In Fig. 5, we show the percentage of subjects who prevented in the first round and did not prevent in the previous round switched to prevention the current round. Contrary to rational learning models we find that in every single round at least 30% of subjects who had abandoned the technology switched back to prevention.

Fig. 5 Percentage of subjects preventing in the first round and not preventing in the previous round switching to prevention in each round

Finally, we hypothesized that agents’ assessment of technology effectiveness would be independent of non-prevention outcomes (H5c). We investigate players’ assessment at the end of the trial period using the following empirical model:

(27) A s s e s s m e n t i , g = β 0 + β 1 a d j P S i , g + β 2 a d j N S i , g + β 3 P r e v e n t i o n ig + β 4 M e d i u m R i s k i + β 5 H i g h R i s k i + β 6 E f f e c t i v e i , g + β 7 M e s s a g e i + γ x i + δ g + ε i , g

where Assessment is the subject’s overall rating of the effectiveness of the technology (1 = “Bad”, 4 = “Very good”), adjPS and adjNS are the number of failures experienced with and without prevention in the match, divided by the number of rounds with and without prevention, respectively. Prevention is the number of rounds where prevention was chosen.

Table 9 shows factors affecting subjects’ assessment of the technology. Columns 1–2 show the results for both matches, controlling and not controlling for risk levels. Columns 3–4 show the results for each match. In line with our hypothesis, subjects rate the technology as less effective if they experienced more technology failures in the match but on average their assessment is independent of non-prevention outcomes. Consistent with rational learning, subjects’ subjective technology assessment in general does not respond to health outcomes without prevention, despite their somewhat mild reaction in the first match. Given that we see large behavioral responses to non-prevention outcomes, this suggests that at least a part of the behavioral response is not directly linked to priors regarding technology effectiveness.

Table 9 Non-prevention outcomes and assessment

Variables

Both matches

Both matches

Match 1

Match 2

(1)

(2)

(3)

(4)

Number of rounds where prevention chosen and sickness experienced

− 2.052***

− 2.036***

− 2.113***

− 2.018***

(adjusted for total number of rounds where prevention chosen)

(0.187)

(0.136)

(0.177)

(0.189)

Number of rounds where prevention not chosen and sickness experienced

0.043

0.044

0.325**

− 0.195

(adjusted for total number of rounds where prevention not chosen)

(0.129)

(0.123)

(0.162)

(0.170)

Number of rounds where prevention chosen

0.089***

0.090***

0.077***

0.100***

(0.009)

(0.009)

(0.013)

(0.013)

Effective

− 0.030

− 0.029

− 0.077

0.005

(0.062)

(0.062)

(0.087)

(0.089)

Any message

− 0.027

− 0.029

0.027

− 0.075

(0.069)

(0.068)

(0.089)

(0.093)

Medium risk

− 0.057

(0.097)

High risk

0.027

(0.116)

Match 2

0.093*

0.093*

(0.053)

(0.053)

Observations

836

836

422

414

Sample mean

3.228

3.228

3.184

3.273

R-squared

0.398

0.397

0.383

0.431

Robust standard errors in parentheses clustered at the individual level. All estimations control for subject characteristics (age group: 17–25, 26–40, 41–60, 61 and above, sex, ethnicity, education, whether the subject is a student, marital status, whether the subject is a parent, attention score, financial literacy score, risk aversion score, Kirby discounting score)

***p < 0.01; **p < 0.05; *p < 0.1

5 Discussion and conclusions

In this paper, we present a theoretical model of preventive technology adoption and test it through a series of incentivized lab experiments. The model yields several insights; first, choosing not to take up an effective (income-increasing) preventive technology is consistent with expected-utility maximization if priors are sufficiently diffuse and agents are risk-averse; second, prevention will likely decline over time as subjects who have negative experiences with prevention downgrade their priors and switch out of prevention; third, declines in prevention over time will be particularly large if baseline risk is small.

Overall, we find subjects’ behavior consistent with the predictions of our model. A substantial fraction of subjects did not prevent in the laboratory, even when they were informed that prevention is highly effective. We also observe a gradual decrease in prevention rates over time. After 15 rounds, the number of subjects choosing prevention dropped by 6–13 percentage points in each match. Individuals who have high expectations about the effectiveness of the technology initially adopt prevention, but later revise their expectations downward when the technology fails. We also observe that in higher risk environments subjects adjust their priors less in response to a technology failure in later rounds, which is consistent with higher frequency of failures and thus lower informational content of each failure in these environments.

However, we also see substantial deviations from any model based around rational updating. Agents react stronger to their most recent experiences than to experiences more distant in the past even though these experiences do not have different informational value, in particular when it comes to preventive failure. This is in line with recent findings that an individual’s decision to take a flu shot most heavily depends on recent outcomes (Jin and Koch Reference Jin and Koch2018). In contrast with our experimental setup, probabilities of adverse events are of course not known in more realistic settings, which means that individuals may also update their priors regarding risks without prevention over time. Stronger reactions to recent outcomes in our experiment are consistent with the well documented “recency effect”, which suggests that people generally are more influenced by more recent information (Miller and Campbell Reference Miller and Campbell1959; Murdock Reference Murdock1962). While discounting of more distant events is somewhat hard to justify in our experimental setup, it could well be efficient in other settings and is thus not necessarily inconsistent with rational choice theory.

We also find strong evidence of behavioral responses to outcomes that do not reveal any information to participants. Specifically, we find that subjects experiencing negative health outcomes without prevention—the likelihood of which was known and completely unrelated to the preventive technology’s effectiveness—are more likely to switch to prevention than subjects experiencing positive health outcomes. Since non-prevention does not provide any information about the effectiveness of preventive technology (or the actual risk, which was held constant and known to all subjects), this strategy adjustment is hard to reconcile with learning models, but rather seems to be the result of a behavioral response (“reacting”) to undesired outcomes.

These patterns of behavior in our experiment resemble findings from recent observational studies which document strong reaction to subjective experiences. Individuals are substantially more likely to purchase flood insurance in the year after a bad flood (Gallagher Reference Gallagher2014). Investors with recent losses on the stock market appear more likely to no longer invest in stocks or to reduce their stock exposure (de Bondt and Thaler Reference de Bondt and Thaler1990). It is possible that individuals use events to update their risk priors in these real-life contexts; this mechanism was intentionally ruled out in our experiment.

Interestingly, we find a discrepancy between subjects’ assessment of technology effectiveness and their prevention behavior. Assessments of technology effectiveness appear to be largely independent of outcomes experienced without prevention, the likelihood of which was known to subjects from the beginning of the experiment. This result is consistent with previous studies which often find that people assess likelihood in a Bayesian fashion (Anwar and Loughran Reference Anwar and Loughran2011; Liu and Hsieh Reference Liu and Hsieh1995). Yet in our experiments, subjects reacted more to non-prevention outcomes than rational models would predict, suggesting factors beyond the direct outcomes (such as the feelings those outcomes produce) may influence behaviors.

A possible explanation for why individuals react to illness, regardless of whether it is informative about the value of prevention is the “availability heuristic” (Tversky and Kahneman Reference Tversky and Kahneman1973), where recent experiences are most available (fresh in subjects’ mind) when subjects have to judge frequencies and probabilities, regardless of how much information these experiences contain. Our finding could also be explained by “experiential regret aversion” (Lovelady Reference Lovelady2014). While many models have focused on how regret and the anticipation of regret may shape decisions (Bell Reference Bell1982; Hayashi Reference Hayashi2011; Loomes and Sugden Reference Loomes and Sugden1987; Sarver Reference Sarver2008), “experiential regret aversion” focuses on how past feelings of regret influence future choices (Lovelady Reference Lovelady2014). In our experiment, regret could explain why individuals who fell sick in the experiment after failing to prevent switched strategies and became more likely to prevent. It is also possible that subjects play rationally only with some probability and experiment otherwise—developing new models to accommodate such behavior could be an interesting avenue for future work.

From a public policy perspective, our findings have three main implications: first, initial uptake of preventive technologies may be easier if the risk of adverse health outcomes is sufficiently large, or is at least perceived to be sufficiently large. Our results suggest that highlighting the risk of not engaging in prevention will likely increase uptake of prevention, at least in early stages when subjects have not yet gained experience with the technology.

The second main implication of our study is that the degree to which rates of prevention can be sustained over time is likely to be strongly affected by how likely adverse events are with prevention, or how imperfectly prevention protects against poor outcomes. While our experiment cannot fully capture long-term dynamics, it strongly suggests that negative experiences with preventive technologies have lasting effects on uptake. In some fortunate cases preventive technologies may be so effective that the likelihood of adverse health outcomes is very small; in those cases, uptake and adoption should be more easily sustained. In many other settings, including flu shots, bed nets or hygiene intervention, the same is clearly not true, so that a large number of individuals trying out the technology may choose to no longer pursue prevention after a certain number of failed trials.

The third and likely most positive finding is that public health messages can increase uptake of preventive technologies, even though the magnitude of these effects is not large—an increase of about 10% relative to the group without messages in our setting. Both the direction and magnitude of our finding are consistent with existing evidence on messaging in public health (Orr and King Reference Orr and King2015).

Our study has a few important limitations. First, we consider our results through a lens of expected utility maximization. Future work could consider alternative models such as minimax (Manski Reference Manski2020), which allow for the possibility that choices within the health sphere may reflect a different set of optimization criteria. Relatedly, the structure of our experimental setup is such that losses in the game are only possible when subjects choose to prevent. If subjects are averse to losses, our results may in part reflect a high prioritization of avoiding losses. In part, this design choice reflected the challenge of simulating losses in laboratory experiments (Hvide et al. Reference Hvide, Lee and Odean2019), which also limits our ability to study different illness severity within our setup. This is an area that could be very interesting for future studies. Third, for simplicity, we rule out spillover or contagion effects in the model, i.e. assume the risk of getting sick is independent of other people’s preventive efforts. In practice, this is clearly not the case in many real world settings, where disease risk directly increases with the risk of other people not preventing (e.g. measles, flu but also general hygiene behaviors). In these settings, our model could be viewed as a special case where individuals take the behavior of other people in their surrounding as given; similar results would likely also emerge if dynamic interactions would be considered, although such a model would be much harder to solve.

Overall, our results suggest that, in settings where individuals’ repeated investments are necessary for positive health outcomes, it may be worthwhile to spend greater resources developing preventive strategies that are highly effective instead of spending resources on promoting preventive technologies that are only partially effective. For technologies with relatively high probabilities of preventive failure, stronger external measures such as financial incentives, social pressure or legal requirement may be necessary to achieve high rates of adoption over time.

Acknowledgements

Open access funding provided by University of Basel. The authors would like to thank Slawa Rokicki as well as the entire staff at the Harvard Decision Science Laboratory for their continued support for the lab sessions and data collection. We would also like to thank the Career Incubator Fund for the financial support of this project. We are also grateful to the seminar participants at the Harvard School of Public Health, Southern Methodist University and New York University for their many useful comments and suggestions. We would also like to thanks Mingqiang Li for his contributions to a previous version of this project.

Footnotes

Electronic supplementary material The online version of this article (https://doi.org/10.1007/s10683-020-09668-6) contains supplementary material, which is available to authorized users.

1 Flu shots are somewhat different from the other behaviors because absolute risk of each person depends on the proportion of the surrounding population vaccinated. We discuss this in further detail in the Discussion section at the end.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

Association, American Dental (2010). Healthy People 2010—Conference Edition..Google Scholar
Anderson, LR, & Mellor, JM (2009). Are risk preferences stable? Comparing an experimental measure with a validated survey-based measure. Journal of Risk and Uncertainty, 39(2), 137160. 10.1007/s11166-009-9075-zCrossRefGoogle Scholar
Anwar, S, & Loughran, TA (2011). Testing a Bayesian learning theory of deterrence among serious juvenile offenders. Criminology, 49(3), 667698. 10.1111/j.1745-9125.2011.00233.xCrossRefGoogle Scholar
Ashraf, N, Field, E, & Lee, J (2014). Household bargaining and excess fertility: An experimental study in Zambia. American Economic Review, 104(7), 22102237. 10.1257/aer.104.7.2210CrossRefGoogle Scholar
Banerjee, A, Barnhardt, S, & Duflo, E (2018). Can iron-fortified salt control anemia? Evidence from two experiments in rural Bihar. Journal of Development Economics, 133, 127146. 10.1016/j.jdeveco.2017.12.004CrossRefGoogle Scholar
Bell, DE (1982). Regret in decision making under uncertainty. Operations Research, 30(5), 961981. 10.1287/opre.30.5.961CrossRefGoogle Scholar
Böhm, R, Betsch, C, & Korn, L (2016). Selfish-rational non-vaccination: Experimental evidence from an interactive vaccination game. Journal of Economic Behavior & Organization, 131, 183195. 10.1016/j.jebo.2015.11.008CrossRefGoogle Scholar
Bryan, G. (2010). Ambiguity and insurance. Working Paper, Yale University.Google Scholar
Burton-Chellew, MN, Nax, HH, & West, SA (2015). Payoff-based learning explains the decline in cooperation in public goods games. Proceedings. Biological Sciences, 282(1801), 20142678 10.1098/rspb.2014.2678Google ScholarPubMed
Chassang, S, Padró i Miquel, G, & Snowberg, E (2012). Selective trials: A principal-agent approach to randomized controlled experiments. American Economic Review, 102(4), 12791309. 10.1257/aer.102.4.1279CrossRefGoogle Scholar
Conley, TG, & Udry, CR (2010). Learning about a new technology: Pineapple in Ghana. American Economic Review, 100(1), 3569. 10.1257/aer.100.1.35CrossRefGoogle Scholar
Daskalakis, C, DiCarlo, M, Hegarty, S, Gudur, A, Vernon, SW, & Myers, RE (2020). Predictors of overall and test-specific colorectal cancer screening adherence. Preventive Medicine, 133, 106022 10.1016/j.ypmed.2020.106022CrossRefGoogle ScholarPubMed
de Bondt, WFM, & Thaler, RH (1990). Do security analysts overreact?. American Economic Review, 80(2), 5257.Google Scholar
Dobkin, C, Finkelstein, A, Kluender, R, & Notowidigdo, MJ (2018). The economic consequences of hospital admissions. American Economic Review, 102(2), 308352. 10.1257/aer.20161038CrossRefGoogle ScholarPubMed
Dupas, P (2011). Health behavior in developing countries. Annual Review of Economics, 3(1), 425449. 10.1146/annurev-economics-111809-125029CrossRefGoogle Scholar
Engle-Warnick, J., Escobal, J., & Laszlo, S. (2007). Ambiguity aversion as a predictor of technology choice: Experimental evidence from Peru. Working Paper 2007s-01, CIRANO.CrossRefGoogle Scholar
Erev, I, Haruvy, E Kagel, JH, & Roth, AE (2016). Learning and the economics of small decisions. The Handbook of Experimental Economics, Princeton, NJ: Princeton University Press 638716. 10.1515/9781400883172-011Google Scholar
Foster, AD, & Rosenzweig, M (1995). Learning by doing and learning from others: Human capital and technical change in agriculture. Journal of Political Economy, 103(6), 11761209. 10.1086/601447CrossRefGoogle Scholar
Gallagher, J (2014). Learning about an infrequent event: Evidence from flood insurance take-up in the United States. American Economic Journal: Applied Economics, 6(3), 206233. 10.1257/app.6.3.206Google Scholar
Guthold, R, Stevens, GA, Riley, LM, & Bull, FC (2018). Worldwide trends in insufficient physical activity from 2001 to 2016: A pooled analysis of 358 population-based surveys with 1.9 million participants. The Lancet Global Health, 6(10), e1077e1086. 10.1016/S2214-109X(18)30357-7CrossRefGoogle ScholarPubMed
Hanna, R, Duflo, E, & Greenstone, M (2016). Up in smoke: The influence of household behavior on the long-run impact of improved cooking stoves. American Economic Journal: Economic Policy, 8(1), 80114. 10.1257/pol.20140008Google Scholar
Hayashi, T (2011). Context dependence and consistency in dynamic choice under uncertainty: the case of anticipated regret. Theory and Decision, 70(4), 399430. 10.1007/s11238-009-9175-xCrossRefGoogle Scholar
Holman, DM, Berkowitz, Z, Guy, GP, Hawkins, NA, Saraiya, M, & Watson, M (2015). Patterns of sunscreen use on the face and other exposed skin among US adults. Journal of the American Academy of Dermatology, 73(1), 83-92.e1 10.1016/j.jaad.2015.02.1112CrossRefGoogle ScholarPubMed
Holt, CA, & Laury, SK (2002). Risk aversion and incentive effects. American Economic Review, 92(5), 16441655. 10.1257/000282802762024700CrossRefGoogle Scholar
Hvide, H. K., Lee, J. H., & Odean, T. (2019). Easy money, cheap talk, or spuds: Inducing risk aversion in economics experiments. Working Paper.CrossRefGoogle Scholar
Jin, G. Z., & Koch, T. G. (2018). Learning by suffering? Patterns in flu shot take-up. Working Paper 25272, NBER.CrossRefGoogle Scholar
Kirby, KN, Petry, NM, & Bickel, WK (1999). Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. Journal of Experimental Psychology: General, 128(1), 7887. 10.1037//0096-3445.128.1.78CrossRefGoogle ScholarPubMed
Liu, J-T, & Hsieh, C-R (1995). Risk perception and smoking behavior: Empirical evidence from Taiwan. Journal of Risk and Uncertainty, 11, 139157. 10.1007/BF01067682CrossRefGoogle Scholar
Loomes, G, & Sugden, R (1987). Some implications of a more general form of regret theory. Journal of Economic Theory, 41(2), 270287. 10.1016/0022-0531(87)90020-2CrossRefGoogle Scholar
Lovelady, S. (2014). Experiential regret aversion. Ph.D. Dissertation, University of Warwick.Google Scholar
Luoto, J, Najnin, N, Mahmud, M, Albert, J, Islam, MS, Luby, S, & Levine, DI (2011). What point-of-use water treatment products do consumers use? Evidence from a randomized controlled trial among the urban poor in Bangladesh. PLoS ONE, 6(10), e26132 10.1371/journal.pone.0026132CrossRefGoogle ScholarPubMed
Lusardi, A, Mitchell, OS Mitchell, OS, & Lusardi, A (2011). Financial literacy and planning: Implications for retirement wellbeing. Financial literacy: Implications for retirement security and the financial marketplace, Oxford: Oxford University Press 1739. 10.3386/w17077Google Scholar
Manski, CF (2020). Towards reasonable patient care under uncertainty. Contemporary Economic Policy, 38(2), 227245. 10.1111/coep.12452CrossRefGoogle Scholar
Miller, N, & Campbell, DT (1959). Recency and primacy in persuasion as a function of the timing of speeches and measurements. The Journal of Abnormal and Social Psychology, 59(1), 19. 10.1037/h0049330CrossRefGoogle ScholarPubMed
Miller, G, & Mobarak, AM (2015). Learning about new technologies through social networks: Experimental evidence on nontraditional stoves in Bangladesh. Marketing Science, 34(4), 480499. 10.1287/mksc.2014.0845CrossRefGoogle Scholar
Mobarak, AM, Dwivedi, P, Bailis, R, Hildemann, L, & Miller, G (2012). Low demand for nontraditional cookstove technologies. Proceedings of the National Academy of Sciences of the United States of America, 109(27), 1081510820. 10.1073/pnas.1115571109CrossRefGoogle ScholarPubMed
Murdock, BB Jr (1962). The serial position effect of free recall. Journal of Experimental Psychology, 64(5), 482488. 10.1037/h0045106CrossRefGoogle Scholar
Ofori-Asenso, R, Jakhu, A, Zomer, E, Curtis, AJ, Korhonen, MJ, Nelson, M et al., (2018). Adherence and persistence among statin users aged 65 years and over: A systematic review and Meta-analysis. The Journals of Gerontology. Series A, Biological Sciences and Medical Sciences, 73(6), 813819. 10.1093/gerona/glx169CrossRefGoogle Scholar
Orr, JA, & King, RJ (2015). Mobile phone SMS messages can enhance healthy behaviour: A meta-analysis of randomised controlled trials. Health Psychology Review, 9(4), 397416. 10.1080/17437199.2015.1022847CrossRefGoogle ScholarPubMed
Oster, E (2018). Does disease cause vaccination? Disease outbreaks and vaccination response. Journal of Health Economics, 57, 90101. 10.1016/j.jhealeco.2017.10.003CrossRefGoogle ScholarPubMed
Saran, I, Fink, G, & McConnell, M (2018). How does anonymous online peer communication affect prevention behavior? Evidence from a laboratory experiment. PLoS ONE, 13(11), e0207679 10.1371/journal.pone.0207679CrossRefGoogle ScholarPubMed
Sarver, T (2008). Anticipating regret: Why fewer options may be better. Econometrica, 76(2), 263305. 10.1111/j.1468-0262.2008.00834.xCrossRefGoogle Scholar
Tversky, A, & Kahneman, D (1973). Availability: A heuristic for judging frequency and probability. Cognitive Psychology, 5(2), 207232. 10.1016/0010-0285(73)90033-9CrossRefGoogle Scholar
Wagstaff, A, Flores, G, Smitz, M-F, Hsu, J, Chepynoga, K, & Eozenou, P (2018). Progress on impoverishing health spending in 122 countries: A retrospective observational study. The Lancet Global Health, 6(2), 180192. 10.1016/S2214-109X(17)30486-2CrossRefGoogle ScholarPubMed
Wagstaff, A, & van Doorslaer, E (2003). Catastrophe and impoverishment in paying for health care: With applications to Vietnam 1993–1998. Health Economics, 12(11), 921934. 10.1002/hec.776CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1 Critical values for the absolute risk reduction, represented by ec, above which prevention is the optimal strategy for expected utility maximizing agents in the experiment. Figure shows critical value ec, the level of absolute risk reduction above which agents with a constant relative risk aversion utility function prefer prevention to non-prevention. All calculations are made under the assumption that agents maximize a CRRA utility function, that incomes in the high and low states are 20 and 10, respectively, and that the cost of prevention is 1. The risk levels in the low, medium and high risk environments are 0.3, 0.5, and 0.7, respectively

Figure 1

Table 1 Messages and information

Figure 2

Table 2 Allocation of experimental treatments

Figure 3

Table 3 Summary statistics on experiment subjects

Figure 4

Fig. 2 Average prevention rates with more effective and less effective technologies

Figure 5

Table 4 Self-reported preventive behavior and preventive behavior in the lab

Figure 6

Table 5 Prevention rates across treatments

Figure 7

Fig. 3 Average prevention rates over time

Figure 8

Table 6 Effects of messages

Figure 9

Table 7 Risk levels and prior updating

Figure 10

Table 8 Weighting of outcomes

Figure 11

Fig. 4 Percentage of subjects not preventing in the first round switching to prevention for the first time in each round

Figure 12

Fig. 5 Percentage of subjects preventing in the first round and not preventing in the previous round switching to prevention in each round

Figure 13

Table 9 Non-prevention outcomes and assessment

Supplementary material: File

Fink et al. supplementary material

Learn or React? An Experimental Study of Preventive Health Decision Making
Download Fink et al. supplementary material(File)
File 1.2 MB