Hostname: page-component-6bf8c574d5-qdpjg Total loading time: 0 Render date: 2025-02-23T17:52:26.616Z Has data issue: false hasContentIssue false

From “Informed” to “Engaged” Consent: Risks and Obligations in Consent for Participation in a Health Data Repository

Published online by Cambridge University Press:  01 January 2021

Rights & Permissions [Opens in a new window]

Abstract

The development and use of large and dynamic health data repositories designed to support research pose challenges to traditional informed consent models. We used semi-structured interviewing (n=44) to elicit diverse research stakeholders' views of a model of consent appropriate to participation in initiatives that entail collection, long-term storage, and undetermined future research use of multiple types of health data. We demonstrate that, when considering health data repositories, research stakeholders replace a concept of consent as informed with one in which consent is engaged. In engaged consent, a participant's ongoing relationship with a repository serves as a substitute or adjunct to information exchange at enrollment. We detail research stakeholders' views of the risks of engaged consent and suggest questions for further study about engagement and consent procedures in initiatives that aim to store data for future unspecified research purposes.

Type
Independent Articles
Copyright
Copyright © American Society of Law, Medicine and Ethics 2020

Traditional standards of informed consent in research require “that subjects enter into research voluntarily and with sufficient information about the research activity to make a comprehending decision about participation.”Reference McGuire and Beskow1 Federal regulations state that the basic elements of informed consent include information about the study purpose; procedures (i.e., biospecimen and information collection, storage and access, re-contact and data-sharing); risks and benefits; protections for privacy and confidentiality; plans for costs, payment and commercialization; plans for sharing results and disclosure; and procedures for withdrawal.2 Biobanking and the creation of other multidimensional data repositories introduce new challenges to this standard of informed consent.Reference Faden, Beauchamp and Kass3 In biobanking, biospecimens are stored and shared to investigate research questions that are not determined at the time of data collection, and plans for commercialization and data sharing may be difficult to articulate in advance. Large-scale research infrastructure projects, like the All of Us Research Program (AoURP) (a government supported research initiative that aims to enroll 1 million people) and Project Baseline (a corporate sponsored project to study a cohort of 10K), also aim to store multiple types of data (e.g., genetics, physical measurements, self-reported behaviors, electronic health records) collected from a large number of participants for future unspecified research uses.Reference Sankar and Parker4 Potential participants may be asked to grant permission to have their data stored at a time when study recruiters will find it “impossible to describe in detail or even to foresee all of the future research for which they might be used.”5

Recently, bioethicists have raised fundamental questions about whether and through what mechanisms current informed consent procedures can accommodate new research models that feature long-term storage and use of data. Reference Budin-Ljøsne, Teare, Kaye, Burke, Beskow, Trinidad, Fullerton, Brelsford, Sabatello, Appelbaum, Murphy, Scott, Kaufman, Geller, LeRoy, Hudson, D'Abramo, Sheehan, Khodyakov, Mendoza-Graf, Berry, Nebecker and Bromley6 In a recent mixed-method examination of researchers' views about the importance of understanding during consent for biobanking, Beskow and WeinfurtReference Beskow and Weinfurt7 identify disagreement among experts about whether participants with gaps in understanding should be allowed to consent for biobanking. Given that many of the experts did not see poor understanding as barring participation, Beskow and Weinfurt conclude that informed consent may need to be re-conceptualized, with understanding considered an aspiration rather than a requirement.Reference Wieten, Blythe and Magnus8 Many of the commentaries accompanying Beskow and Weinfurt's article appear to reconsider the role of information exchange in consent. As Ellen Wright Clayton says, “It is time to think more clearly about what we hope to achieve with informed consent.”Reference Clayton9

This paper contributes to this reconsideration by focusing on research stakeholders' views of a model of consent appropriate to biobanking and research infrastructure initiatives like the AoURP and Project Baseline (hereafter referred to as health data repositories) that entail long-term storage and undetermined future research use of multiple types of health data. We conducted semi-structured interviews with a variety of research stakeholders to elicit their views of a model of consent appropriate to health data repositories. We explored their views of the function of consent for participation in health data repositories; and we examined their views of the overlap and divergence between health data repository and traditional biomedical research consent. In particular, we explored research stakeholders' views of the role of information exchange in consent and challenges to consent that arise when there is limited certainty about the future purposes, procedures, and risks of a health data repository study at the time of enrollment.

This paper contributes to this reconsideration by focusing on research stakeholders' views of a model of consent appropriate to biobanking and research infrastructure initiatives like the AoURP and Project Baseline (hereafter referred to as health data repositories) that entail long-term storage and undetermined future research use of multiple types of health data. We conducted semi-structured interviews with a variety of research stakeholders to elicit their views of a model of consent appropriate to health data repositories. We explored their views of the function of consent for participation in health data repositories; and we examined their views of the overlap and divergence between health data repository and traditional biomedical research consent.

We demonstrate that, when considering health data repositories, research stakeholders refine and reframe their concept of consent. Rather than describe consent as informed, they describe a concept in which consent is engaged. Stakeholders' model of engaged consent emphasizes the importance of the participant's ongoing relationship with the study as a substitute or adjunct to information exchange at the time of enrollment. Moreover, we demonstrate the ways in which research stakeholders' views of the need for re-consent are shaped by their concerns about limitations of information exchange at enrollment. By focusing on stakeholders' understandings of risks and ethical obligations in consent for participation in health data repositories, we outline some contemporary uncertainties about the functions and requirements of consent for initiatives that aim to store data for unspecified research purposes.

Background

Informed consent is the essence of autonomyReference Capron10 or respect for persons, a key ethical principle in the Belmont Report that remains a foundation for contemporary research ethics.11 A large empirical literature describes the extent to which individuals understand information presented during the informed consent process,Reference Sugarman, Paasche-Orlow, Flory and Emanuel12 as well as strategies for improving comprehension.Reference Del Carmen, Joffe, Goldberger, Kruse, Kadish, Passman, Bergner, Palmer, Cassidy, Dunn, Spira and Sheikh13 As procedures for long-term storage of data for unspecified research purposes have developed over the past few years,Reference Patil, Majumdar, Awan, De Souza and Greenspan14 bioethicists have raised questions about whether and in what way individuals should consent for initial donation of data or biospecimens to repositories and for re-use of data. A large national survey of adults in the U.S. found that a majority of respondents were supportive of large-scale research on genes and environment, with the opportunity to learn more about one's own health appearing to be a strong motivator for participation.Reference Kaufman, Baker, Milner, Devaney and Hudson15 Yet bioethicists have raised difficult questions about which informational features must be included in consent for health data repositories and how those features should be implemented.Reference Lemke, Halverson, Ross, Burke, Antommaria, Bennett, Sanderson, Brothers, Mercaldo, Beskow, Dombeck, Thompson, Watson-Ormond and Weinfurt16

The revised Common Rule for the protection of human research participants incorporates into regulations a model of broad consent. 17 Broad consent provides “consent for an unspecified range of future research subject to a few content and/or process restrictions.”Reference Grady, Eckstein and Berkman18 The U.S. Health and Human Services Secretary's Advisory Committee on Human Research Protections (SACHRP) states that broad consent “may be the most suitable pathway for research involving identifiable private information or identifiable bio-specimens” and can function as a “substitute for traditional informed consent in certain circumstances.”19 In this broad consent framework, participants receive sufficient information about potential study purposes and procedures, foreseeable risks and benefits, and plans for use of identifiable information or specimen and information sharing.20

For a variety of reasons, policy guidelines may not settle questions about information exchange during consent to health data repositories. First, the regulatory version of broad consent differs in certain ways from how broad consent has been discussed and used in practice, and other models of consent have been proposed to ensure that the rights of donors are upheld when donating data to a health data repository.Reference Nanibaa'A, Sathe, Antommaria, Garrett, Dohan and Koenig21 Various models of consent — blanket consent, layered consent,Reference Bunnik, Janssens and Schermer22 tiered consent,Reference Lentz, Kennett, Perlmutter and Forrest23 dynamic consent,Reference Kaye, Whitley, Lund, Morrison, Teare, Melham, Wee, Henaghan and Winship24 and partnered consent25 are just some examples — provide a plan for information exchange while highlighting its limits. For instance, in a blanket consent model, participants donate their data and samples with no ability to limit their uses for future research,Reference Wendler26 an approach that some say undermines participant autonomyReference Caulfield27 and under-communicates study risks.Reference Greely28

Moreover, the Common Rule's broad consent requirement that participants receive sufficient information about purposes and procedures, risks and benefits, and plans for use and sharing of data may not be achievable at the time of consent to participation. The necessary components of a broad consent process remain unsettled, and SACHRP “favored allowing institutions to create their own broad consent forms that could be tailored to a variety of circumstances.”29 Barriers to fully informing participants at the time of consent for health data repository studies have been long-recognized and include overestimation of personal benefit and underestimation of risk.Reference Klima, Fitzgerald-Butt, Kelleher, Barr, McCarty, Nair, Austin, Giampietro, Ormond, Cirino, Helenowski, Chisholm and Wolf30 Moreover, data-banking studies often involve multiple researchers, sites, and projects, complicating dialogue with participants as new uses of the data or new plans for return of results emerge.

Recently, functions of consent beyond informing have received attention from bioethicists. Recognition of limitations of information exchange during consent has brought other key functions of consent to the fore.Reference Dickert, Fehr, Llanos, Scicluna, Samady, Mandava, Pace, Campbell, Emanuel and Grady31 For instance, Dickert et al. emphasize the fact that, even where understanding remains limited, consent processes promote “transparency, integrity, and trustworthiness” between researcher and participant; these functions of consent, “each have independent ethical value.”Reference Dickert, Eyal and Goldkind32 Brudney emphasizes that consent is best thought of not as a means of promoting autonomy but of contributing to authentic decision-making.Reference Brudney33 And, Faden et al., arguing that consent processes can over-protect patients from research that could benefit them, suggest using strategies that prioritize transparency and trust instead of traditional consent procedures.34 In this context of change and reconsideration, we conducted a broad exploration of the functions that research stakeholders ascribe to consent, the aspects of consent they see as critical, and the aspects of health data repository consent that raise concerns about protection of participant autonomy.

Methods

We conducted a series of semi-structured telephone interviews with a diverse group of 44 experienced research stakeholders about their perspectives on consent for large-scale health data repositories. Our goal was to solicit the perspectives of stakeholders with previous experiences with biobanks, longitudinal studies, human subjects' protection, data privacy and security, and stakeholder-engaged projects. We sought interviewees representing universities, health provider organizations, community organizations, non-profit research institutions, and private companies. We aimed to enroll a purposive, variant sample of experts in the field to capture a wide range of contemporary views about consent for health data repositories. Such a sample is useful to expand the range of differences of opinion that may emerge in the data.

To assemble a diverse yet information-rich sample, we reached out to (1) authors of recent publications on ethics of genetic research, (2) individuals involved with commercial and research biobanks, (3) the members of relevant AoURP working groups, and (4) individuals representing community-based organizations attending stakeholder engagement conferences about the AoURP. Because it is one of the largest and most diverse health data repository programs — both in terms of involved institutions and participants — we assumed individuals involved with AoURP would have highly salient perspectives. We tracked enrollment as it proceeded and adjusted sampling to ensure that we included perspectives from all of these groups.

A team of three experienced qualitative researchers conducted all interviews by telephone using a semi-structured interview guide. It included open-ended questions about the enrollment and consent of participants, approaches to consent for a project like AoURP including broad consent, pros and cons of different consenting approaches, and the need for re-consent. Questions included, “What may motivate a large and diverse group of individuals to enroll in a health data repository? What does broad consent mean in the context of AoURP or related initiatives? That is, what are people consenting for? What are the benefits and drawbacks related to the reliance on broad consent? What are the situations where you think additional consent should be required for studies that plan to use existing de-identified data? How might the use of broad consent affect participants' interest in, enrollment in, satisfaction with, and retention in the repository?” All interviews were audio recorded and transcribed verbatim. Institutional Review Board approval for this study was obtained from the RAND Human Subjects Protection Committee.

All researchers jointly developed the codebook, which included codes derived deductively from interview topics and inductive categories describing different views of consent that emerged during data collection. The codebook included codes for the goals, meanings, and implications of consent; the need for modifications to consent procedures to ensure ethical study procedures; the role for updates to consent or follow up consenting; participants' motivations for consenting; ethical concerns about different consent approaches and solutions to address them; and implementation challenges of different consent approaches and solutions to address them. After the main codes were developed, two transcripts were coded separately by the two coders and compared. Disagreements were discussed until consensus was achieved. Next, one coder coded the remaining interview transcripts. A second coder then checked text marked with categorical content codes (i.e., need for re-consent), found no disagreements with content codes, and tallied counts. Both coders re-reviewed coded text, identified the most salient themes, looked for cross cutting themes across interviewees, linked related concepts, and searched for stakeholder differences and similarities in perspectives. All three researchers reviewed data summaries, offered revisions and refinements to thematic descriptions, and finalized selection of illustrative quotes.

Results

The sample is described in Tables 1 and 2. We approached 77 individuals to yield a sample of 44 (57%) who completed a phone interview. Females were more likely than males to respond to our interview invitation (65% vs. 37%, p=.019), and we interviewed more project administrators than Ph.D.-level researchers. Roughly one-third of our participants were employed at academic institutions, and one quarter were employed by a health provider organization. Interviewees are identified by a study ID as well as a code for employment sector (Health Provider Organization=H; University=U; Non-Profit Research Organization=NP; Private Research Organization=PR; Community-Based Organization=C); interviewees highly-involved in the AoURP are identified with a plus (+) symbol.

Table 1. Interviewees' Place of Employment

* Includes organizations that offer specialized research expertise in areas such as infrastructure support, marketing and communication, or data management

Table 2. Sample Characteristics

* Defined as participating in 2 or more AoURP working groups

I. Functions of Consent to Participate in a Health Data Repository

Interviewees described consent to a health data repository as a process eliciting participant agreement to evolving uses of their data as overseen by an institutional infrastructure that stewards that data over a long period of time. Instead of emphasizing the informing function of consent, interviewees suggested consent could be informed enough: it could provide a general overview that lacks many details. These aspects of consent as described by interviewees are detailed below.

Evolving Uses of Data:

Interviewees contrasted traditional informed consent, in which participants agree to a specific study purpose, to consent in a health data repository context, in which participants consent for use of their data for evolving purposes. While broad consent has been described as allowing future, unspecified, or indeterminant uses of data, we call these uses of data ‘evolving’ to reflect interviewees' emphases on data being relinquished to researchers' emergent choices about study questions. Interviewee 14 (NP) said, “Essentially, an individual consents at the outset that their data can be used for purposes that are not yet established.” Another (ID23; U+) agreed that participants must know “that their data is going to be used for research and available to researchers for all kinds of research.” According to interviewee 26 (H+), participants are giving up their right to disallow particular uses of their data: “we make it clear if you're not comfortable with having your samples and data used for [a] specific kind of research, then you should consider not participating because literally it could be used for any and all research.” Interviewee 41 (U+) agreed that participants needed to know that they were giving up rights: “let's just really be absolutely clear that you are donating your data and your blood and your information, and we do not know what researchers are going to do with it.” These interviewees emphasized that participants relinquish their right to prevent data from being used. Interviewee 50 (U+) said that the consent “needs to cover … the future assay that can be done on the specimen.”

Other interviewees emphasized that consent to participation in a health data repository entails an agreement that their data will be put to use. Interviewee 43 (NP+) said that consent is an agreement to share data with “someone out there [who] will hopefully be using it…to help us understand illnesses and diseases better.” Interviewee 19 (U+) said that the purpose of a repository is discovery, which necessitates an exploratory use of the data: “You are telling them that the data will be used for every discovery that will happen in the future.” Interviewee 17 (PR) called the lack of specificity of the study purpose “part of the transparency” of a data repository study since “we're moving into a discovery phase, so we won't know everything that we're going to learn.” These interviewees framed consent not so much as an agreement to any subsequent use of data but to a purpose dictated by the imperative of scientific discovery.

Institution and Infrastructure:

Rather than describing consent as an agreement to complete specific study procedures, interviewees described participants as agreeing to be a part of a broader research process. They described consent as conferring decision-making authority on the institution or infrastructure that manages the health data repository. As interviewee 26 (H+) explained, “They're consenting to be part of a large longitudinal study that will engage with them multiple times” over an extended period. When asked to clarify what participants are consenting to, interviewee 25 (U+) said they “are volunteering to be a part of [a study] and contribute information…that could be used for any type of research for years and years to come.” Interviewee 13 (U) said participants agree to a method of collecting and storing data, including “how the study will operate,” or “the infrastructure of the study and how the study is set up,” which comprises “a process by which their samples and data are going to be collected, how they are going to be stored, what sort of confidentiality protections…and then this process by which decisions will be made about who can use data and for what purpose.” Interviewee 31 (H+) summarized that the consent “has to accurately describe… the rules of engagement” of the study. Interviewee 27 (H+) described a requirement that researchers “be up front with folks that … these are the way your materials will be used, these are the protections that are in place, and we're going to do our best to make sure that it's being used as wisely as possible.” Interviewee 14 (NP) agreed that consent processes entail “making sure that at the outset participants understand that if they participate, this is the framework that they are participating in.”

Informed Enough:

Interviewees consistently deemphasized the importance of information exchange and understanding at the time of consent to a data repository. As interviewee 26 (H+) said, for example, the recruitment process “is actually about getting people jazzed up and excited” about a long-term relationship with the study. Interviewee 50 (U+) said that a “constant information loop with participants” is a goal, rather than one-time conveyance of information, a procedure this interviewee called “really looking at consent in a different light.” Interviewee 50 (U+) said that while traditional consent consists of “’I'm explaining something to you, I'm going to ask you some questions, making sure that you understand, and I'm going to ask you to sign this piece of paper,’” in consent for a health data repository “the engagement of participants … has to be continuous.” Interviewee 50 (U+) continued that, “engagement is part of the consent, you know, a more modern, and better at that, consent process.”

Interviewees considered this kind of consent to be informed enough: they acknowledged that initial information might be incomplete yet sufficient to protect participant autonomy. Interviewee 14 (NP) felt that complete information about a study was not needed to achieve an adequate consent process: “the idea of knowing everything in order to be able to make an informed decision is a naive concept. We never know everything when we make a decision and that doesn't impede us in making autonomous decisions.” Interviewee 13 (U) said that study purpose, procedures, and risks and benefits could be communicated “in enough detail that people can make an informed decision about whether they are willing to agree to that.” Interviewee 38 (U+) described a reasonable compromise between feasibility and the need to inform. The consent process must “weigh the balances between protecting human subjects, but also the balance between making a consent form that's like 40 pages long that no one's going to sign or be a part of.” Interviewee 38 (U+) said, “I don't think there's anything wrong with a consent that…is probably more feasible and practical” than a comprehensive informed process. While these comments reflect a ubiquitous need to balance feasibility and information provision during consent, we note interviewees' consistent dismissal of the need to completely inform potential participants. What we here call an informed enough consent is, according to interviewee 38 (U+), “still protecting a human subject, rather than something that is so detailed or so far into the weeds.”

Despite overall endorsement of the informed enough approach, the most common concern expressed by interviewees was the risk of inadequately informing individuals during consent. Interviewee 21 (H+) agreed that “just conceptually it's hard for people to understand,” and as a result “our biggest hurdle is…feeling like our patients are truly consenting to the process.” Interviewee 54 (H+) called “the lack of specificity” in the consent a major source of “negative feedback.” Five interviewees said that inadequate information provided at the time of consent decreased participation rates. Each aspect of the broad consent requirement for sufficient information-exchange — study purpose, procedures, risks and benefits, plans for use of data, and information sharing — was mentioned as a potential source of inadequate comprehension.

For instance, regarding study purpose and procedures, interviewee 46 (H+) said that “people really don't know potentially what could be done with their data.” Interviewee 31 (H+) described that a consent for research on ‘health related’ topics is not well-understood by participants: “a lot of them…have [sic] very narrow understanding,” and may think that “health-related has to do with disease and not wellness, for example.” Interviewee 18 (U), noting that “it's one of the few things I am struggling with,” was worried that “the data can get sent out and studies that could be done on things that may not be compatible with someone's beliefs.” Interviewee 15 (NP) agreed that “I could see people not wanting the data to be used for a topic that they felt very strongly about.” Interviewee 13 (U) anticipated that if studies “are not in keeping with what people thought was going to happen, that that will be a major problem with trust in research and with people's willingness to continue.”

Interviewee 54 (H+) empathized with participants' wish for information: “I think they literally just want to know more specifics. They want more specificity of exactly, okay, well, you're taking six tubes of blood from me, what are you doing with six tubes of blood? What tests are you running?” Citing concerns that procedures were inadequately explained, interviewee 53 (U+) recommended “[r]ather than say, ‘Oh, we don't know what yet we can use your information for,’” the consent process should express “possible potential uses; list them all out and categorize them,” and afterward return to the participant to ask, “’Did I make myself clear?’”

II. Engagement as Protection Against Inadequate Information

Most interviewees identified participants' commitment to an ongoing relationship with the study as a key component of consent for health data repository research. As interviewee 27 (H+) explained, participants agree to “a long-term commitment, that people will … stay with the project.” In this sense, “consenting is not a one-time step, single piece of paper;” it is “an ongoing process.” Interviewee 27 continued that consent and engagement are synonymous: “whether you call it engagement, or you really understand the term consent … I don't think it makes a huge difference” because “consent should be an ongoing activity. It shouldn't be something you do once, and you're in.” While interviewees did not provide a consistent definition of engagement, the most common descriptions were of an enduring relationship in which communication deepened and developed over time.

Interviewees consistently described the purpose of engagement as mitigating limitations of information exchange at the time of enrollment. Interviewee 14 (NP) used the analogy of a marriage: individuals enter with incomplete information “but still feel like [they] made an informed decision … people can choose to participate in a research study that allows for broad reuse of their data and so long as in a healthy marriage, there is clear communication and engagement over time and the ability to check in and also to step out any time a person feels their needs are not being met then it's still ethically an okay arrangement.”

Interviewees' descriptions of engagement often included options to receive information that might shape participants' willingness to continue participation. For example, interviewee 50 (U+) said that, “the [health data repository] is going to be in contact with participants so that participants know what is going on in that [health data repository].” Within this engagement, “they have access to their own data. And they may decide at any time what they want, what their level of participation may be.” Follow up could remind the participant they can opt out: “You can revoke your authorization to be part of the program, you can change your mind, you can … opt out at any time.” Interviewee 36 (NP+) endorsed an approach in which participants can “have a voice about what we're studying or if they can initiate their own research.”

Re-consent:

For interviewees, options for re-consent presented ambiguous solutions to the informational deficiencies of consent for health data repositories. On the one hand, re-consent procedures might mitigate limitations in information exchange at the time of consent, strengthening participants' link to and trust in the project. On the other hand, re-consent procedures could undermine participants' commitment to a study by suggesting initial consent was insufficient. In this way, interviewees had mixed views of whether re-consent was a form of engagement or an impediment to it.

For example, a minority of interviewees were confident that no additional permissions for use of data would need to be gathered from participants. The eight interviewees who said that there would be no situations where additional consent would be necessary described re-consent as undermining participants' ongoing relationship with the study. For instance, one said that a requirement for re-consent “would mean that there's a huge barrier to doing research … with data from communities that are already underserved by biomedical research” (ID36; NP+); that “you've consented people under this broad framework”; and that any re-consent “changes the terms that you agreed to initially” (ID14; NP). Three interviewees said that a re-consent process could heighten participant anxiety. It may, interviewee 17 (PR) said, attenuate engagement because it is a form of “bothering them about consenting and re-consenting” and “makes them feel like somehow everyone else is trying to protect themselves from something.” Interviewee 16 (U) agreed that “it's going to prompt people to say, ‘wait, what are they doing with my medical records?’” By going back to participants, interviewee 32 (U+) said, “you really run the risk of having people not want to continue” to participate.

Yet 23 of 44 of interviewees felt that some additional process of consent should be a part of participant follow up. Nine interviewees said that further consent would be necessary if new types of data were to be collected or analyzed in the future, for instance for study procedures that are “more high risk” (ID38; U+), in which “a different type of procedure … carries more risk than a blood draw” (ID25; U+), or that use a “brand new technology” (ID18; U) or “an additional questionnaire” (ID39; C). Some of these nine interviewees suggested re-consent should be used as the data analytic plan becomes clearer even if no additional data is collected. For instance, interviewee 34 (PR+) mentioned circumstances that should trigger “some sort of re-consent” including “anytime there's a major programmatic change” or “halfway through at the five-year mark, just to remind people,” or, as interviewee 40 (PR+) described it, as a study “gets more in-depth and things change.”

Three other interviewees considered additional consent to be important when topics for study were identified. Interviewee 15 (NP) recommended “more specific consents down the road” when the study is “easier to understand.” For interviewee 15, additional consent would be needed because, “when there is a specific topic, I think participants should be allowed to have” more information. Interviewee 24 (U+) said any topic should require re-consent “if the scope is not included in what the participant consent,” and interviewee 53 (U+) assumed “that down the road” a health data repository should include “very specific…follow-up consent process[es]…when other studies that are very specific then take place.” Two interviewees mentioned that using data for profit should require additional consent, and two others mentioned the need for special procedures for Native American participants whose “samples [have] to be completely segregated from everyone else's so that they have greater control over what can be done with it” (ID30; U+) or for participants with brain injuries or reduced capacity to consent (ID47; H+).

Four other interviewees said consent would be important if the data were to be used to study sensitive topics. As interviewee 13 (U) said, “if…a researcher comes along in and wants to collect a very particular information [sic] on a topic that is -- could be considered sensitive…then I think that we either have to make the criteria for wavier or exemption or you know, get consent, hopefully simple. Hopefully simple consent.” Interviewee 43 (NP+) agreed that the question of “when to go back and ask people if they're okay with certain kinds of things” would be important as researchers “are getting information about what they want to study [and] say, ‘Oh, this is kind of a sketchy topic or maybe we need to go back and ask.’” Interviewee 43 (NP+) mentioned the difference between “making a good drug…for…an illness that I care about that I want to be solved” or a “lifesaving drug” versus “if it's for, like, Viagra” or something “more cosmetic” in which going back to the participant for re-consent may be important.

Interviewees who felt confident that re-consent was needed could not always name what should trigger it: as interviewee 22 (U+) said, “I don't have a good example in mind, but I just can foresee if something is more sensitive.” Others described re-consent as a form of engagement: a means of “asking people if they're okay” (ID43; NP+) with study procedures or a strategy “just to remind people” (ID34; PR+) of their participation in the study.

Discussion

In this paper, we draw on semi-structured interview data from a diverse group of 44 research stakeholders to examine the ways in which understandings of consent to a health data repository overlap and diverge from traditional consent principles. Interviewees described new challenges to the concept and practice of informed consent when there is limited certainty about the future purposes, procedures, and risks of a data repository at the time of participant enrollment. Interviewees indicated that building repositories for unspecified uses conflicts with the traditional view that the research participant be fully informed at the time of consent. Instead, interviewees understood health data repository consent not as informed but as engaged. Deemphasizing the importance of full information at the time of consent, they stressed the value of the ongoing relationship with the study as a mechanism for periodic information-sharing.

In this paper, we draw on semi-structured interview data from a diverse group of 44 research stakeholders to examine the ways in which understandings of consent to a health data repository overlap and diverge from traditional consent principles.

About half of our interviewees viewed some type of re-consent as an important means of mitigating limitations in information exchange at initial consent. The researcher stakeholders who endorsed a requirement for re-consent directly linked this endorsement to the inadequacy of information exchange at initial consent. As well, these research stakeholders suggested that re-consent provided one avenue by which participants could grow in their understanding of the repository's purposes, procedures, and risks and benefits. They described this deepening understanding as likely to increase commitment to the repository. At the same time, those who did not prefer re-consent expressed concerns it would undermine engagement with the study. Overall, research stakeholders saw engaged consent as an adequate means of mitigating informational gaps, gaps they felt should be closed as long as the participant's relationship with the study can be preserved. Research stakeholders had no shared notion of which informational gaps needed to be closed, what events should require re-consent, or what emergent information should be shared over time.

In these ways, our findings are consistent with the conclusions of Beskow and Weinfurt that nationally recognized experts disagree about the importance of comprehension in consent.35 Many in their study did not believe poor comprehension should bar enrollment. Our findings confirm that research experts are questioning “whether adequate comprehension should be viewed as an ethical requirement,”36 and that some view understanding as not essential to participation.Reference Kim, Miller, McKinney, Beskow, Ford, Kraft, Garrison, Wilfond, Solberg and Ursin37 Our interviewees seemed to suggest that rejecting understanding is “an ethical proposal whose time has come,” as Solomon Cargill says.Reference Cargill38

A few years ago, bioethicist Erik ParensReference Parens39 noted a concern that contemporary research norms are drifting away from the need to fully elicit and respect participants' specific preferences. Parens describes traditional informed consent practices as recognizing the wide diversity of viewpoints about the preferability of learning genetic information about oneself.Reference Lakes, Vaughan, Jones, Burke, Baker and Swanson40 Given this diversity, traditional informed consent procedures provide a means to “show respect to persons by asking them if they want access to a given piece of genetic information.”Reference Patil, Majumdar, Awan, De Souza and Greenspan41 That is, the traditional model of informed consent “was partly meant to ensure that individuals weren't coerced into decisions that someone else thought were in their — or the state's — best interest.”42 As evidence of a drift from this idea, Parens notes that proponents of genetic research justify their practices by citing population-based survey data indicating that most people are interested in their genetic information. “Drifting away from consent,” in his view, is a move that undercuts respect for the fact that “different people will reasonably want different sorts of information.”43 Our results provide an empirical suggestion that a similar drift away from informed consent can be seen in the concepts and practices emerging around health data repositories.

Yet our findings suggest that pronouncements of the collapse of the role for information exchange in consent are incomplete. Our interviewees appeared to agree with Appelbaum's view that ignorance is not bliss.Reference Appelbaum44 In different ways, most all of the expert research stakeholders we interviewed looked for means to improve and augment information exchange, including through engagement or re-consent. They emphasized a drift toward more thorough and long-term engagement with participants. They were reluctant to jettison traditional informed consent activities, such as approval for study purposes, procedures, and risks. While they did not agree on the events that should trigger re-consent, most preferred to retain the possibility that it would occur. They vested considerable responsibilities within the institution or infrastructure of the study to manage data responsibly. Most consistently, they stressed the importance of an ongoing relationship between participants and health data repository representatives, and indicated that informational shortcomings at the time of enrollment could be overcome through intentional engagement over time. These findings are consistent with calls for embedding the functions of consent in communication over timeReference Zawati and Knoppers45 and the recognition that “communication and decisions about research participation may not be contained within a discrete consent encounter.”Reference Dickert46

Importantly, Henderson et al.Reference Henderson, Edwards and Cadigan47 found in a survey of 456 U.S. biobanks that most employ robust strategies for managing specimens and decision-making about data use, a finding they saw as an indication of a developing “ethics of stewardship” among health data repositories. While these institutional responsibilities were rarely elaborated by our interviewees, they recognized the place of institutional reputation and infrastructure to the consent process. They suggested that responsible long-term data management can stand alongside consent as a mechanism for ensuring the protection of participants.Reference Jeffers, Laurie, Dove and Ganguli-Mitra48 And, both implicitly and explicitly, our interviewees identified the importance of strategies to build and maintain trust in the individuals and institutions managing the repository.Reference Kraft, Cho, Gillespie, Khodyakov, Mikesell, Bromley, Yarborough, Fryer-Edwards, Geller, Sharp, Moreno-John, Fleming and Ford49 Trustworthiness in physicians, researchers, health care systems, governments, and corporations involved in research has specifically been identified as important to enrollment in precision medicine initiatives.Reference Kraft, Cho, Gillespie, Burgess and O’Doherty50 Our interviewees described engagement as a strategy that could help to maintain and enhance trust by increasing transparency, confirming ongoing interest in participating, and attending to unique or historical challenges to trust (e.g., commercialization, controversial research topics, research misconduct experienced by some subpopulations). In these ways, fully informing participants about study purpose, procedures, and risks and benefits seemed important as a means of protecting participants, but interviewees could imagine new timelines and novel means of achieving these and related goals.

Nonetheless, our interviewees neither presented a clear definition of engagement nor delineated its component responsibilities. In addition, the plan for implementing engagement as a mechanism for mitigating limitations of information exchange at enrollment remained imprecise. In fact, Henderson et al.61 found that most biobanks do not create ongoing relationships with participants. Interviewees described several different and mutually-exclusive roles for engagement, including: (1) keeping participants advised of the option to opt out, providing access to their data, or otherwise giving them a voice in the study choices but not asking for further consent; (2) periodically updating them on what is being done with their specimens or providing them with some access to their own data; (3) re-consenting around new uses of data or around new specific topics, particularly those that may be sensitive; and (4) introducing additional consent procedures for vulnerable populations.

One final area of uncertainty can be noted. A traditional informed consent includes the obligation that the participant be fully informed prior to opting in, while interviewees described engaged consent as a means of re-affirming over time the participant's right to opt out. If fully embraced, this shift in emphasis from opt in to out out could alter the incentives for researchers, increasing the importance of participant retention and inviting investment in transparency, return of results, and information exchange during a study. Interviewees suggested frequently that an engaged approach should remind participants that they can opt out, but they seemed uncertain about which information should be provided simultaneous with this reminder. Taken as a whole, interviewees did not demonstrate consensus about best practices for long-term engagement with participants in a health data repository. Future research will need to clarify the necessary elements of engagement as well as the implications of using engaged consent as a means to mitigate limitations in information exchange at the time of consent to a health data repository.

Limitations

We note several limitations of our study. Our findings are limited by the non-representative sampling of the interviewees. While research stakeholders who participated reflect a diverse array of sectors and experiences, the findings cannot be said to generalize to the entire health data repository community. A second limitation is that our sample included many individuals familiar with the AoURP, an initiative that foregrounds the importance of engagement.

Conclusion

With the development of large-scale health data repositories, the research stakeholders we interviewed described a procedure for engaged rather than informed consent. Results indicate the need for further research on engagement as a means of improving participants' comprehension of a health data repository and of ensuring the affordance of appropriate protections from research risk.

Acknowledgements

This work was supported by the National Institutes of Health under Grant 1U24OD023176-01. results

Footnotes

The authors have no conflicts to disclose.

References

McGuire, A.L. and Beskow, L.M., “Informed Consent in Genomics and Genetic Research,” Annual Review of Genomics and Human Genetics 11, no. 1 (2010): 361381, at 362.CrossRefGoogle Scholar
45 CFR 46.116 (2018).CrossRefGoogle Scholar
Faden, R.R., Beauchamp, T.L., and Kass, N.E.. “Informed Consent, Comparative Effectiveness, and Learning Health Care,” New England Journal of Medicine 370, no. 8 (2014): 766768.CrossRefGoogle Scholar
All of Us Research Program, National Institutes of Health, Department of Health and Human Services, 2018; Sankar, P.L. and Parker, L.S., “The Precision Medicine Initiative's All of Us Research Program: An Agenda for Research on its Ethical, Legal, and Social Issues,” Genetics in Medicine 19, no. 7 (2017): 743.Google Scholar
See McGuire and Beskow, supra note 1, at 362.Google Scholar
Budin-Ljøsne, I., Teare, H.J., Kaye, J., et al. “Dynamic Consent: A Potential Solution to Some of the Challenges of Modern Biomedical Research.” BMC Medical Ethics 18, no. 1 (2017): 4; Burke, W., Beskow, L.M., Trinidad, S.B., Fullerton, S.M., and Brelsford, K., “Informed Consent in Translational Genomics: Insufficient Without Trustworthy Governance,” The Journal of Law, Medicine & Ethics 46, no. 1 (2018): 79–86; Sabatello, M. and Appelbaum, P.S., “The Precision Medicine Nation,” Hastings Center Report 47, no. 4 (2017): 19–29; Murphy, J., Scott, J., Kaufman, D., Geller, G., LeRoy, L., and Hudson, K.. “Public Perspectives on Informed Consent for Biobanking,” American Journal of Public Health 99, no. 12 (2009): 2128–2134; D'Abramo, F., “Biobank Research, Informed Consent and Society. Towards a New Alliance?” Journal of Epidemiolgical Community Health 69, no. 11(2015): 1125–1128; Sheehan, M., “Can Broad Consent be Informed Consent?” Public Health Ethics 4, no. 3 (2011): 226–235; Khodyakov, D., Mendoza-Graf, A., Berry, S., Nebecker, C., and Bromley, E.. “Return of Value in the New Era of Biomedical Research — One Size Will Not Fit All,” AJOB Empirical Bioethics 10, no. 4 (2019): 265–275.CrossRefGoogle Scholar
Beskow, L.M. and Weinfurt, K. P., “Exploring Understanding of ‘Understanding’: The Paradigm Case of Biobank Consent Comprehension,” The American Journal of Bioethics 19, no. 5 (2019): 618.CrossRefGoogle Scholar
Wieten, S., Blythe, J., and Magnus, D., “Informed Consent: A Matter of Aspiration Since 1966 (At Least),” The American Journal of Bioethics 19, no. 5 (2019): 35.CrossRefGoogle Scholar
Clayton, E.W., “The Unbearable Requirement of Informed Consent,” The American Journal of Bioethics 19, no. 5 (2019): 1920, at 19.CrossRefGoogle Scholar
Capron, A. M., “Where Did Informed Consent for Research Come From?” The Journal of Law, Medicine & Ethics 46, no. 1 (2018): 1229.CrossRefGoogle Scholar
National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research, The Belmont Report, (Department of Health, Education, and Welfare: 1979).Google Scholar
Sugarman, J. and Paasche-Orlow, M., “Confirming Comprehension of Informed Consent as a Protection of Human Subjects,” The Journal of General Internal Medicine 21, no. 8 (2006): 898899; Flory, J. and Emanuel, E., “Interventions to Improve Research Participants’ Understanding in Informed Consent for Research: A Systematic Review,” JAMA 292, no. 13 (2004): 1593–1601.CrossRefGoogle Scholar
Del Carmen, M. G. and Joffe, S., “Informed Consent for Medical Treatment and Research: A Review,” The Oncologist 10, no. 8 (2005): 636641; Goldberger, J.J., Kruse, J., Kadish, A., H., Passman, R., and Bergner, D.W., “Effect of Informed Consent Format on Patient Anxiety, Knowledge, and Satisfaction,” American Heart Journal 162, no. 4 (2011): 780–785, e781; Palmer, B.W., Cassidy, E., L., Dunn, L., B., Spira, A.P., and Sheikh, J.I., “Effective Use of Consent Forms and Interactive Questions in the Consent Process,” IRB: Ethics & Human Research 30, no. 2 (2008): 8–12.CrossRefGoogle Scholar
Patil, S., Majumdar, B., and Awan, K.H., et al., “Cancer Oriented Biobanks: A Comprehensive Review,” Oncology Reviews 12, no. 1 (2018); De Souza, Y.G. and Greenspan, J.S., “Biobanking Past, Present and Future: Responsibilities and Benefits,” AIDS 27, no. 3 (2013): 303–312.Google Scholar
Kaufman, D. J., Baker, R., Milner, L. C., Devaney, S., and Hudson, K. L., “A Survey of U.S Adults’ Opinions about Conduct of a Nationwide Precision Medicine Initiative Cohort Study of Genes and Environment,” PloS One 11, no. 8 (2016): e0160461.CrossRefGoogle Scholar
Lemke, A.A., Halverson, C., and Ross, L.F., “Biobank Participation and Returning Research Results: Perspectives from a Deliberative Engagement in South Side Chicago,” American Journal of Medical Genetics Part a 158A (2012): 1029-1037; Burke, W., Antommaria, A.H., and Bennett, R., et al. “Recommendations for Returning Genomic Incidental Findings? We Need to Talk!” Genetics in Medicine 15, no. 11 (2013): 854859; Sanderson, S.C., Brothers, K.B., and Mercaldo, N.D., et al., “Public Attitudes Toward Consent and Data Sharing in Bio-bank Research: A Large Multi-Site Experimental Survey in the US,” The American Journal of Human Genetics 100, no. 3 (2017): 414–427; Beskow, L.M., Dombeck, C.B., Thompson, C.P., Watson-Ormond, J.K., and Weinfurt, K.P., “Informed Consent for Biobanking: Consensus-Based Guidelines for Adequate Comprehension,” Genetics in Medicine 17, no. 3 (2015): 226.Google Scholar
45 CFR §§ 46, subparts A-D (2017).Google Scholar
Grady, C., Eckstein, L., and Berkman, B., et al., “Broad Consent for Research with Biological Samples: Workshop Conclusions, The American Journal of Bioethics 15, no. 9 (2015): 3442, at 35.CrossRefGoogle Scholar
Guidance on Broad Consent Under the Revised Common Rule, Attachment C - Recommendations for Broad Consent Guidance, Secretary's Advisory Committee on Human Research Protections, Department of Health and Human Services, July 26, 2017, np.Google Scholar
Guidance on Broad Consent Under the Revised Common Rule, Attachment D - Recommendations for a Broad Consent Template, Secretary's Advisory Committee on Human Research Protections, Department of Health and Human Services, July 26, 2017, np.Google Scholar
Nanibaa'A, G., Sathe, N.A., and Antommaria, A.H.M., et al., “A Systematic Literature Review of Individuals' Perspectives on Broad Consent and Data Sharing in the United States,” Genetics in Medicine 18, no. 7 (2016): 663; Garrett, S.B., Dohan, D., and Koenig, B.A., “Linking Broad Consent to Biobank Governance: Support From a Deliberative Public Engagement in California,” The American Journal of Bioethics 15, no. 9 (2015): 56–57.Google Scholar
Bunnik, E.M., Janssens, A.C.J.W., and Schermer, M.H.N., “A Tiered-Layered-Staged Model for Informed Consent in Personal Genome Testing,” European Journal of Human Genetics 21, no. 6 (2013): 596601.CrossRefGoogle Scholar
Lentz, J., Kennett, M., Perlmutter, J., and Forrest, A., “Paving the Way to a More Effective Informed Consent Process: Recommendations from the Clinical Trials Transformation Initiative,” Contemporary Clinical Trials 49 (2016): 6569.CrossRefGoogle Scholar
Kaye, J., Whitley, E.A., Lund, D., Morrison, M., Teare, H., and Melham, K., “Dynamic Consent: A Patient Interface for Twenty-First Century Research Networks,” European Journal of Human Genetics 23, no. 2 (2015): 141146; Wee, R., Henaghan, M., and Winship, I., “Ethics: Dynamic Consent in the Digital Age of Biology: Online Initiatives and Regulatory Considerations,” Journal of Primary Health Care 5, no. 4 (2013): 341–347.CrossRefGoogle Scholar
See McGuire and Beskow, supra note 1.Google Scholar
Wendler, D., Broad versus Blanket Consent for Research with Human Biological Samples,” Hastings Center Report 43, no. 5 (2013): 34.CrossRefGoogle Scholar
Caulfield, T., “Biobanks and Blanket Consent: The Proper Place of the Public Good and Public Perception Rationales,” King's Law Journal 18, no. 2 (2007): 209226.CrossRefGoogle Scholar
Greely, H.T., “The Uneasy Ethical and Legal Underpinnings of Large-Scale Genomic Biobanks,” Annual Review of Genomics and Human Genetics 8 (2007): 343364.CrossRefGoogle Scholar
See supra note 19, np.Google Scholar
Klima, J., Fitzgerald-Butt, S.M., and Kelleher, K.J., et al., “Understanding of Informed Consent by Parents of Children Enrolled in a Genetic Biobank,” Genetics in Medicine 16 (2014): 141148; Barr, M. “‘I’m not Really Read up on Genetics’: Biobanks and the Social Context of Informed Consent,” Biosocieties 1, no. 2 (2006): 251–262; McCarty, C.A., Nair, A., Austin, D.M., and Giampietro, P.F., “Informed Consent and Subject Motivation to Participate in a Large, Population-Based Genomics Study: The Marshfield Clinic Personalized Medicine Research Project,” Community Genetics 10 (2007): 2–9; Ormond, K.E., Cirino, A.L., Helenowski, I.B., Chisholm, R.L., and Wolf, W.A., “Assessing the Understanding of Biobank Participants,” American Journal of Medical Genetics 149A (2009): 188-198.CrossRefGoogle Scholar
Dickert, N.W., Fehr, A.E., Llanos, A., Scicluna, V.M., and Samady, H., “Patients’ Views of Consent for Research Enrollment During Acute Myocardial Infarction,” Acute Cardiac Care 17, no. 1 (2015): 14; Mandava, A., Pace, C., Campbell, B., Emanuel, E., and Grady, C., “The Quality of Informed Consent: Mapping the Landscape, A Review of Empirical Data from Developing and Developed Countries,” Journal of Medical Ethics 38, no. 6 (2012): 356–365.CrossRefGoogle Scholar
Dickert, N.W., Eyal, N., and Goldkind, S.F., et al, “Reframing Consent for Clinical Research: A Function-Based Approach,” The American Journal of Bioethics 17, no. 12 (2017): 311, at 4.CrossRefGoogle Scholar
Brudney, D., “Choosing for Another: Beyond Autonomy and Best Interests,” Hastings Center Report 39, no. 2 (2009): 3137.CrossRefGoogle Scholar
See Faden et al., supra note 3.Google Scholar
See Beskow and Weinfurt, supra note 7.Google Scholar
See Beskow and Weinfurt, supra note 7, at 16.Google Scholar
Kim, S.Y. and Miller, F.G., “Waivers and Alterations to Consent in Pragmatic Clinical Trials: Respecting the P:rinciple of Respect for Persons,” IRB: Ethics and Human Research 38, no. 1 (2016): 15; McKinney, R.E. Jr., Beskow, L.M., and Ford, D.E., et al., “Use of Altered Informed Consent in Pragmatic Clinical Research,” Clinical Trials 12, no. 5 (2015): 494-502; Kraft, S.A., Garrison, N.A., and Wilfond, B.S., “Understanding as an Ethical Aspiration in an Era of Digital Technology-Based Communication: An Analysis of Informed Consent Functions,” The American Journal of Bioethics 19, no. 5 (2019): 34–36; Solberg, B. and Ursin, L., “Being Polite: Why Biobank Consent Comprehension Is Neither a Requirement nor an Aspiration,” The American Journal of Bioethics 19, no. 5 (2019): 31–33.Google Scholar
Cargill, S. Solomon, “Rejecting ‘Understanding’: An Ethical Proposal Whose Time Has Come,” The American Journal of Bioethics 19, no. 5 (2019): 4142, at 41.CrossRefGoogle Scholar
Parens, E., “Drifting Away from Informed Consent in the Era of Personalized Medicine,” Hastings Center Report 45, no. 4 (2015): 1620.CrossRefGoogle Scholar
Lakes, K.D., Vaughan, E., Jones, M., Burke, W., Baker, D., and Swanson, J.M., “Diverse Perceptions of the Informed Consent Process: Implications for the Recruitment and Participation of Diverse Communities in the National Children's Study,” American Journal of Community Psychology 49, no. 1-2 (2012): 215232.CrossRefGoogle Scholar
See Parens, supra note 39, at 17.Google Scholar
See Parens, supra note 39, at 17.Google Scholar
See Parens, supra note 39, at 19.Google Scholar
Appelbaum, P.S., “Ignorance Isn't Bliss: Retaining a Meaningful Comprehension Requirement for Consent to Research,” The American Journal of Bioethics 19, no. 5 (2019): 2224.CrossRefGoogle Scholar
Zawati, M. and Knoppers, B.M., “Reciprocity and the Quest for Meaningful Disclosure,” The American Journal of Bioethics 19, no. 5 (2019): 3638.CrossRefGoogle Scholar
Dickert, N.W., “The Value of Consent for Clinical Research Does Not Always Hinge on Understanding,” The American Journal of Bioethics 19, no. 5 (2019): 2022, at 21.CrossRefGoogle Scholar
Henderson, G.E., Edwards, T.P., and Cadigan, R.J., et al., “Stew-ardship Practices of U.S. Biobanks,” Science Translational Medicine 5 (2013): np.CrossRefGoogle Scholar
Jeffers, B.R., “Human Biological Materials in Research: Ethical Issues and the Role of Stewardship in Minimizing Research Risks,” Advances in Nursing Science 24, no. 3 (2001): 3246; Laurie, G.T., Dove, E.S., and Ganguli-Mitra, A., et al., “Charting Regulatory Stewardship in Health Research: Making the Invisible Visible,” Cambridge Quarterly of Healthcare Ethics 27, no. 2 (2018): np.CrossRefGoogle Scholar
Kraft, S.A., Cho, M.K., and Gillespie, K., et al., “Beyond Consent: Building Trusting Relationships with Diverse Populations in Precision Medicine Research,” The American Journal of Bioethics 18, no. 4 (2018): 320; Khodyakov, D., Mikesell, L., and Bromley, E., “Trust and the Ethical Conduct of Community-Engaged Research,” European Journal of Person-Centered Healthcare 5, no. 4 (2017): 522–526; Yarborough, M., Fryer-Edwards, K., Geller, G., and Sharp, R., “Transforming the Culture of Biomedical Research from Compliance to Trustworthiness: Insights from Non-Medical Sectors,” Academic Medicine 48 (2009): 472-477; Moreno-John, G., Fleming, C., and Ford, M.E., et al., “Mentoring in Community-Based Participatory Research: The RCMAR Experience,” Ethnicity & Disease 17, no. 1 (2007): 33–43.CrossRefGoogle Scholar
Kraft, S.A., Cho, M.K., and Gillespie, K., et al., “Beyond Consent: Building Trusting Relationships with Diverse Populations in Precision Medicine Research,” The American Journal of Bioethics 18, no. 4 (2018): 320; Burgess, M.M. and O’Doherty, K.C., “Moving From Understanding of Consent Conditions to Heuristics of Trust,” The American Journal of Bioethics 19, no. 5 (2019): 24–26.Google Scholar
Figure 0

Table 1. Interviewees' Place of Employment

Figure 1

Table 2. Sample Characteristics