JHHRJournal of Human Health Research2576-9383Open Access PubUnited StatesJHHR-22-413810.14302/issn.2576-9383.jhhr-22-4138commentariesScientific Ethical Integrity and Human Research Subjects Protections Non-compliance Remediation: Commentary on Practical Considerations and Implicationsremediation for human research subjects protections non-compliance: practical considerations and implicationsRalphJ Johnson12*Research PA-C/Research Coordinator, University of Texas MD Anderson Cancer CenterChaplain, Texas Medical Center Catholic Chaplaincy Corp.Corresponding authorRaulIsea1Fundación Instituto de Estudios Avanzados -IDEA
Ralph Jay Johnson, Ph.D., PA-C, M.A.H.S., M.AT. Dept. of Lymphoma/Myeloma, UT-MDACC, Unit 42, 1515 Holcombe Blvd. Houston, TX, 77030. U.S.A. 832-372-3511jayjohnson131313@gmail.com
The authors have declared that no competing interests exist.
Medical science’s advancements depend on preserving its credibility and the public trust, though as a human institution it is fallible and liable to ethical breaches that can void public confidence and support. There is no more egregious ethical departure than deviations / violations of Human Research Subjects Protections (i.e., non-compliance), which is remarkable given they are fairly widespread and often repeated. Once uncovered, this generally should result in the research’s suspension or termination. Yet, there is a third option to preserve valuable and worthy research that went awry due to lapses in Human Research Subjects Protections, specifically, Remediation. Due to the sequestered nature of Remediation, little has been reported on its processes, and practically nothing, regarding practical considerations, recommendations, and implications for the remediation workers themselves—for this line of work is perilously risky. This commentary reports some of those best-practices, “first-hand grittier in-the-trenches” informed practical lessons learned. Implications are discussed in the interest of improving the reasonable, balanced, and competent ethical conduct of research, addressing / avoiding Human Subjects Protections ethical non-compliance, and avenues for further inquiry regarding Remediation.
Introduction
Medical science is a vital and principal institution due to its promises of a far-reaching and alluring compendium of advancements through which there is greater predictability, control, and improvement in the human condition.123 Nevertheless, it is a human institution—fallible, and prone to ethical breaches, misconduct and breaks from scientific integrity.34567 Thus, preservation of the scientific enterprise’s credibility and the public trust vested in it is predicated on ensuring sound scientific integrity. In the post-modern era, with rapid dissemination of information and increased democratic processes, the risk of accusations of breaks in scientific integrity is magnified greatly.910 The loss of public confidence in medical scientific research institutions may corrosively erode public support for medical scientists and their research programs everywhere.391112 Concern should be paramount and ubiquitous for preserving scientific integrity and to achieve reclamation, if possible, where there have been ethical breaches in otherwise valuable and meaningful research. 313141516
Probably there is no more egregious ethical breach of scientific integrity in medical research than deviations or violations (i.e., non-compliance) of Human Research Subjects Protections, especially anything abrogating adequate informed consent to participate in research (e.g., no consent obtained, wrong consent, language not translated, improperly completed consent, consent P&P not followed, consent undocumented, etc.).17181920 The integrity of Human Research Subjects Protections is commonly considered inviolable and sacrosanct.20 Unfortunately, violations are fairly common, even though there are a plethora of formally established safeguards, policies, procedures, regulations and agencies and agents, as well as punitive sanctions for such violations.2122232425 A large proportion of scientific research wrongdoing (approximately 50%) falls under the rubric of Human Research Subjects Protections non-compliance, with nearly 100% attributable to “Failure to Follow Procedures.”19 Conservatively, there are estimates over a two-year period of about 1,200 - 2,150 cases in the U.S. per year alone. No one can be exactly sure, because they are sensitive cases and therefore kept secret.2227 Furthermore, most of the known offenders tend to be repeat offenders, even with multiple layers of prevention for recidivists. 2628
Background
Typically, after an audit finds substantial, continued, and patterned deviations, violations, and abuses, an Institutional Review Board (IRB) assigns a level of non-compliance; based on this level, there are two formal absolute options: suspension or termination.29303132 However, there is a 3rd informal option of Remediation, depending on whether the research is valuable, worthy, and can be redeemed through restitution and reclamation, restoration of trust, significant risk management, remorse and contrition, and establishing preventive plans of actions to avoid recidivism.2233343536 Remediation offers scientific research institutions and agencies opportunities for reclaiming and salvaging otherwise worthwhile research studies that went astray due Human Research Subjects Protections non-compliance.16223536
Human Research Subjects Protections Deviation / Violation remediation projects may be widespread and fairly common—so much so that IRBs employ a common acronym: “HRSPD/V-CAPA” or “CAPA” for short (i.e., Corrective And Preventive Action plan) to describe them.3738cf.39 Yet, little has been written and virtually no formal research has been done on how they are conducted, much less the practical implications for those burdened with conducting them.223940 Note: there are probably about as many Human Research Subjects Protections-related CAPAs as there are scientific research-intensive institutions.4142 But any formal reports are usually vague summaries void of practical detail and limited to the extent IRBs require public dissemination and demonstrations of open contrition and penitence.3031 This is probably the consequence of their embarrassing and sensitive nature, so that only direct participants are truly privy to them.17181920 Thus, the world of Human Research Subjects Protections non-compliance remediation is one that is a “known secret”—but dark, murky, nebulous and rarely discussed in public venues unless mandated, and then only to the extent mandated.22
Purpose
A substantial number of Human Research Subjects Protections CAPAs also are a testament to the notion that valuable scientific research studies can and do make related mistakes, but these can be redeemed through remediation. 31314151622 Yet, formal empirical studies on Human Research Subjects Protections violation remediation would be an admission that an egregious, non-condoned, profane violation occurred of something considered sanctified. “It is not supposed to happen, but it does, and how it is done and what does that mean for the one(s) who have to do it has been as-of-yet unspoken.”4344 Nevertheless, given that these affairs and their repair are apparently widespread, and to fill the gap regarding this vital information, the purpose of this article is to provide some informed conceptual yet practical lessons learned on involvement with Human Research Subjects Protections non-compliance remediation projects—particularly from the perspective and best interests of those directly involved with them. The points derive from the author’s first-hand experience with repairing, reclaiming, and resurrecting multiple errant research studies that were temporarily suspended due to Human Research Subjects Protections deviations and violations at multiple research-intensive institutions. Though the perspective is that of an outsider or distanced party brought-in and specifically tasked with fixing up, cleaning up and restoring a study or studies to ethical health, the advice, guidance, and recommendations are just as relevant to insiders involved with Human Research Subjects Protections Violation remediation.
Commentary
First, Human Research Subjects Protections Violation remediation projects can be extremely expensive and labor-intensive, as they probably will involve painstakingly re-conducting work that was done wrong or not at all for substantial numbers of human research subjects (e.g., hundreds, if not in the thousands).45 “Remediation is a third option, but it is no free pass.”22 Also, remediation projects tend to be painful, ugly, and even dreadful affairs in that they involve an admission of extreme wrongdoing regarding a subject that should be sacrosanct— the defilement of which definitely is in the realm of professional discretization. So finger-pointing, “backbiting,” and recriminations are not unusual—not to mention concerns about that ‘the competitors in a highly competitive field might take the information and run with it should it leak out and become public.’ The best possible course of action to counter all this is quickly: ‘To get it out, you get it out, and you take control.’46 Taking control involves transitioning quickly to acceptance of what happened, an accurate and visual needs assessment of the extent of wrongdoing, and the fast development of a course of action to correct it—and then implementing the plan as quickly and with as little fanfare as possible.2246 Also, it is better to propose a workable resolution developed from accurate data to the IRB and/or other regulatory agencies rather than have them propose an uniform one that is unworkable. Doing so also demonstrates control, competence, and subject-matter expertise regarding the situation, which can work wonders to restore trust and credibility.
Second, cleaning up and fixing up a mess often involves getting one’s hands dirty. Specifically, there may be “guilt by association.”47 That is, the person or persons charged with remediation may become errantly typecast in the public eye—somewhere between ultimately responsible for the mess in the first place, or associated with hard feelings surrounding the project itself (or both). Often, when Human Research Subjects Protections non-compliance is revealed—and especially where there was a substantial, longstanding pattern of behavior—the culprits responsible may attempt to run away, hide, and feign ignorance. Specifically, they turn tail and run knowing the true extent of the mess they created when faced with the unappealing and laborious prospect of cleaning-and-fixing-up a big mess with repercussions that may taint their reputations and careers. Moreover, anyone tasked with a remediation project should be cognizant that those involved in the non-compliance may use the self-serving and treacherous yet clever ruse of implying those involved in the remediation effort must have caused the non-compliance in the first place—or else they would not be involved in the remediation. This is not to mention that those privy to what resulted in the misconduct probably will be unavailable to those cleaning-up the resulting mess, so the Remediation Team will not have the benefit of their insight and knowledge to inform reclamation efforts.
Again, these situations have the potential to become rife with finger-pointing and blame-laying, especially at the innocent feet of the remediation workers. A viable recommended strategy for the remediation crew to counter the implications of “guilt by association” is to emphatically and publicly insist they were not the parties causing the original non-compliance with Human Research Subjects Protections; they are charged with helping to formulate and implement a viable solution. Vigorous support from research institutions’ regulators and administrators of these public relations efforts should be obtained in advance of a remediation assignment.
Third, given the seriousness of allegations by the IRB or regulatory agencies, it is always a good idea to conduct a parallel internal investigation of the breadth and depth of external probes and findings (i.e., a needs assessment).22 In other words, auditor / regulator reports should not be relied on exclusively. Typically, they only represent a sampling of detectable, significant Human Research Subjects Protections non-compliance, which might merely scratch the surface and fail to delve extensively into the problems.2232373843 Naturally, once detected in substantial and patterned amounts, formulations of systematic remediation plans should be predicated on a comprehensive needs assessment survey.22 This survey should be conducted to visually depict any patterns and connections and to keep all parties focused and honest. This survey should be reported to the IRB.22 This will facilitate a more hands-on, practical apprehension of what happened, how it happened, and how it can be fixed and improved or prevented going forward.394648 Also, it will help prevent the remediation team from cutting corners in the interest of expediency.
Most likely, one reason significant problems occurred in the first place was that no routine internal audit mechanism was established—or, if there was one, it was not comprehensive or involved enough. An internal needs assessment is the opportunity to establish a routine audit mechanism. A comprehensive survey entails a replete inventory and description of particular types and amounts of non-compliance. These are the “what happened” factors related to the unmet Human Research Subjects Protections regulatory standards; these types of problems can be ranked in terms of amounts and severity and the aggravating circumstances of whether they were unintentional or willful.22 Addressing each issue then can become a collaboration between the IRB, regulatory agencies and study investigators. Doing so comprehensively and systematically can be a great confidence restorer by showing that the remediation workers are ethically “true to their word.”
Fourth, remediation workers should be keenly aware that they are involved in the airing and cleaning of dirty laundry. In an industry that emphasizes image and professional reputation and prides itself on adherence and compliance with best-practices standards, there may be fears that the workers might talk.740 Remediation projects necessarily have deadlines for completion imposed by IRBs. When the work is over, there is an intrinsic risk—rather than gratitude for the Herculean tasks and egregious conditions under which they were accomplished—that the remediation workers may be disposed of over contrived reasons, much like sweeping yesterday’s dirt under the rug with prejudice.49 Any protests they register will be met with counter-protests of “sour grapes.”49 Likewise, public awards and tokens of appreciation for their hard work and a job well done will probably not be forthcoming, because this would be a formal acknowledgement that something sordid and scandalous occurred, which would rather be buried and forgotten.49 Also, study administrators and investigators may want to be rid of constant haunting reminders of past transgressions. The remediation work may just be over with anyway.49 One way to allay these fears would be for remediation workers to sign self-imposed non-disclosure agreements to secure their employment and ensure their discretion.
In sum, the interest of furthering the discourse on scientific integrity, this article attempted to provide some practical cautionary considerations and recommendations regarding involvement in Human Research Subjects Protections Violation remediation and reclamation projects for those “in the trenches.” In terms of the consequences of considerations and aspects of Human Research Subjects Protections Violation remediation, this article proposes a practical, gritty real-world in-the-trenches depiction of scientific research ethics that can be synthesized and summarized as the following: “In the end, doing the right thing because it is the right thing to do will probably hurt,” or, “No good deed has ever gone unpunished.” But one still does the right thing anyway so as to look oneself in the mirror in the morning.
Rather than just a guidebook for side-stepping potential landmines, this article also tacitly highlighted that the pristine, ideal environment in which Human Subjects Protections are expected to be kept, the substantial efforts, personnel and resources expended to do so, and the absolutist sanctions for failing to do so, have seemingly established a Zero-Defect culture around an enterprise in which human error is the norm rather than the exception.2650 A Zero-Defect culture51 dictates that such standards are so sacrosanct and inviolable that the research intensive institution and its personnel could not possibly engage in their violation or even deviation—whether this is actually true or not. A Zero-Defect culture, which is commonly considered ineffective, exists where the administration is intolerant of any errors, deviations or violations; it may choose to ignore evidence of any kind. As such, workers are not held accountable or empowered by failures and become complacent and unmotivated.51 As such, in this culture workers who identify and report and fix mistakes (i.e., “stop-the-line”) tend to be held in contempt and public opprobrium, even if they were not the source of the mistakes.49
This can be synergistically compounded by a scientific research culture of Paternalism.50516162636465666768697071 Specifically, this is where renowned and funded medical researchers maintain a notion that they hold high authority due to their subject matter expertise in a particularly complicated and technical discipline; this tempts them to involuntarily or volitionally conduct research for their own interests and/or the greater good of science rather than in their patients’ interests—because their patients “could never understand.” The two cultures together and unchecked can synergistically result in a perfect storm that spawns substantial hidden Human Research Subject non-compliance, until some unexpected event causes them to surface.4926
This destructive pattern can be countered by a commitment to a: (1) Participatory Study approach to engaging patients where they are treated less as research subjects and more as participants in a collaborative effort 5253545526; and (2) a Culture of Safety that acknowledges, though mistakes and errors should be avoided, that mistakes and errors do happen as we are all human.565758 Both (1) and (2) together mean that (1) actively engaged Study Participants have much to teach researchers and (2) admission and study of ethical mistakes can be learning experiences from which to enhance adherence to policy and procedures and foster innovation from lessons learned. This combined approach has the additional benefit of workers and administrators taking responsibility and accountability for their actions, thus anyone can “stop-the-line,” if they realize things have gone awry.
Conclusion
At heart this article is a stark admission that there is an unavoidable professional commitment to ensure that scientific research is conducted both ethically and competently; but failing that, remediation cannot entirely fix and make it like new again. Remediation can resurrect studies but cannot turn back the clock as if any wrongdoing or errors never happened. Nevertheless, remediation may be the one saving grace to reclaim valuable and important research despite Human Research Subjects Protections non-compliance. To fill a gap in the scientific integrity and ethics literature regarding information about the personal risks and hazards of those in the “remediation trenches,” this article provided pointers with practical implications along with recommendations of best practices.
At minimum, this article acknowledges a known problem that has been kept in the shadows due to its sensitive, controversial, and taboo nature. At best, this article serves as the impetus for more definitive and perhaps empirical works and discourses on the subject matter. Then the hushed whispers and disquietude surrounding a heretofore forbidden and censured subject will be brought to light and transformed into acceptable and credible peer-reviewed scientific articles. After all, prevention is far less costly than cure, and the focus should be on preventing scientific misconduct and ethical breaches, especially Human Subjects Protections non-compliance, rather than fixing and cleaning up the damage afterward. Yet, without a common body of knowledge about Human Subjects Protection Violations / Deviations and their corrective remediation, this less costly prevention is improbable.
DeclarationsEthical Approval and Consent to Participate
Non-applicable, this was a commentary supported by a review of supporting open-source documents and analyses of anonymous publically available data.
Consent for Publication
Yes.
Availability of Data and Materials
Yes, publications and sources are available on-line or provided by author upon request.
Funding
This project was supported by in-kind support from the University of Texas MD Anderson Cancer Center, Dept. of Myeloma-Lymphoma, which the author gratefully acknowledges.
Authors’ Contribution
Non-applicable, there is one sole Author.
The Author wishes to gratefully acknowledge in-kind support of the Department of Lymphoma and Myeloma, UT-MD Anderson Cancer Center, Houston, TX. in the preparation of this manuscript. Also, the author thanks Mr. Jasper Olsem for his encouragement in pursuing the subject matter. The author also expresses appreciation for Michael P. Ramos for proof of concept, and Ms. Aileen “Acey” Cho freelance-copy editor for proofing and copyediting drafts. The opinions expressed are solely those of the Author. Reprints and correspondence should be addressed to the author at ralph.johnson@txsg.state.tx.us, rjjohnson@mdanderson.org, or, jayjohnson131313@gmail.com UT-MDACC, Dept. of Lymphoma-Myeloma, Unit 429, 1515 Holcombe, Houston, Texas, 77030-400, U.S.A.. (832-750-1446; 832-372-3511)
WeisbergD FScience in the Service of Patients: Lessons from the Past in the Moral Battle for the Future of Medical Education20148717989StamanJDijstelbloemHSmitsMAfterword inReshaping the Human Condition: Exploring Human Enhancement(eds.) Leo Zonneveld2008Huub Dijstelbloem & Danielle Ringoir Rathenau Institute, The Hague 2008: 149 –160KoepsellDScientific Integrity and Research Ethics: An Approach from the Ethos of Science: Springer Briefs in Ethics2015150Springer Nature: InternationalCham, Switzerland:Academy of Sciences, and National Academy of Engineering. (1995)On Being a Scientist: Responsible Conductin Research, Second Edition. Washington, DC: The National Academies Press. https://doi.org/10.17226/4917:1516Institute of Medicine, NationalHonigBLampelJBaumJ AGlynnM AReflections on Scientific Misconduct in Management: unfortunate incidents or a normative crisis?Academy of Management Perspectives32,(4).https://doi.org/10.5465/amp.2015.0167CLSVeldkampCHJHartgerinkvanAssen MALMWichertsJ M2017Who believes in the Storybook image of the scientist?Account Res:24312715110.1080/08989621.2016.126892228001440National Academies of Sciences, Engineering, and Medicine; Policy and Global Affairs; Committee on Science, Engineering, Medicine, and Public Policy; Committee on Responsible Science. Foundations of integrity in research: Core values and guiding norms inFostering Integrity in Research: ashington (DC): National Academies Press (US);2017THEWHITE HOUSEMemorandum on Restoring Trust in Government Through Scientific Integrity and Evidence-Based Policymaking.Executive Order: Jan 27;2021Washington, D.Cthe Bipartisan Policy Center’s Science for Policy Project. (2009).Improving the Use of Science in Regulatory Policy: Final Report. Science for PolicyProject: Aug 5: 41-45 and 4951Members ofFunkCfindings about Americans’ confidence in science and their views on scientists’ role in society.Pew Research Center: Feb 12:2020Washington, D.CAndersonJRainieL(2017)The Future of Truth and Misinformation Online. . Pew ResearchCenter: Washington, D.CNationalResearch Counciland Institute of Medicine (US) Committee on Assessing Integrity in Research Environments. (2002)Integrity in Researchin Integrity in Scientific Research: Creating an Environment That Promotes Responsible Conduct. Washington (DC):National Academies Press (US)LenzerJHoffmanJ RFurbergC DIoannidisJ PGuideline Panel Review Working Group. Ensuring the integrity of clinical practice guidelines: a tool for protecting patients.BMJ.347:201355351010.1136/bmj.f5535AntesA LMaggiJr LBHow to conduct responsible research: A guide for graduate students.CurrProtoc:2021Mar;1(3):e87. doi: 10.1002/cpz1.87. PMID: 33740292 PMCID: PMC827748110.1002/cpz1.8733740292AngelosPMurphyT FSampsonHHollingsD DInformed consent, capitation, and conflicts of interest in clinical trials: views from the field20061405740810.1016/j.surg.2006.06.02717084716https://linkinghub.elsevier.com/retrieve/pii/S0039-6060(06)00473-9KoepsellD2015Scientific Integrity and Research Ethics:7383DuBoisJ MAndersonE EChibnallJ TDiakovLPreventing Egregious Ethical Violations in Medical Practice: Evidence-Informed Recommendations from a Multidisciplinary Working Group20181044233110.30770/2572-1852-104.4.23DuBoisJ MAndersonEmily EChibnallJ TMozerskyJSerious Ethical Violations in Medicine: A Statistical and Ethical Analysis of 280 Cases in the United States from 2008-2016.Am JBioeth20191911634BACMorenoArteagaGMII GViolation of ethical principles in clinical research. Influences and possible solutions for Latin America.BMC Med Ethics20121335WhiteMGWhy Human Subjects Research Protection Is Important.Ochsner20202011633JohnsonR JRemediation for Human Research Subjects Protections Non-Compliance:201563110ChubinD E19853528089DingellJ DShattuck Lecture--misconduct in medical research.NEnglJ Med:19933282216105BurkeD LResearch misconduct: deviance, due process, and the disestablishment of science.GM19953305315DuboisJ MCarrollKGibbTKrausEEnvironmental Factors Contributing to Wrongdoing in Medicine:2012Epub22316318810.1080/10508422.2011.641832MarshallEScientific misconduct. How prevalent is fraud? That's a million-dollar question.Science:200029054971662310.1126/science.290.5497.166211186377FanelliDHow many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data.PLoSOne;2009455738GrantDAlfredK CSanctions and recidivism: an evaluation of physician discipline by state medical boards.J Health Polit Policy Law200732586785BankertEAmdurR JInstitutional Review Board: Management and Function: Management and Function 2nd Edition: Jones and Bartlett Publishers; Sudsbury20108513MA:Ethics and compliance plan. Report to the Compliance and Audit Committee of the Board of Regents2009University of CaliforniaBhattAProtocol deviation and violation.PerspectClin Res201233117CDCHuman Subjects Research Protection. Policy Science Administration2010CDC-SA.https://www.cdc.gov/os/integrity/docs/cdc-policy-human-research-protections.pdfBorysovAntoniuk OIPashchenkoO OPeculiarities of legal responsibility for offenses in the field of clinical trials of medicines.WiadLek:202073122833283933611290https://pubmed.ncbi.nlm.nih.gov/33611290/AntkowiakT MColumJTransnat'lLRemedial approaches to human rights violations: The Inter-American Court of human rights and beyond.J.Transnat'lL2007CohenGAdashiE Y2012In the Wake of Guatemala: The Case for Voluntary Compensation and Remediation.AJPH: 10246PereiraPQuality in clinical research activities: Role of institution/clinical trial site1January-JuneBramstedtK AA study of warning letters issued to clinical investigators by the United States Food and Drug Administration.Clin Invest Med:200427312934MehraMKurpanekKPetrizzoMBrennerSThe life cycle and management of protocol deviations.TherInn20144876277730BenoitW LImage repair discourse and crisis communication.Public Relations ReviewVolume 23, Issue 2, Summer1997177186RobitailleD E(2011)The Corrective Action HandbookPaton Professional Press;Chico, CAMassettH AMishkinGRubinsteinLIvyS P(2016)Challenges facing Early Phase Trials sponsored by the National Cancer Institute: An analysis ofCorrective Action Plans to improve accrual.5408-5416ManueleF AIncident investigation: Our methods are flawed.Prof201459103443HeYYuanCChenLLiuYWhile it is not deliberate, much of today's biomedical research contains logical and technical flaws, showing a need for corrective action.Int J Med Sci2018154309322RettigR AThe industrialization of clinical research.HEALTH2000
AFFAIRS: https://doi.org/10.1377/hlthaff.19.2.129
RaddiDDeverinitiR SGanachariG SA retrospective study: root cause analysis of reported serious adverse event and development of corrective action and preventive action for deviated serious adverse event reports at a clinical trial site management office.Int202073194199DOI:HussingerabKPellensMGuilt by association: How scientific misconduct harms prior collaborators2019482516530RoachJ DQuality Oversight in nursing research (Ch 6) inBuilding and Sustaining a Hospital-Based Nursing ResearchProgram:2016123150Springer Publishing; NYMietheT DIndividual and organizational consequences of whistleblowing inWhistleblowing at Work: Tough Choices1999in Exposing Fraud, Waste, and Abuse on the Job5375Routledge: NY, NY
eBook ISBN 9780429267512https://doi.org/10.4324/9780429267512
SteeleJ PAntecedents and Consequences of Toxic Leadership in the U. S. Army: A Two Year Review and Recommended Solutions2011
Technical rept.https://apps.dtic.mil/sti/citations/ADA545383
DemingW ETransformation of Western Style of Management19851146MillerF GWertheimerAFacing up to paternalism in research ethics.The Hastings Center Report:20073732434ReillyR CParticipatory case study2010658660
In: Mills, Albert J. and Durepos, Gabrielle and Wiebe, Elden, (eds.)Encyclopedia of case study research. Sage, Thousand Oaks, CA
HudonCChouinardM-CBissonMDanishAKaramMarlèneCase study with a participatory approach: Rethinking pragmatics of stakeholder engagement for implementation research.Ann Fam Med:202119654054610.1370/afm.2717WrightM TParticipatory health research: origins and current trends.BGG:642140145BaramMMaking clinical trials safer for human subjects2021Perspectives on Medical Error: Reactions to the IOM Report2723PisaniA RWymanP AMohrD CPerrinoTHuman subjects protection and technology in prevention science: selected opportunities and challenges.Prevention201617765778WeaverS JLubomksiL HWilsonR FPfohE RPromoting a culture of safety as a patient safety strategy: a systematic review2013236974