Alternative Research Designs
- LAST REVIEWED: 23 February 2011
- LAST MODIFIED: 23 February 2011
- DOI: 10.1093/obo/9780199756797-0048
- LAST REVIEWED: 23 February 2011
- LAST MODIFIED: 23 February 2011
- DOI: 10.1093/obo/9780199756797-0048
Introduction
While randomized controlled trials (RCTs) are considered the gold standard for intervention research, under some circumstances alternative research designs may be considered a practical and robust alternative for quantitative evaluation. Health outcomes and health behavior are influenced by a complex array of factors. These may include individual characteristics and social influences, as well as factors that relate to the environment in which the person lives and operates. Individual characteristics may relate to knowledge, skills, and attitudes. Social influence may include perceptions of normative behaviors, peer pressure, and social support structures. Environmental characteristics may relate to characteristics of the physical environment, laws or regulations, or policies that affect behavior in a given context. Because health behavior can be influenced by factors at all these levels, interventions may need to target all or many of these levels in order to successfully change behavior. As such, public health interventions often need to try to achieve change in whole populations (e.g., schools, communities, workplaces) rather than individual people. Where the unit of intervention is the population rather than the individual, there may be significant cost and logistical problems in accessing a sufficiently large sample to conduct an RCT. This has led to growing acknowledgment of the role of pragmatic research designs in evaluation of public health interventions. Alternative research designs to the RCT that may be useful for the evaluation of public health interventions include interrupted time series, multiple baseline, randomized encouragement, and regression discontinuity designs, among others. Selection of research design should take into account trade-offs between internal validity and external validity, cost, acceptability, and feasibility. The mixed methods approach uses quantitative and qualitative data collection simultaneously and combines them to produce answers to important questions. This is a complementary approach to experimental and quasi-experimental designs, but it constitutes the use of different data collection methodologies, not an alternative research design.
General Overviews
Nutbeam 1998 gives a useful introduction to the different purposes and audiences for evaluation research. In particular it highlights the need to match the study design to the research question. A cook’s tour of alternative research designs suitable for public health evaluations is provided by Mercer, et al. 2007. A more detailed and in-depth discussion of alternative research designs, including when and how they should be used, is given by Shadish, et al. 2002. Cook 2010 presents a viewpoint about methodological issues with respect to establishment of causality.
Cook Thomas D., Michael Scriven, Chris L. S. Coryn, and Stephanie D. H. Evergreen. 2010. Contemporary thinking about causation in evaluation: A dialogue with Tom Cook and Michael Scriven. American Journal of Evaluation 31.1: 105–117.
Written in a conversational style, this article presents a dialogue between Cook and Scriven discussing key controversies and topics in relation to evaluation designs to establish causation. Limitations of the RCT with respect to the type of research questions that can be addressed are discussed.
Mercer, Shawna L., Barbara J. DeVinney, Lawrence J. Fine, Lawrence W. Green, and Denise Dougherty. 2007. Study designs for effectiveness and translation research: Identifying trade-offs. American Journal of Preventive Medicine 33.2: 139–154.
DOI: 10.1016/j.amepre.2007.04.005
This article describes provides a valuable overview of several alternative research designs and their potential application to evaluation of health interventions. A description of each design is provided as well as examples of the types of circumstances under which they might be used.
Nutbeam, Don. 1998. Evaluating health promotion—Progress, problems and solutions. Health Promotion International 13.1: 27–44.
A general overview of the key challenges in evaluating health promotion activities is presented. A phased approach to evaluation in which research questions (and appropriate designs) may change as the health promotion program develops is recommended. Some description of alternative research designs and examples of when they have been implemented are provided.
Shadish, William R., Thomas D. Cook, and Donald T. Campbell. 2002. Experimental and quasi-experimental designs for generalized casual inference. Boston: Houghton Mifflin.
This textbook provides a useful overview for researchers and students of the types of designs that can be used for establishing causal inference. Design characteristics and interpretation of designs such as the controlled before and after, regression discontinuity, and time series are described.
Users without a subscription are not able to see the full content on this page. Please subscribe or login.
How to Subscribe
Oxford Bibliographies Online is available by subscription and perpetual access to institutions. For more information or to contact an Oxford Sales Representative click here.
Article
- Abortion
- Access to Health Care
- Action Research
- Active Aging
- Active Living
- Addiction
- Adolescent Health, Socioeconomic Inequalities in
- Adolescent Risk-Taking Behavior in the United States
- Advocacy, Public Health
- Agricultural Safety and Public Health
- Air Quality: Health Effects
- Air Quality: Indoor Health Effects
- Alcohol Availability and Violence
- Alternative Research Designs
- Ambient Air Quality Standards and Guidelines
- American Perspectives on Chronic Disease and Control
- Antimicrobial Resistance (AMR)
- Arts in Health
- Asbestos
- Asthma in Children
- Asthma, Work-Related
- Attachment as a Health Determinant
- Behavior
- Behavior Change Theory in Health Education and Promotion
- Behavioral Risk Factor Surveillance
- Bicycling and Cycling Safety
- Bioethics
- Birth and Death Registration
- Birth Cohort Studies
- Board of Health
- Breastfeeding
- Built Environment and Health, The
- Business and Corporate Practices
- Cancer Communication Strategies in North America
- Cancer Prevention
- Cancer Screening
- Capacity Building
- Capacity Building for NCDs in LMICs
- Capacity-Building for Applied Public Health in LMIC: A US ...
- Cardiovascular Health and Disease
- Child Labor
- Child Maltreatment
- Children, Air Pollution and
- Children, Injury Risk-Taking Behaviors in
- Children, Obesity in
- Citizen Advisory Boards
- Climate Change and Human Health
- Climate Change: Institutional Response
- Clinical Preventive Medicine
- Community Air Pollution
- Community Development
- Community Gardens
- Community Health Assessment
- Community Health Interventions
- Community Partnerships and Coalitions
- Community-Based Participatory Research
- Complexity and Systems Theory
- Critical Health Literacy
- Cultural Capital and Health
- Cultural Safety
- Culture and Public Health
- Definition of Health
- Dental Public Health
- Design and Health
- Dietary Guidelines
- Directions in Global Public Health Graduate Education
- Driving and Public Health
- Ecological Approaches
- Enabling Factors
- Environmental Health, Pediatric
- Environmental Laws
- Environmental Protection Agency
- Ethics of Public Health
- Evidence-Based Pediatric Dentistry
- Evidence-Based Public Health Practice
- Family Planning Services and Birth Control
- Food Safety
- Food Security and Food Banks
- Food Systems
- Frail Elderly
- Functional Literacy
- Genomics, Public Health
- Geographic Information Systems
- Geography and Health
- Global Health
- Global Health Diplomacy
- Global Health Promotion
- Global Health Security
- Guide to Community Preventive Services, The
- Health Administration
- Health Communication
- Health Disparities
- Health Education
- Health Impact Assessment
- Health in All Policies
- Health in All Policies in European Countries
- Health Literacy
- Health Literacy and Noncommunicable Diseases
- Health Measurement Scales
- Health Planning
- Health Promoting Hospitals
- Health Promotion
- Health Promotion Foundations
- Health Promotion Workforce Capacity
- Health Promotion Workforce Capacity
- Health Systems of Low and Middle-Income Countries, The
- Healthy People Initiative
- Healthy Public Policy
- Hepatitis C
- High Risk Prevention Strategies
- Homelessness
- Human Rights, Health and
- Human Sexuality and Sexual Health: A Western Perspective
- IANPHI and National Public Health Institutes
- Immigrant Populations
- Immunization and Pneumococcal Infection
- Immunization in Pregnancy
- Indigenous Peoples, Public Health and
- Indigenous Populations of North America, Australasia, and ...
- Indoor Air Quality Guidelines
- Inequities
- Infant Mortality
- Internet Applications in Promoting Health Behavior
- Intersectoral Action
- Intersectoral Strategies in Low - Middle Income Countries ...
- Justice, Social
- Knowledge Translation and Exchange
- Knowledge Utilization and Exchange
- Law of Public Health in the United States
- Media Advocacy
- Mental Health
- Mental Health Promotion
- Migrant Health
- Migrant Worker Health
- Motor Vehicle Injury Prevention
- Multi-Drug-Resistant Tuberculosis
- Nanotechnology
- National Association of Local Boards of Health
- National Public Health Institutions
- Needs Assessment
- Needs Assessments in International Disasters and Emergenci...
- Obesity Prevention
- Occupational Cancers
- Occupational Exposure to Benzene
- Occupational Exposure to Erionite
- Occupational Safety and Health
- Occupational Safety and Health Administration (OSHA)
- Oral Health Equity for Minority Populations in the United ...
- Ottawa Charter
- Parenting and Work
- Parenting Skills and Capacity
- Participatory Action Research
- Patient Decision Making
- Pesticide Exposure and Pesticide Health Effects
- Pesticides
- Physical Activity and Exercise
- Physical Activity Promotion
- Pneumoconiosis
- Polio Eradication in Pakistan
- Population Aging
- Population Determinants of Unhealthy Foods and Beverages
- Population Health Objectives and Targets
- Precautionary Principle
- Prenatal Health
- Preparedness
- Program Evaluation in American Health Education
- Program Planning and Evaluation
- Public Health, History of
- Public Health Surveillance
- Public-Private Partnerships in Public Health Research and ...
- Public-Private Partnerships to Prevent and Manage Obesity ...
- Quackery as a Public Health Problem
- Quantitative Microbial Risk Assessment
- Racism as a Structural Determinant of Health
- Radiation Emergencies and Public Health: Impacts, Prepared...
- Randomized Controlled Trials
- Real World Evaluation Strategies
- Reducing Obesity-Related Health Disparities in Hispanic an...
- Research Integrity in Public Health
- Resilient Health Systems
- Rural Health in the United States
- Safety, Patient
- School Health Programs in the Pacific Region
- Sex Education in HIV/AIDS Prevention
- Silicosis
- Skin Cancer Prevention
- Smoking Cessation
- Social Determinants of Health
- Social Epidemiology
- Social Marketing
- Statistics in Public Health
- STI Networks, Patterns, and Control Strategies
- Stillbirths
- Suicide
- Sustainable Development Goals
- Systems in the United States, Public Health
- Systems Modeling and Big Data for Non-Communicable Disease...
- Systems Theory in Public Health
- Traditional, Complementary, Alternative, and Integrative M...
- Translation of Science to Practice and Policy
- Traumatic Stress and Post-Traumatic Stress Disorder
- Tuberculosis among Adults and the Determinants of Health
- UK Public Health Systems
- Unintentional Injury Prevention
- Urban Health
- Vaccination, Mandatory
- Vaccine Hesitancy
- Vermiculite
- Violence Prevention
- Vulnerability, Intersectionality and Health in Migration
- War
- Water Quality
- Water Quality and Water-Related Disease
- Weight Management in US Occupational Settings
- Welfare States, Public Health and Health Inequalities
- Workforce
- Worksite Health Promotion
- World Health Organization (WHO)