Effect Size
- LAST REVIEWED: 29 May 2019
- LAST MODIFIED: 29 May 2019
- DOI: 10.1093/obo/9780199828340-0247
- LAST REVIEWED: 29 May 2019
- LAST MODIFIED: 29 May 2019
- DOI: 10.1093/obo/9780199828340-0247
Introduction
Simply put, effect size (ES) is the magnitude or strength of association between or among variables. Effect sizes (ESs) are commonly represented numerically (i.e., as parameters for population ESs and statistics for sample estimates of population ESs) but also may be communicated graphically. Although the word “effect” may imply that an ES quantifies the strength of a causal association (“cause and effect”), ESs are used more broadly to represent any empirical association between variables. Effect sizes serve three general purposes: research results reporting, power analysis, and meta-analysis. Even under the same research design, an ES that is appropriate for one of these purposes may not be ideal for another. Effect size can be conveyed graphically or numerically using either unstandardized metrics, which are interpreted relative to the original scales of the variables involved (e.g., the difference between two means or an unstandardized regression slope), or standardized metrics, which are interpreted in relative terms (e.g., Cohen’s d or multiple R2). Whereas unstandardized ESs and graphs illustrating ES are typically most effective for research reporting, that is, communicating the original findings of an empirical study, many standardized ES measures have been developed for use in power analysis and especially meta-analysis. Although the concept of ES is clearly fundamental to data analysis, ES reporting has been advocated as an essential complement to null hypothesis significance testing (NHST), or even as a replacement for NHST. A null hypothesis significance test involves making a dichotomous judgment about whether to reject a hypothesis that a true population effect equals zero. Even in the context of a traditional NHST paradigm, ES is a critical concept because of its central role in power analysis.
General Overviews
The works included in this section are textbooks primarily intended for applied researchers and graduate students with some basic statistics training, including some experience with NHST. Each of these resources, however, tends to focus on standardized ESs with minimal presentation of unstandardized ESs. Cumming 2012 and Kline 2013 contextualize the value of ES calculation and interpretation given the limitations of NHST and point to the central role of ESs for a cumulative science utilizing meta-analyses. Ellis 2010 offers a similar broad discussion of ESs for the interpretation of original research results and the importance of ESs for power analysis and meta-analysis. Grissom and Kim 2012 and Rosenthal, et al. 2000 offer more comprehensive treatments of ES calculation across a wide variety of research designs.
Cumming, G. 2012. Understanding the new statistics: Effect sizes, confidence intervals and meta-analysis. New York: Routledge.
Clear textbook describing the limitations of a NHST paradigm for original research and a cumulative science, while advocating for an increased focus on reporting and interpretation of ES. Emphasizes the importance of confidence intervals for conveying the uncertainty of a single ES statistic and meta-analyses of ESs for a cumulative science.
Ellis, P. D. 2010. The essential guide to effect sizes: Statistical power, meta-analysis, and the interpretation of research results. Cambridge, UK: Cambridge Univ. Press.
Non-technical introduction to effect sizes and their use in power analysis and meta-analyses.
Grissom, R. J., and J. J. Kim. 2012. Effect sizes for research: Univariate and multivariate applications. 2d ed. New York: Routledge.
Pedagogically oriented textbook on ES calculation and interpretation. Comprehensive but focuses on standardized ESs for a variety of research designs. Covers parametric and non-parametric ESs, univariate and multivariate ESs.
Kline, R. B. 2013. Beyond significance testing: Statistics reform in the behavioral sciences. Washington, DC: American Psychological Association.
Lays out the arguments against NHST but also addresses ES estimation for a range of circumstances. Also discusses replication and meta-analysis.
Rosenthal, R., R. L. Rosnow, and D. B. Rubin. 2000. Contrasts and effect sizes in behavioral research: A correlational approach. Cambridge, UK: Cambridge Univ. Press.
Pedagogically oriented textbook focuses on calculation and interpretation of standardized ESs (mainly in the correlation metric), particularly ESs for specific comparisons (i.e., contrasts) as opposed to omnibus effects for larger research designs.
Users without a subscription are not able to see the full content on this page. Please subscribe or login.
How to Subscribe
Oxford Bibliographies Online is available by subscription and perpetual access to institutions. For more information or to contact an Oxford Sales Representative click here.
Article
- Abnormal Psychology
- Academic Assessment
- Acculturation and Health
- Action Regulation Theory
- Action Research
- Addictive Behavior
- Adolescence
- Adoption, Social, Psychological, and Evolutionary Perspect...
- Adulthood
- Advanced Theory of Mind
- Affective Forecasting
- Affirmative Action
- Ageism
- Ageism at Work
- Aggression
- Allport, Gordon
- Alzheimer’s Disease
- Ambulatory Assessment in Behavioral Science
- Analysis of Covariance (ANCOVA)
- Anger
- Animal Behavior
- Animal Learning
- Anxiety Disorders
- Art and Aesthetics, Psychology of
- Artificial Intelligence, Machine Learning, and Psychology
- Assessment and Clinical Applications of Individual Differe...
- Attachment in Social and Emotional Development across the ...
- Attention-Deficit/Hyperactivity Disorder (ADHD) in Adults
- Attention-Deficit/Hyperactivity Disorder (ADHD) in Childre...
- Attitudes
- Attitudinal Ambivalence
- Attraction in Close Relationships
- Attribution Theory
- Authoritarian Personality
- Autism
- Bayesian Statistical Methods in Psychology
- Behavior Therapy, Rational Emotive
- Behavioral Economics
- Behavioral Genetics
- Belief Perseverance
- Bereavement and Grief
- Biological Psychology
- Birth Order
- Body Image in Men and Women
- Burnout
- Bystander Effect
- Categorical Data Analysis in Psychology
- Childhood and Adolescence, Peer Victimization and Bullying...
- Clark, Mamie Phipps
- Clinical Neuropsychology
- Clinical Psychology
- Cognitive Consistency Theories
- Cognitive Dissonance Theory
- Cognitive Neuroscience
- Communication, Nonverbal Cues and
- Comparative Psychology
- Competence to Stand Trial: Restoration Services
- Competency to Stand Trial
- Computational Psychology
- Conflict Management in the Workplace
- Conformity, Compliance, and Obedience
- Consciousness
- Coping Processes
- Correspondence Analysis in Psychology
- Counseling Psychology
- Courage
- Creativity
- Creativity at Work
- Critical Thinking
- Cross-Cultural Psychology
- Cultural Psychology
- Daily Life, Research Methods for Studying
- Data Science Methods for Psychology
- Data Sharing in Psychology
- Death and Dying
- Deceiving and Detecting Deceit
- Defensive Processes
- Depression
- Depressive Disorders
- Development, Prenatal
- Developmental Psychology (Cognitive)
- Developmental Psychology (Social)
- Diagnostic and Statistical Manual of Mental Disorders (DSM...
- Discrimination
- Disgust
- Dissociative Disorders
- Drugs and Behavior
- Eating Disorders
- Ecological Psychology
- Ecopsychology
- Educational Settings, Assessment of Thinking in
- Effect Size
- Embodiment and Embodied Cognition
- Emerging Adulthood
- Emotion
- Emotional Intelligence
- Empathy and Altruism
- Employee Stress and Well-Being
- Environmental Neuroscience and Environmental Psychology
- Ethics in Psychological Practice
- Event Perception
- Evolutionary Psychology
- Expansive Posture
- Experimental Existential Psychology
- Exploratory Data Analysis
- Eyewitness Testimony
- Eysenck, Hans
- Factor Analysis
- Festinger, Leon
- Five-Factor Model of Personality
- Flynn Effect, The
- Forensic Psychology
- Forgiveness
- Friendships, Children's
- Fundamental Attribution Error/Correspondence Bias
- Gambler's Fallacy
- Game Theory and Psychology
- Geropsychology, Clinical
- Global Mental Health
- Habit Formation and Behavior Change
- Happiness
- Health Psychology
- Health Psychology Research and Practice, Measurement in
- Heider, Fritz
- Heuristics and Biases
- History of Psychology
- Human Factors
- Humanistic Psychology
- Humor
- Hypnosis
- Implicit Association Test (IAT)
- Industrial and Organizational Psychology
- Inferential Statistics in Psychology
- Insanity Defense, The
- Intelligence
- Intelligence, Crystallized and Fluid
- Intercultural Psychology
- Intergroup Conflict
- International Classification of Diseases and Related Healt...
- International Psychology
- Interviewing in Forensic Settings
- Intimate Partner Violence, Psychological Perspectives on
- Introversion–Extraversion
- Item Response Theory
- Kurtosis
- Language
- Laughter
- Law, Psychology and
- Lazarus, Richard
- Leadership
- Learned Helplessness
- Learning Theory
- Learning versus Performance
- LGBTQ+ Romantic Relationships
- Lie Detection in a Forensic Context
- Life-Span Development
- Lineups
- Locus of Control
- Loneliness and Health
- Mathematical Psychology
- Meaning in Life
- Mechanisms and Processes of Peer Contagion
- Media Violence, Psychological Perspectives on
- Mediation Analysis
- Meditation
- Memories, Autobiographical
- Memories, Flashbulb
- Memories, Repressed and Recovered
- Memory, False
- Memory, Human
- Memory, Implicit versus Explicit
- Memory in Educational Settings
- Memory, Semantic
- Meta-Analysis
- Metacognition
- Metamemory
- Metaphor, Psychological Perspectives on
- Microaggressions
- Military Psychology
- Mindfulness
- Mindfulness and Education
- Minnesota Multiphasic Personality Inventory (MMPI)
- Money, Psychology of
- Moral Conviction
- Moral Development
- Moral Psychology
- Moral Reasoning
- Motivation
- Music
- Narcissism
- Narrative
- Nature versus Nurture Debate in Psychology
- Neuroscience of Associative Learning
- Nonergodicity in Psychology and Neuroscience
- Nonparametric Statistical Analysis in Psychology
- Observational (Non-Randomized) Studies
- Obsessive-Complusive Disorder (OCD)
- Occupational Health Psychology
- Older Workers
- Olfaction, Human
- Operant Conditioning
- Optimism and Pessimism
- Organizational Justice
- Parenting Stress
- Parenting Styles
- Parents' Beliefs about Children
- Path Models
- Peace Psychology
- Perception
- Perception, Person
- Performance Appraisal
- Personality and Health
- Personality Disorders
- Personality Psychology
- Person-Centered and Experiential Psychotherapies: From Car...
- Phenomenological Psychology
- Placebo Effects in Psychology
- Play Behavior
- Positive Psychological Capital (PsyCap)
- Positive Psychology
- Posttraumatic Stress Disorder (PTSD)
- Prejudice and Stereotyping
- Pretrial Publicity
- Prisoner's Dilemma
- Problem Solving and Decision Making
- Procrastination
- Prosocial Behavior
- Prosocial Spending and Well-Being
- Protocol Analysis
- Psycholinguistics
- Psychological Literacy
- Psychological Perspectives on Food and Eating
- Psychology, Political
- Psychoneuroimmunology
- Psychophysics, Visual
- Psychotherapy
- Psychotic Disorders
- Publication Bias in Psychology
- Race
- Reasoning, Counterfactual
- Rehabilitation Psychology
- Relationships
- Reliability–Contemporary Psychometric Conceptions
- Religion, Psychology and
- Replication Initiatives in Psychology
- Research Methods
- Resilience
- Risk Taking
- Role of the Expert Witness in Forensic Psychology, The
- Rumination
- Sample Size Planning for Statistical Power and Accurate Es...
- Savoring
- Schizophrenic Disorders
- School Psychology
- School Psychology, Counseling Services in
- Self, Gender and
- Self, Psychology of the
- Self-Construal
- Self-Control
- Self-Deception
- Self-Determination Theory
- Self-Efficacy
- Self-Esteem
- Self-Monitoring
- Self-Regulation in Educational Settings
- Self-Report Tests, Measures, and Inventories in Clinical P...
- Sensation Seeking
- Sex and Gender
- Sexual Minority Parenting
- Sexual Orientation
- Signal Detection Theory and its Applications
- Simpson's Paradox in Psychology
- Single People
- Single-Case Experimental Designs
- Situational Strength
- Skinner, B.F.
- Sleep and Dreaming
- Small Groups
- Social Class and Social Status
- Social Cognition
- Social Neuroscience
- Social Support
- Social Touch and Massage Therapy Research
- Somatoform Disorders
- Spatial Attention
- Sports Psychology
- Stanford Prison Experiment (SPE): Icon and Controversy
- Stereotype Threat
- Stereotypes
- Stress and Coping, Psychology of
- Student Success in College
- Subjective Wellbeing Homeostasis
- Suicide
- Taste, Psychological Perspectives on
- Teaching of Psychology
- Terror Management Theory
- Testing and Assessment
- The Concept of Validity in Psychological Assessment
- The Neuroscience of Emotion Regulation
- The Reasoned Action Approach and the Theories of Reasoned ...
- The Weapon Focus Effect in Eyewitness Memory
- Theory of Mind
- Therapy, Cognitive-Behavioral
- Thinking Skills in Educational Settings
- Time Perception
- Trait Perspective
- Trauma Psychology
- Twin Studies
- Type A Behavior Pattern (Coronary Prone Personality)
- Unconscious Processes
- Video Games and Violent Content
- Virtues and Character Strengths
- Wisdom
- Women and Science, Technology, Engineering, and Math (STEM...
- Women, Psychology of
- Work Well-Being
- Workforce Training Evaluation
- Wundt, Wilhelm