Statistical Assumptions
- LAST REVIEWED: 28 September 2016
- LAST MODIFIED: 28 September 2016
- DOI: 10.1093/obo/9780199756810-0165
- LAST REVIEWED: 28 September 2016
- LAST MODIFIED: 28 September 2016
- DOI: 10.1093/obo/9780199756810-0165
Introduction
Statistical assumptions underlie valid inference in education research. All statistical procedures have underlying assumptions, some more stringent than others. In some cases, violations of these assumptions will not change substantive research conclusions. In other cases, violations of assumptions will undermine meaningful research. Establishing that one’s data meet the assumptions of the procedure one is using is an expected component of all quantitatively based research. To ensure valid inference using a statistical procedure, sound education research requires that all statistical assumptions be met as a part of quasi-experimental and experimental research designs. However, some statistical procedures are robust to violations of statistical assumptions. Still, fulfillment of statistical assumptions in education research is increasingly recognized to ensure that valid conclusions are reached, which generalize to the sample being studied (or to be aware that generalization is not warranted). As the range of statistical procedures is great, researchers should look to the corresponding range of literature on the theory of statistical assumptions for any given procedure. Further, researchers should review literature on the application of statistical procedures in research guidelines released by educational research agencies, such as the Institute of Educational Sciences. Currently, the gold standard for educational research is experimental research design, which requires a different set of statistical assumptions than the more common observational or quasi-experimental designs.
General Overviews
Statistical assumptions are critical to conducting valid inference on a sample. Typical statistical assumptions of hypothesis testing include normality, linearity, exogeneity, homoskedasticity, and correct model specification, as noted by Garson 2014. For a discussion of these assumptions in the context of regression modeling, which is a common technique in education research, see Berry 1993. For a broader discussion of assumptions beyond the linear regression model, a comprehensive reference overview of the various statistical assumptions underlying parametric and semi-parametric statistical techniques can be found in the work of David Sheskin (See Sheskin 2011). In the case of violations of statistical assumptions, Wilcox 2010 provides a thorough discussion of modern robust statistical techniques for conducting inference on a sample. A more advanced theoretical exposition regarding consequences of violations of assumptions addressed with the bootstrap and maximum likelihood methods can be found in Freedman 2009. For a general discussion of how to approach violations of statistical assumptions and how to conduct statistical inference in an applied setting, see van Belle 2011. Additionally, once the researcher has determined that possible violations of statistical assumptions are addressed, it may be possible to generalize findings beyond the sample being studied, or to make causal assertions, depending on the sample being studied and selected methodology. Experimental and quasi-experimental methodologies, which have distinct assumptions from observational studies in regard to randomization, may permit generalization and causal inference. A thorough and modern discussion of the methodologies and assumptions that are used for causal inference in the social sciences is provided by Imbens and Rubin 2015. For a discussion of design-based and statistical assumptions requisite to causal inference in education research, see Murnane and Willett 2010.
Berry, William D. 1993. Understanding regression assumptions. Sage University Paper Series on Quantitative Applications in the Social Sciences 07–092. Newbury Park, CA: SAGE.
A concise primer on the theory and application of testing for statistical assumptions in the regression context. Emphasis is placed on the substantive meaning of meeting regression assumptions in an applied setting.
Freedman, David A. 2009. Statistical models: Theory and practice. 2d ed. New York: Cambridge Univ. Press.
Comprehensive graduate-level discussion of statistical assumptions and common methods such as regression and path analysis with matrix algebra. Chapters on maximum likelihood and bootstrap methods will prove relevant to social science researchers seeking to understand the role of the asymptotic normality assumption.
Garson, G. David. 2014. Multiple regression. Asheboro, NC: Statistical Associates.
An introductory graduate-level text that covers application of multiple regression methodology in various statistical packages, such as SAS, Stata, and SPSS. Includes a comprehensive overview of statistical assumptions underlying multiple regression motivated by numerous applied social science datasets.
Imbens, G. W., and Donald B. Rubin. 2015. Causal inference for statistics, social, and biomedical sciences: An introduction. New York: Cambridge Univ. Press.
A new but seminal text that develops the theory of causal inference as applied in various domains of social and natural science research. Extensive discussion of the classical randomized experiment design from the research design phase to statistical analysis. Discussion of causality is motivated by a discussion spanning Fisher and Rubin to the assumptions underlying application of modern statistical analysis to conduct valid inference.
Murnane, Richard J., and John B. Willett. 2010. Methods matter: Improving causal inference in educational and social science research. New York: Oxford Univ. Press.
Clear discussion of the steps in conducting causal inference in education and the social sciences, with strong introductory sections on assumptions in the design stage and subsequent statistical analysis. Nontechnical applied exposition on various aspects and assumptions of experimental, quasi-experimental designs, and observational designs, including randomized controlled trials and regression discontinuity designs.
Sheskin, David J. 2011. Handbook of parametric and nonparametric statistical procedures. 5th ed. New York: Chapman and Hall/CRC.
A seminal reference text for applied statistics that encompasses theory, application, and interpretation of virtually all parametric and nonparametric statistical tests underlying much of modern social science inference today. Brief introductory chapter provides an overview of various subsets of statistical analysis, which is followed by numerous chapters on single sample, multiple sample, factorial design, correlational, and multivariate statistical procedures.
van Belle, Gerald. 2011. Statistical rules of thumb. 2d ed. Hoboken, NJ: John Wiley.
Provides over one hundred formal and informal suggestions regarding statistical assumptions, analysis, and interpretation in an applied setting. Chapters on sample size, observational studies, and covariation prove relevant to the modern education researcher, in addition to concluding chapters on how to present statistical analysis and conduct professional statistical consulting.
Wilcox, Rand R. 2010. Fundamentals of modern statistical methods: Substantially improving power and accuracy. 2d ed. New York: Springer.
DOI: 10.1007/978-1-4419-5525-8
A text that delves into theoretical and practical considerations of applied statistical methodology, from discussion of distributions and hypothesis testing to conducting robust multivariate analysis. Particular emphasis is placed on robust methods, which are key to reaching valid inference in the social sciences in relation to statistical power.
Users without a subscription are not able to see the full content on this page. Please subscribe or login.
How to Subscribe
Oxford Bibliographies Online is available by subscription and perpetual access to institutions. For more information or to contact an Oxford Sales Representative click here.
Article
- Academic Achievement
- Academic Audit for Universities
- Academic Freedom and Tenure in the United States
- Action Research in Education
- Adjuncts in Higher Education in the United States
- Administrator Preparation
- Adolescence
- Advanced Placement and International Baccalaureate Courses
- Advocacy and Activism in Early Childhood
- African American Racial Identity and Learning
- Alaska Native Education
- Alternative Certification Programs for Educators
- Alternative Schools
- American Indian Education
- Animals in Environmental Education
- Art Education
- Artificial Intelligence and Learning
- Assessing School Leader Effectiveness
- Assessment, Behavioral
- Assessment, Educational
- Assessment in Early Childhood Education
- Assistive Technology
- Augmented Reality in Education
- Beginning-Teacher Induction
- Bilingual Education and Bilingualism
- Black Undergraduate Women: Critical Race and Gender Perspe...
- Black Women in Academia
- Blended Learning
- Bullying
- Case Study in Education Research
- Changing Professional and Academic Identities
- Character Education
- Children’s and Young Adult Literature
- Children's Beliefs about Intelligence
- Children's Rights in Early Childhood Education
- Citizenship Education
- Civic and Social Engagement of Higher Education
- Classroom Learning Environments: Assessing and Investigati...
- Classroom Management
- Coherent Instructional Systems at the School and School Sy...
- College Admissions in the United States
- College Athletics in the United States
- Community Relations
- Comparative Education
- Computer-Assisted Language Learning
- Computer-Based Testing
- Conceptualizing, Measuring, and Evaluating Improvement Net...
- Continuous Improvement and "High Leverage" Educational Pro...
- Counseling in Schools
- Creativity
- Critical Approaches to Gender in Higher Education
- Critical Perspectives on Educational Innovation and Improv...
- Critical Race Theory
- Crossborder and Transnational Higher Education
- Cross-National Research on Continuous Improvement
- Cross-Sector Research on Continuous Learning and Improveme...
- Cultural Diversity in Early Childhood Education
- Culturally Responsive Leadership
- Culturally Responsive Pedagogies
- Culturally Responsive Teacher Education in the United Stat...
- Curriculum Design
- Data Collection in Educational Research
- Data-driven Decision Making in the United States
- Deaf Education
- Desegregation and Integration
- Design Thinking and the Learning Sciences: Theoretical, Pr...
- Development, Moral
- Dialogic Pedagogy
- Digital Age Teacher, The
- Digital Citizenship
- Digital Divides
- Disabilities
- Distance Learning
- Distributed Leadership
- Doctoral Education and Training
- Early Childhood Education and Care (ECEC) in Denmark
- Early Childhood Education and Development in Mexico
- Early Childhood Education in Aotearoa New Zealand
- Early Childhood Education in Australia
- Early Childhood Education in China
- Early Childhood Education in Europe
- Early Childhood Education in Sub-Saharan Africa
- Early Childhood Education in Sweden
- Early Childhood Education Pedagogy
- Early Childhood Education Policy
- Early Childhood Education, The Arts in
- Early Childhood Mathematics
- Early Childhood Science
- Early Childhood Teacher Education
- Early Childhood Teachers in Aotearoa New Zealand
- Early Years Professionalism and Professionalization Polici...
- Economics of Education
- Education For Children with Autism
- Education for Sustainable Development
- Education Leadership, Empirical Perspectives in
- Education of Native Hawaiian Students
- Education Reform and School Change
- Educational Research Approaches: A Comparison
- Educational Statistics for Longitudinal Research
- Educator Partnerships with Parents and Families with a Foc...
- Emotional and Affective Issues in Environmental and Sustai...
- Emotional and Behavioral Disorders
- English as an International Language for Academic Publishi...
- Environmental and Science Education: Overlaps and Issues
- Environmental Education
- Environmental Education in Brazil
- Epistemic Beliefs
- Equity and Improvement: Engaging Communities in Educationa...
- Equity, Ethnicity, Diversity, and Excellence in Education
- Ethical Research with Young Children
- Ethics and Education
- Ethics of Teaching
- Ethnic Studies
- Europe, History of Education in
- Evidence-Based Communication Assessment and Intervention
- Family and Community Partnerships in Education
- Family Day Care
- Federal Government Programs and Issues
- Feminization of Labor in Academia
- Finance, Education
- Financial Aid
- Formative Assessment
- Future-Focused Education
- Gender and Achievement
- Gender and Alternative Education
- Gender, Power and Politics in the Academy
- Gender-Based Violence on University Campuses
- Gifted Education
- Girls' Education in the Developing World
- Global Mindedness and Global Citizenship Education
- Global University Rankings
- Governance, Education
- Grounded Theory
- Growth of Effective Mental Health Services in Schools in t...
- Higher Education and Globalization
- Higher Education and the Developing World
- Higher Education Faculty Characteristics and Trends in the...
- Higher Education Finance
- Higher Education Governance
- Higher Education Graduate Outcomes and Destinations
- Higher Education in Africa
- Higher Education in China
- Higher Education in Latin America
- Higher Education in the United States, Historical Evolutio...
- Higher Education, International Issues in
- Higher Education Management
- Higher Education Policy
- Higher Education Research
- Higher Education Student Assessment
- High-stakes Testing
- History of Early Childhood Education in the United States
- History of Education in the United States
- History of Technology Integration in Education
- Homeschooling
- Inclusion in Early Childhood: Difference, Disability, and ...
- Inclusive Education
- Indigenous Education in a Global Context
- Indigenous Learning Environments
- Indigenous Students in Higher Education in the United Stat...
- Infant and Toddler Pedagogy
- Inservice Teacher Education
- Integrating Art across the Curriculum
- Intelligence
- Intensive Interventions for Children and Adolescents with ...
- International Perspectives on Academic Freedom
- Intersectionality and Education
- Knowledge Development in Early Childhood
- Leadership Development, Coaching and Feedback for
- Leadership in Early Childhood Education
- Leadership Training with an Emphasis on the United States
- Learning Analytics in Higher Education
- Learning Difficulties
- Learning, Lifelong
- Learning, Multimedia
- Learning Strategies
- Legal Matters and Education Law
- LGBT Youth in Schools
- Linguistic Diversity
- Linguistically Inclusive Pedagogy
- Literacy
- Literacy Development and Language Acquisition
- Literature Reviews
- Mathematics Identity
- Mathematics Instruction and Interventions for Students wit...
- Mathematics Teacher Education
- Measurement for Improvement in Education
- Measurement in Education in the United States
- Meta-Analysis and Research Synthesis in Education
- Methodological Approaches for Impact Evaluation in Educati...
- Methodologies for Conducting Education Research
- Mindfulness, Learning, and Education
- Mixed Methods Research
- Motherscholars
- Motivation
- Multiliteracies in Early Childhood Education
- Multiple Documents Literacy: Theory, Research, and Applica...
- Multivariate Research Methodology
- Museums, Education, and Curriculum
- Music Education
- Narrative Research in Education
- Native American Studies
- Nonformal and Informal Environmental Education
- Note-Taking
- Numeracy Education
- One-to-One Technology in the K-12 Classroom
- Online Education
- Open Education
- Organizing for Continuous Improvement in Education
- Organizing Schools for the Inclusion of Students with Disa...
- Outdoor Play and Learning
- Outdoor Play and Learning in Early Childhood Education
- Pedagogical Leadership
- Pedagogy of Teacher Education, A
- Performance Objectives and Measurement
- Performance-based Research Assessment in Higher Education
- Performance-based Research Funding
- Phenomenology in Educational Research
- Philosophy of Education
- Physical Education
- Play
- Podcasts in Education
- Policy
- Policy Context of United States Educational Innovation and...
- Politics of Education
- Portable Technology Use in Special Education Programs and ...
- Post-humanism and Environmental Education
- Pre-Service Teacher Education
- Problem Solving
- Productivity and Higher Education
- Professional Development
- Professional Learning Communities
- Program Evaluation
- Programs and Services for Students with Emotional or Behav...
- Psychology Learning and Teaching
- Psychometric Issues in the Assessment of English Language ...
- Qualitative Data Analysis Techniques
- Qualitative, Quantitative, and Mixed Methods Research Samp...
- Qualitative Research Design
- Quantitative Research Designs in Educational Research
- Queering the English Language Arts (ELA) Writing Classroom
- Race and Affirmative Action in Higher Education
- Reading Education
- Refugee and New Immigrant Learners
- Relational and Developmental Trauma and Schools
- Relational Pedagogies in Early Childhood Education
- Reliability in Educational Assessments
- Religion in Elementary and Secondary Education in the Unit...
- Researcher Development and Skills Training within the Cont...
- Research-Practice Partnerships in Education within the Uni...
- Response to Intervention
- Restorative Practices
- Risky Play in Early Childhood Education
- Role of Gender Equity Work on University Campuses through ...
- Scale and Sustainability of Education Innovation and Impro...
- Scaling Up Research-based Educational Practices
- School Accreditation
- School Choice
- School Culture
- School District Budgeting and Financial Management in the ...
- School Improvement through Inclusive Education
- School Reform
- Schools, Private and Independent
- School-Wide Positive Behavior Support
- Science Education
- Secondary to Postsecondary Transition Issues
- Self-Regulated Learning
- Self-Study of Teacher Education Practices
- Service-Learning
- Severe Disabilities
- Single Salary Schedule
- Single-sex Education
- Single-Subject Research Design
- Social Context of Education
- Social Justice
- Social Network Analysis
- Social Pedagogy
- Social Science and Education Research
- Social Studies Education
- Sociology of Education
- Standards-Based Education
- Statistical Assumptions
- STEM-related Education, Indigenous Science Education and
- Student Access, Equity, and Diversity in Higher Education
- Student Assignment Policy
- Student Engagement in Tertiary Education
- Student Learning, Development, Engagement, and Motivation ...
- Student Participation
- Student Voice in Teacher Development
- Sustainability Education in Early Childhood Education
- Sustainability in Early Childhood Education
- Sustainability in Higher Education
- Teacher Beliefs and Epistemologies
- Teacher Collaboration in School Improvement
- Teacher Evaluation and Teacher Effectiveness
- Teacher Preparation
- Teacher Training and Development
- Teacher Unions and Associations
- Teacher-Student Relationships
- Teaching Critical Thinking
- Technologies, Teaching, and Learning in Higher Education
- Technology Education in Early Childhood
- Technology, Educational
- Technology-based Assessment
- The Bologna Process
- The Regulation of Standards in Higher Education
- Theories of Educational Leadership
- Three Conceptions of Literacy: Media, Narrative, and Gamin...
- Tracking and Detracking
- Traditions of Quality Improvement in Education
- Transformative Learning
- Transitions in Early Childhood Education
- Tribally Controlled Colleges and Universities in the Unite...
- Understanding the Psycho-Social Dimensions of Schools and ...
- University Faculty Roles and Responsibilities in the Unite...
- Using Ethnography in Educational Research
- Value of Higher Education for Students and Other Stakehold...
- Virtual Learning Environments
- Vocational and Technical Education
- Wellness and Well-Being in Education
- Women's and Gender Studies
- Young Children and Spirituality
- Young Children's Learning Dispositions
- Young Children's Working Theories