Subscribe Today
Home Articles Reader Opinion Editorial Book Reviews Discussion Writers Guide About TCRecord
transparent 13

Dividing by Zero: Exploring Null Results in a Mathematics Professional Development Program

by Heather C. Hill, Douglas Lyman Corey & Robin T. Jacob - 2018

Background/Context: Since 2002, U.S. federal funding for educational research has favored the development and rigorous testing of interventions designed to improve student outcomes. However, recent reviews suggest that a large fraction of the programs developed and rigorously tested in the past decade have shown null results on student outcomes and, often, intermediate variables. Scholars reporting on null results often explain such results by citing factors they informally identified while they either delivered or observed the program.

Purpose/Objective/Research Question/Focus of Study: In this paper, we argue for a more systematic approach to examining null results, and develop a framework for evaluating null results based on the policy implementation literature. We then illustrate this approach by examining why one professional development program failed to show impacts on measures of teaching and student learning in a recent study.

Setting: The professional development program took place in a mid-sized urban school district on the East Coast. The provider was fully scaled up, capable of providing professional development in most U.S. locations.

Research Design: The main study of this program was conducted as a cluster randomized trial with 105 teachers in 18 schools. Here, we engage in a qualitative case study, using multiple sources of evidence to assess the likelihood that specific reasons for null results are valid.

Data Collection and Analysis: The case study sources of evidence include observations of professional development; teacher surveys and logs; transcribed videos of teachers’ mathematics instruction; and teacher interviews.

Findings/Results: Our analysis suggested that null impacts could result from district priorities and instructional guidance that compete with professional development goals; weaknesses in the intervention as well as its fit to teachers’ needs; and the difficulty of implementing ambitious instructional practice.

Conclusions/Recommendations: Our findings suggest the need for further elaboration of the null-results framework. They also suggest that professional development providers consider both (a) both the organizations in which programs operate and (b) fit of the program to teachers’ needs as potential barriers to success.

To view the full-text for this article you must be signed-in with the appropriate membership. Please review your options below:

Store a cookie on my computer that will allow me to skip this sign-in in the future.
Send me my password -- I can't remember it
Purchase this Article
Purchase Dividing by Zero: Exploring Null Results in a Mathematics Professional Development Program
Individual-Resource passes allow you to purchase access to resources one resource at a time. There are no recurring fees.
Become a Member
Online Access
With this membership you receive online access to all of TCRecord's content. The introductory rate of $25 is available for a limited time.
Print and Online Access
With this membership you receive the print journal and free online access to all of TCRecord's content.

Cite This Article as: Teachers College Record Volume 120 Number 6, 2018, p. 1-42
https://www.tcrecord.org ID Number: 22151, Date Accessed: 9/16/2021 6:48:29 PM

Purchase Reprint Rights for this article or review
Article Tools
Related Articles

Related Discussion
Post a Comment | Read All

About the Author
  • Heather Hill
    Harvard University
    E-mail Author
    HEATHER C. HILL, Ph.D., is the Jerome T. Murphy Professor of Education at the Harvard Graduate School of Education. Her interests include teacher professional development, mathematics instruction, and educational policy.
  • Douglas Lyman Corey
    Brigham Young University
    E-mail Author
    DOUGLAS LYMAN COREY, Ph.D., is Associate Professor of Mathematics Education at the Department of Mathematics Education, Brigham Young University.
  • Robin T. Jacob
    University of Michigan
    E-mail Author
    ROBIN T. JACOB, Ph.D., is Research Associate Professor at the Institute for Social Research and the School of Education at the University of Michigan.
Member Center
In Print
This Month's Issue