Home Articles Reader Opinion Editorial Book Reviews Discussion Writers Guide About TCRecord
transparent 13

Instruction Matters: Lessons From a Mixed-Method Evaluation of Out-Of-School Time Tutoring Under No Child Left Behind

by Annalee G. Good, Patricia Ellen Burch, Mary S. Stewart, Rudy Acosta & Carolyn Heinrich - 2014

Background/Context: Under supplemental educational services (“supplemental services”), a parental choice provision of the No Child Left Behind Act (NCLB), schools that have not made adequate yearly progress in increasing student achievement are required to offer low-income families free, afterschool tutoring. Existing research shows low attendance rates among eligible students and little to no aggregate effects on achievement for students who do attend.

Focus of study: We employ a framework grounded in examining the instructional setting, or “instructional core,” and we draw on the unique contributions of qualitative research to help explain the limited effects of supplemental services on student achievement. Specifically, we address the following research question: How can in-depth examination of the instructional core explain the impact of supplemental services on student learning?

Research Design: Our findings draw on data from an ongoing mixed-method and multisite study of the implementation and impact of supplemental educational services in five urban school districts located in four states. Although this paper includes quantitative data from this study, analysis focuses on qualitative data, including observations of tutoring sessions using a standardized observation instrument; semistructured interviews with district staff, provider administrators, and tutors; focus groups with parents of eligible students; and document analysis.

Findings: We identify two primary reasons for a lack of effects. First, there is a “treatment exposure” problem where most students receive far less than 40 hours of tutoring over the course of a school year, a critical threshold for seeing significant effects on achievement. In addition, there are discrepancies between an invoiced hour of tutoring and actual instructional time. Second, supplemental services has an instructional quality problem. Instruction lacks innovation; the curriculum typically does not align to that of the day school; programs do not meet all students' instructional needs, especially students with disabilities and English language learners; and there can be considerable variation in quality within the same provider.

Conclusions: Our findings lay the foundations for being able to not only establish best practices for supplemental services, but to suggest policy changes to facilitate these best practices and offer insights to a host of other parental choice, out-of-school time (OST), and accountability-based reforms.

To view the full-text for this article you must be signed-in with the appropriate membership. Please review your options below:

Store a cookie on my computer that will allow me to skip this sign-in in the future.
Send me my password -- I can't remember it
Purchase this Article
Purchase Instruction Matters: Lessons From a Mixed-Method Evaluation of Out-Of-School Time Tutoring Under No Child Left Behind
Individual-Resource passes allow you to purchase access to resources one resource at a time. There are no recurring fees.
Become a Member
Online Access
With this membership you receive online access to all of TCRecord's content. The introductory rate of $25 is available for a limited time.
Choose this to join the mailing list or add an announcement.
Print and Online Access
With this membership you receive the print journal and free online access to all of TCRecord's content.

Cite This Article as: Teachers College Record Volume 116 Number 3, 2014, p. -
https://www.tcrecord.org ID Number: 17351, Date Accessed: 9/19/2021 1:05:30 PM

Purchase Reprint Rights for this article or review
Article Tools
Related Articles

Related Discussion
Post a Comment | Read All

About the Author
  • Annalee Good
    University of Wisconsin, Madison
    E-mail Author
    ANNALEE G. GOOD is a Research Associate at the University of Wisconsin-Madison. She has published and presented numerous papers on the nature of the instructional landscape in federally funded tutoring programs, as well as the role of K–12 classroom teachers in the development of educational policy.
  • Patricia Burch
    University of Southern California
    E-mail Author
    PATRICIA BURCH is an Associate Professor at the Rossier School of Education at the University of Southern California, where her research examines the role of private firms as influences in the design and implementation of K–12 education policy and how public education is being transformed by new forms of privatization. Her book, Hidden Markets: The New Education Privatization, was published by Routledge in 2009.
  • Mary Stewart
    University of Wisconsin, Madison
    E-mail Author
    MARY S. STEWART is a doctoral candidate at the University of Wisconsin-Madison in the Educational Policy Studies Department. Her research focuses on educational policy implementation, legal issues in education, and program evaluation.
  • Rudy Acosta
    University of Southern California
    E-mail Author
    RUDY ACOSTA is a doctoral candidate at the University of Southern California in the Rossier School of Education. His research focuses on educational policy of market-based initiatives in K–12 public schooling, access of information of educational policies to under-resourced communities, and parent and community organizing around school reform.
  • Carolyn Heinrich
    University of Texas, Austin
    E-mail Author
    CAROLYN HEINRICH is the Sid Richardson professor of public affairs and affiliated professor of economics and the director of the Center for Health and Social Policy at the Lyndon B. Johnson School of Public Affairs, University of Texas at Austin. Her research focuses on education and social welfare policy, labor force development, public management, and econometric methods for program evaluation, working directly with governments at all levels. Recent publications include articles in journals such as the Journal of Policy Analysis and Management and Educational Evaluation and Policy Analysis and a book (2011), The Performance of Performance Standards.
Member Center
In Print
This Month's Issue