Final Report Released on Congressionally Mandated Study of Educational Technology Products

Study Examines Effectiveness of Computer-Based Reading and Math Products

Contact: Cheryl Pedersen, (609) 275-2258

PRINCETON, N.J. (February 18, 2009)—A new report from Mathematica Policy Research, Inc., evaluates 10 computer-based reading and math products to determine their effectiveness in bolstering student achievement. The study, the largest of its kind to use an experimental design to study reading and math software products implemented in a range of grade levels across the country, was mandated under Section 2421(a), Part D, of Title II of the No Child Left Behind Act.

The new report presents effects for the 2005-2006 school year and also looks at whether teacher experience using the software products matters, including findings for teachers from the first year who continued with the study and had a new cohort of students and an additional year of experience using the software. Effects for each of the 10 products evaluated are included in the report. A previous report reviewed results for 2004-2005.

The study assesses the effects of four reading products—Destination Reading, Waterford Early Reading Program, Headsprout, and Plato Focus—on reading achievement in first grade, and two products—LeapTrack and Academy of Reading—in fourth grade. It also looks at effects of two math products—Larson Pre-Algebra and Achieve Now—on math achievement in sixth grade, and two high school algebra products—Cognitive Tutor Algebra I and Larson Algebra I—used mostly in ninth grade.

Key findings include the following:

Teacher experience was not systematically related to changes in effects between the first year and the second year.
Of the 10 products reviewed, one had statistically significant positive effects. The size of the effect was equivalent to moving a student from the 50th to the 54th percentile.

The report, Effectiveness of Reading and Mathematics Software Products: Findings from Two Student Cohorts, by Larissa Campuzano, Mark Dynarski, Roberto Agodini, and Kristina Rall, is on the web at http://www.mathematica-mpr.com/publications/redirect_pubsdb.asp?strSite=pdfs/Education/effectreadmath09.pdf.

To read more about the research, part of a $15 million congressionally mandated study funded by the U.S. Department of Education's Institute of Education Sciences.

Mathematica, a nonpartisan research firm, conducts high quality, objective policy research and surveys to improve public well-being. Its clients include federal and state governments, foundations, and private-sector and international organizations. The employee-owned company, with offices in Princeton, N.J., Washington, D.C., Cambridge, Mass., Ann Arbor, Mich., and Oakland, Calif., has conducted some of the most important studies of nutrition, health care, education, welfare, employment, and early childhood policies and programs in the United States.