But I still believe strongly in the benefits of making evidence-based decisions (in education, in medicine, etc.), so I just want to share a cool link with my blog readers that summarizes (in really easy to understand ways) high quality research studies on education: http://ies.ed.gov/ncee/wwc/publications/quickreviews/. This is a government-based website that provides objective information about findings from scientific research on education topics, and I encourage interested blog readers to check it out.
Here are some cool examples of real findings from this site that I believe have direct implications for our district (I've put the key findings in bold).
1. How to close the race-based achievement gap: "Recursive Processes in Self-Affirmation: Intervening to Close the Minority Achievement Gap"
This study examined whether having African-American middle school students write essays affirming their personal values improved their academic performance. Seventh graders were placed at random into intervention and comparison groups near the start of the school year. Both groups were given structured writing assignments three to five times during their seventh- and eighth-grade years. The intervention group wrote about their personal values (e.g., relationships with friends and family, religious values) and why these were important to them.The comparison group wrote about neutral subjects, such as their daily routine, or why values they considered unimportant might be important to others.
The study analyzed data on about 175 African-American and 190 European-American students (the study’s term for white students who are non-Latino and non-Asian) at a suburban middle school who were randomly assigned to intervention and comparison groups at the beginning of seventh grade. The study measured effects by comparing the seventh- and eighth-grade GPAs of students in the intervention and comparison groups. These GPAs included grades from the four core academic subjects: science, social studies, math, and English. The study examined effects separately for European-American and African-American students and for low- and high-achieving students.
Among African-American students, completing writing exercises about their values increased their average seventh- and eighth-grade GPA by a quarter of a letter grade (0.24 points), a change that was statistically significant. The intervention did not have a statistically significant effect on the academic outcomes of European-American students. Among low-achieving African-American students, the effect was somewhat larger, an increase in average seventh- and eighth-grade GPA of 0.41 points. In addition, the intervention reduced the likelihood that low-achieving African-American students were assigned to a remedial program or were retained in grade.
2. The effectiveness of different elementary math curriculum: "Achievement Effects of Four Elementary School Math Curricula: Findings from First Graders in 39 Schools"
This study examined the relative effectiveness of four widely-used early elementary school math curricula: (1) Investigations in Number, Data and Space (Investigations), (2) Math Expressions (ME), (3) Saxon Math (Saxon), and (4) Scott Foresman-Addison Wesley Mathematics (SFAW). The study included about 1,300 first graders from 39 schools in four school districts in Connecticut, Minnesota, New York, and Nevada. Participating schools were randomly assigned to use one of the four curricula. At least one school in each district was assigned to each of the four math programs. A random sample of approximately 10 students per classroom was included in the analysis. The study measured the relative effectiveness of the four curricula by comparing end-of-year test scores on a nationally normed math assessment developed for the Early Childhood Longitudinal Study–Kindergarten Class (ECLS–K).
First graders attending schools assigned to the ME and Saxon curricula scored significantly higher on math assessments than students attending schools assigned to the Investigations or SFAW curricula. Math achievement did not differ significantly between schools using ME and Saxon; nor were there significant differences in student math achievement between schools using Investigations and SFAW. The authors report that math achievement of ME and Saxon students was 0.30 standard deviations higher than Investigations students, equivalent to moving a student from the 50th to 62nd percentile. Math achievement of ME and Saxon students was 0.24 standard deviations higher than SFAW students, equivalent to moving a student from the 50th to the 59th percentile.
3. How to close the income-based achievement gap: "Addressing Summer Reading Setback Among Economically Disadvantaged Elementary Students"
The study examined whether providing summer reading books to economically disadvantaged first- and second-grade students for three consecutive summers improved reading achievement. In the spring of the first year, 1st- and 2nd-graders in each school were randomly assigned to receive 12 self-selected summer reading books every year for three consecutive summers. Each spring, students in the summer reading group attended a book fair and were asked to select 15 books from the 400 to 600 offered. From these 15 books, 12 were distributed to students in the summer reading group for free on the final day of school.
The authors examined effects for students overall as well as for the subgroup consisting of the most economically disadvantaged students—those who were eligible to receive free lunch.
The study found that students who received three consecutive years of free, self-selected summer reading books had statistically significantly higher reading test scores than students who did not receive summer reading books. The reported effect size of 0.14 is interpreted by the WWC as roughly equivalent to moving a student from the 50th percentile to the 56th percentile of reading achievement. In addition, the study found a statistically significant effect of summer reading among students who were the most economically disadvantaged, with an effect size of 0.21.
4. The potential limits of professional development: "Middle School Mathematics Professional Development Impact Study: Findings After the First Year of Implementation"
The study examined whether 7th-graders’ knowledge of rational numbers improved when the students’ math teachers participated in related professional development activities. A total of eight 6-hour sessions of instruction on pedagogy, content knowledge, and resource materials were provided, three during a summer institute and five during school-year seminars. In the weeks following each of the five seminars, a total of 20 hours of classroom coaching were provided by a facilitator to assist teachers in applying new strategies.
Professional development was administered by either America’s Choice or Pearson Achievement Solutions.
The study analyzed data on about 4,500 students and 200 teachers from approximately 80 schools in 12 districts during the 2007–08 academic year. Half the schools within each district were randomly assigned to offer 7th-grade math teachers professional development on the teaching of rational numbers. Teachers in all schools were allowed to continue participating in existing professional development programs. Student-level math achievement was measured by a computer-adaptive rational number test developed by the Northwest Evaluation Association. Teacher-level topical knowledge was measured by a rational number test created by the study’s authors. Teachers’ instructional practices were measured by classroom observations. The study measured the effects of professional development by comparing outcomes at the end of the academic year in schools that were offered professional development provided by the study with outcomes in schools that did not.
The study found that students in schools where teachers were offered extensive professional development by the study performed no better on a test of math achievement in rational numbers than students in comparison schools at the end of the 2007–08 academic year. Further, the study found the professional development had no impact on teacher knowledge of rational number topics and on how to teach them. However, the study found a significant positive impact of the professional development on one of the three measures of teacher instructional practices examined. Teachers who were offered the study’s extensive professional development engaged in 1.03 more activities per hour that elicited student thinking than teachers not offered the study’s professional development.
5. More on the potential limits of professional development: "The Impact of Two Professional Development Interventions on Early Reading Instruction and Achievement"
The authors examined data on 270 teachers and more than 5,000 second graders from 90 elementary schools in four states during the 2005–06 school year. Study schools were randomly assigned to one of three groups: one in which second-grade teachers received training based on the LETRS curriculum, another where they received the training as well as ongoing instructional coaching, and a third where the teachers received the standard professional development available in their district. Thirty schools were assigned to each research group. The study measured effects by comparing the outcomes of teachers and students from each of the three groups of schools.
This study examined the effect of a professional development program based on Language Essentials for Teachers of Reading and Spelling (LETRS) on the knowledge and practice of second-grade teachers and the reading achievement of their students.In two of the research groups, teachers received eight days of reading instruction training based on selected modules from the LETRS curriculum, modified for purposes of the study. Training was offered in the summer and continued through the school year. One of the two groups that received the training also received weekly one-on-one support from a specially trained instructional coach. In the third research group, teachers received the district’s standard professional development program.
The authors examined data on 270 teachers and more than 5,000 second graders from 90 elementary schools in four states during the 2005–06 school year. Study schools were randomly assigned to one of three groups: one in which second-grade teachers received training based on the LETRS curriculum, another where they received the training as well as ongoing instructional coaching, and a third where the teachers received the standard professional development available in their district. Thirty schools were assigned to each research group. The study measured effects by comparing the outcomes of teachers and students from each of the three groups of schools.
Providing second-grade teachers training based on the LETRS curriculum (with or without the instructional coaches) increased their knowledge of reading instruction techniques and their use of explicit instruction. However, it did not increase the reading test scores of their students. The authors estimated effect sizes on reading scores that ranged from 0.03 to 0.08. These estimates were not statistically significant.
6. Improving elementary science knowledge: “Teaching Science as a Language: A ‘Content-First’ Approach to Science Teaching”
This study examined whether teaching scientific concepts using everyday language before introducing scientific terminology improves the understanding of these concepts. Both groups were taught through web-based lessons with no science instructor. The content-first lesson began by explaining scientific concepts in everyday language, and then linked these concepts to scientific language using interactive quizzes and activities. The control lesson began by defining scientific terms, and then provided activities similar to the content-first lesson but based only on scientific language.
The study included 49 students—30 who spoke Spanish at home and 19 who spoke English at home—from one fifth-grade classroom in Oakland, California. All students took a four-hour web-based lesson on photosynthesis developed by the study authors. Twenty-five students were randomly selected to take a version that explained scientific concepts using everyday language before introducing scientific terminology. The other 24 took a version that used scientific terminology from the outset. At the end of the lesson, the study authors used a test they developed to assess students’ conceptual understanding of photosynthesis.
This study examined whether teaching scientific concepts using everyday language before introducing scientific terminology improves the understanding of these concepts. Both groups were taught through web-based lessons with no science instructor. The content-first lesson began by explaining scientific concepts in everyday language, and then linked these concepts to scientific language using interactive quizzes and activities. The control lesson began by defining scientific terms, and then provided activities similar to the content-first lesson but based only on scientific language.
The study included 49 students—30 who spoke Spanish at home and 19 who spoke English at home—from one fifth-grade classroom in Oakland, California. All students took a four-hour web-based lesson on photosynthesis developed by the study authors. Twenty-five students were randomly selected to take a version that explained scientific concepts using everyday language before introducing scientific terminology. The other 24 took a version that used scientific terminology from the outset. At the end of the lesson, the study authors used a test they developed to assess students’ conceptual understanding of photosynthesis.
When tested immediately after the lesson on their understanding of photosynthesis using scientific language, students who received the content-first lesson had higher scores than students who received the lesson that introduced scientific terminology from the outset. The difference in test scores was about three-fifths of a standard deviation, equivalent to moving a student from the 50th percentile to the 74th percentile.
******************************************************************
These six studies all provide data (based on high quality research studies) that I believe have potentially great importance for the Amherst district. Two point to the limitations of professional development in terms of improving student achievement (one in elementary reading, one in middle school math). Two point to the effectiveness of particular interventions for decreasing the achievement gap (one in African American middle school students, one in low income elementary students). One points to the hazards of using particular elementary math curriculum (including Investigations, our current curriculum). And one points to the benefits of explaining scientific terms in an everyday way at improving science knowledge in elementary school students.
So, here are six studies identified by the government as meeting appropriate standards for conducting research, and each provides evidence about what works (or doesn't) in terms of student achievement. And for me, that is a better way of making decisions about education than relying on gut instinct about what works, or our feeling of what should work, or what we hope, based on ideology, would work. I have no stake in any of this research - I don't know the authors, this isn't my work, and I get no pay out if Amherst adopts (or avoids) any of these approaches. But I believe we all - parents, teachers, students, community members - have a stake in making sure our public schools are doing the best they can for all children, and to me that means making evidence-based decisions about how to best allocate our limited school dollars.