Curriculum - Education Next https://www.educationnext.org/research/curriculum-research/ A Journal of Opinion and Research About Education Policy Fri, 15 Mar 2024 14:11:04 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.5 https://i0.wp.com/www.educationnext.org/wp-content/uploads/2019/12/e-logo.png?fit=32%2C32&ssl=1 Curriculum - Education Next https://www.educationnext.org/research/curriculum-research/ 32 32 181792879 How Building Knowledge Boosts Literacy and Learning https://www.educationnext.org/how-building-knowledge-boosts-literacy-and-learning/ Wed, 13 Mar 2024 09:00:45 +0000 https://www.educationnext.org/?p=49717868 First causal study finds outsized impacts at “Core Knowledge” schools

The post How Building Knowledge Boosts Literacy and Learning appeared first on Education Next.

]]>

Illustration

Educators and researchers have been fighting the reading wars for the last century, with battles see-sawing literacy instruction in American schools from phonics to whole language and, most recently, back to phonics again. Policymakers have entered the fray, after more than a quarter-century of stagnant reading scores in the United States. Over the last decade, 32 states and the District of Columbia have adopted new “science of reading” laws that require schools to use curricula and instructional techniques that are deemed “evidence-based.”

Such reading programs include direct instruction in phonics and reading comprehension skills, such as finding the main idea of a paragraph, and efforts to accelerate learning tend to double down on more of the same skill-building practice. But research increasingly points to another critical aspect of literacy: the role of student knowledge. For example, prior research by two of us found that a young child’s knowledge of the social and physical world is a strong predictor of their academic success in elementary school. And advocates for knowledge-based education often cite the so-called “baseball study” where students reading a passage about baseball who knew about the sport were far better at understanding and summarizing the story than students who didn’t, regardless of their general reading skills.

Knowledge-building reading curricula are rooted in these insights, and use materials and activities based on a sequence of integrated science and social studies topics, texts, and vocabulary. Yet the potential value of this approach is often an afterthought in state and district efforts to strengthen reading instruction, and the benefits to students of combining evidence-based curriculum with systematic efforts to build student knowledge have yet to be rigorously documented.

We conduct the first-ever experimental study of this topic, based on randomized kindergarten-enrollment lotteries in nine Colorado charter schools that use an interdisciplinary knowledge-based curriculum called Core Knowledge. To assess the long-term impact of experiencing a knowledge-building curriulum on student learning, we compares performance on statewide tests in grades 3–6 between kindergarten lottery winners who attended a Core Knowledge charter school with lottery losers who could not enroll.

We find that winning an enrollment lottery and enrolling in a Core Knowledge charter school boosted long-term reading achievement in 3rd to 6th grade by 16 percentile points, as compared to comparable applicants who did not win their enrollment lottery. The size of this gain is approximately equivalent to the difference between the mediocre performance of U.S. 13-year-olds on the 2016 Progress in International Reading Literacy Study and that of top-scoring countries like Singapore and Finland. Our results are also notable in their contrast with other studies of reading interventions, which typically find small, short-term effects.

Students and teachers in many public elementary schools spend up to two hours each day on reading instruction. While the component skills of literacy are critical to student development and learning, our findings point to a missed opportunity to accelerate literacy by building knowledge at the same time. Skill building and knowledge accumulation are separate but complementary cognitive processes, and while the adage “skill begets skill” may be true, a fuller description of cognitive development could be “skill begets skill, knowledge begets knowledge, and skill combined with knowledge begets them both.”

Kindergarten Lotteries for “Core Knowledge” Charters

The Core Knowledge curriculum was created in the 1980s by E.D. Hirsch, Jr., a researcher and advocate of knowledge-building education. Its content and activities follow a planned sequence of the knowledge and skills students should accumulate and master in grades K–8 in all academic subjects and the arts. This “knowledge-based schooling” approach is rooted in the belief that a common base of shared knowledge is foundational for not just individual students’ reading comprehension abilities but also for our ability as a society to communicate and promote equal opportunity. An estimated 1,700 schools across the U.S. use the curriculum today, including more than 50 in Colorado.

To assess the impact of the Core Knowledge curriculum on student achievement, we look at nine oversubscribed Colorado charter schools that all use the curriculum, had been open for at least four years, and held random enrollment lotteries to register kindergarten students in either or both of the 2009–10 and 2010–11 school years. Our study includes 14 separate lotteries with 2,310 students, almost all of whom are from high- or middle-income families.

These families generally have a range of schooling options, including private schools, other charter schools, and public schools outside their district under Colorado’s open-enrollment law. About one in five students in our sample applied to multiple charter lotteries—usually two instead of one. Some 41 percent won at least one lottery, and 47 percent of winners enrolled in that school. In all, 475 lottery winners went on to attend a Core Knowledge charter, while 1,356 students did not win the lottery and attended school elsewhere. In analyzing the effects of attending a Core Knowledge charter, we take into account the fact that not all lottery winners actually enrolled.

Attrition and Family Choice

We base our analysis on the performance of lottery applicants on the Partnership for Assessment of Readiness for College and Careers (PARRC) reading and math tests in grades 3, 4, 5, and 6, as well as the 5th-grade science PARRC test. By looking at these scores, we can compare the performance of students who did and did not experience a knowledge-building curriculum over up to seven years of their schooling.

However, roughly 36 percent of students in our sample did not complete all scheduled PARCC tests through grade 6, and the attrition rate for students who did not win the enrollment lottery is 5 percentage points higher than for lottery winners. Detailed student data reveals three major factors at play. First, some students stop participating in Colorado’s PARCC testing because they move out of state, transfer to a different school, or are homeschooled. A second group of students don’t have test-score data because they are exempted as language learners or special-education students. Third, other students are off-track with their expected kindergarten cohort in later years because of delayed kindergarten entry (“redshirting”) or due to having skipped or repeated a grade.

To ensure that this attrition does not skew our results, we exclude from our analysis both the four lotteries with the highest rates of differential attrition between lottery winners and losers and the youngest applicants, who are more likely to be redshirted by their parents regardless of their lottery outcome. We also adjust our results for students’ gender, race or ethnicity, and eligibility for a free or reduced-price school lunch to ensure that any demographic differences between lottery winners and losers do not introduce bias.

Figure 1: Higher Achievement for Students at Core Knowledge Charter Schools

Accelerated Achievement

We find positive long-term effects on reading performance for students who are randomly selected by a kindergarten enrollment lottery and attend a Core Knowledge charter school. Across grades 3–6, these students score 47 percent of a standard deviation higher in reading than comparable lottery applicants who did not have a chance to enroll. This is equivalent to a gain of 16 percentile points for a typical student (see Figure 1). Students who attend a Core Knowledge charter also make outsized gains in science of 30 percent of a standard deviation, which is equivalent to a gain of 10 percentile points. Effects in math are positive, at about 16 percent of a standard deviation, but fall short of statistical significance.

Figure 2: Bigger Benefits for Females

The effects are slightly larger for female students than males (see Figure 2). In reading, female Core Knowledge charter students score 50 percent of a standard deviation higher compared to 44 percent for males, for a gain 17 of percentile points compared to 15 percentile points for males. Females gain about 12 percentile points in science and 9 percentile points in math, while males gain 6 percentile points in science and experience no gains in math. We also look at effects by student grade level and find no upward or downward trend, suggesting the effects may have stabilized by 4th grade (see Figure 3).

Figure 3: Effects on Reading by Student Grade

While prior non-experimental research has documented stronger reading performance among students who already have knowledge about a topic, our analysis shows positive long-term impacts in reading from systematically building student knowledge over time. In our view, these results suggest that the “procedural skills” approach that has dominated reading comprehension instruction over the last 30 years in public schools is less effective than a “knowledge-based” approach that teaches skills and also is designed to build a body of knowledge as the main mechanism for increasing comprehension.

These findings also build on the body of evidence linking students’ levels of general knowledge to achievement in reading, science, and math. Research also shows that levels of general knowledge are strongly correlated with socio-economic status and parental levels of education. However, unlike these factors, knowledge is malleable through curricular choices. The intervention we study, where students experience seven years of a knowledge-building curriculum, appears to set off a long-term, compounding process whereby improved reading comprehension leads to increased knowledge, and increased knowledge leads to even better comprehension.

A Call to Build Knowledge About “Knowledge”

In addition to informing current-day decision-making, we believe these results should inspire a new research and policy agenda to measure and track students’ knowledge development and understand the mechanisms involved in knowledge-building curricula. The effects our study finds are similar in pattern and magnitude to earlier non-experimental evidence, which suggests that gains in students’ general knowledge could have a larger effect on future achievement than similar gains in more widely studied non-cognitive domains, such as executive function, visual-spatial and fine motor skills, and social and emotional development.

The potential benefits of knowledge-building curricula could be far-reaching. The compounding process our analysis reveals would occur not only in reading, but also across all subjects to the extent that they depend primarily on reading comprehension for learning. Moreover, these achievement gains across all subjects would likely extend into future years, as increased comprehension in one year leads to increased knowledge and comprehension in the next, and so on. We believe that these curricula could also increase students’ educational attainment and future labor market success.

However, elevating student knowledge to a more central place and higher priority in research and policy will require a significant conceptual shift—the term “building knowledge” does not readily trigger a conceptual map linking the intervention to higher achievement, unlike common interventions like reducing class size, extending the school day, and raising teacher pay.

Well-designed measures of student knowledge should be considered as an important addition to other national measures for students in elementary grades. To be sure, they will carry an additional challenge. Any definition and measures of “general knowledge” will need both scientific validity and political viability at a moment when attempts to ban library books and shape course content are on the rise. Attempting to define what all public-school students should know will undoubtably trigger debates and a variety of viewpoints. However, the evidence points to building knowledge as a critical foundation of student literacy with potentially lifelong effects. The benefits of skillful reading and broad knowledge should be a shared starting point, from which a stronger approach to reading instruction can grow.

David Grissmer is research professor in the School of Education & Human Development at the University of Virginia, where Richard Buddin is education consultant, Jamie DeCoster and Tanya Evans are research assistant professors, and Chris S. Hulleman is research professor. Thomas G. White is a former senior researcher at the School of Education & Human Development. Daniel T. Willingham is professor of psychology at the University of Virginia. Chelsea A.K. Duran is a postdoctoral fellow at the Curry School of Education at the University of Virginia. Mark Berends is professor at the University of Notre Dame. William M. Murrah is associate professor at Auburn University.

This article appeared in the Spring 2024 issue of Education Next. Suggested citation format:

Grissmer, D., Buddin, R., Berends, M., White, T.G., Willingham, D.T., DeCoster, J., Duran, C.A.K., Hulleman, C.S., Murrah, W.M., and Evans, T. (2024). How Building Knowledge Boosts Literacy and Learning: First causal study finds outsized impacts at “Core Knowledge” schools. Education Next, 24(2), 52-57.

The post How Building Knowledge Boosts Literacy and Learning appeared first on Education Next.

]]>
49717868
Can Tracking Improve Learning? https://www.educationnext.org/tracking-improve-learning/ Fri, 11 Dec 2009 00:00:00 +0000 http://www.educationnext.org/tracking-improve-learning/ Evidence from Kenya

The post Can Tracking Improve Learning? appeared first on Education Next.

]]>
ednext_20093_64_openerTracking students into different classrooms according to their prior academic performance is controversial among both scholars and policymakers. If teachers find it easier to teach a homogeneous group of students, tracking could enhance school effectiveness and raise test scores of both low- and high-ability students. But if students benefit from learning with higher-achieving peers, tracking could disadvantage lower-achieving students, thereby exacerbating inequality.

Debates over tracking reached their high point in the United States in the 1990s. An influential report published in 1998 by the Thomas B. Fordham Foundation argued that the available research did not support the contention that tracking doomed impoverished students to inferior schooling, nor did it support universal adoption of the practice. Over the last decade, patterns in grouping students have changed markedly in the U.S.; high school students are no longer placed in rigidly defined general-education or noncollege tracks but have the flexibility to move between course levels for different subjects. These changes may have assuaged some critics, but the broader debate over tracking remains unsettled.

The central challenge in measuring the effect of tracking on performance is that schools that track students may be different in many respects from schools that do not. For example, they may attract a different pool of students and possibly a different pool of teachers. The ideal situation to assess the impact of tracking on test scores of different groups of students would be one in which students were assigned to tracking or nontracking schools randomly, and the performance of students could be compared across school types.

We shed light on these issues using data from Kenya. In 2005, each of 140 primary schools in western Kenya received funds from the nongovernmental organization International Child Support (ICS) Africa to hire an extra teacher. One hundred twenty-one of these schools had a single 1st-grade class and used the new teacher to split the students into two classes. In 61 randomly selected schools, students were assigned to classes based on prior achievement as measured by test scores. In the remaining 60 schools, students were randomly assigned to one of the two classes, without regard to their prior academic performance.

The results showed that all students benefited from tracking, including those who started out with low, average, and high achievement. At the tracking schools, the test scores of students who started out in the middle of their class do not seem to be affected by which section (top or bottom) the students were later assigned to. In other words, any negative effects of being with lower-achieving peers were more than offset in tracked settings by the benefit of the teacher being able to better tailor instruction to students’ needs.

Primary Education in Kenya

The Kenyan education system includes eight years of primary school and four years of secondary school. Like many other developing countries, Kenya has recently made rapid progress toward the goal of universal primary education. After the elimination of school fees in 2003, primary school enrollment rose nearly 30 percent, from 5.9 million in 2002 to 7.6 million in 2005. This is typical of what is happening in sub-Saharan Africa overall, where the number of new entrants to primary school increased by more than 30 percent between 1999 and 2004.

This progress creates its own new challenges, however. Pupil-teacher ratios have grown dramatically, particularly in lower grades. In our sample of schools in western Kenya, the median 1st-grade class in 2005 (after the introduction of free primary education, but before the class-size-reduction program we study here) had 74 students and the average class size was 83. These classes are heterogeneous in a number of ways: Students differ vastly in age, school readiness, and support at home. Many of the new students are first-generation learners and have not attended preschools, which are neither free nor compulsory in Kenya. These challenges are not unique to Kenya; they confront many developing countries where school enrollment has risen sharply in recent years. Understanding the roles of tracking and peer effects in this type of environment is thus critically important.

Our results are most likely to be directly applicable to settings where classes are large, the student population is heterogeneous, and few additional resources are available to teachers. It is unclear whether similar results would be obtained in different contexts, such as developed countries, where smaller class sizes may allow more tailored instruction even without tracking, and extra resources, such as remedial education, computer-assisted learning, and special education programs, may already provide tools to help teachers deal with different types of students.

Design of the Experiment

This study takes advantage of a class-size-reduction program and evaluation that involved primary schools in Bungoma and Butere-Mumias in Western Province, Kenya. Of 210 primary schools in these districts, 140 schools were randomly selected to participate in the Extra-Teacher Program. With funding from the World Bank, ICS Africa provided each of the 140 selected schools with funds to hire an additional 1st-grade teacher on a contractual basis starting in May 2005, the beginning of the second term of that school year. Most of the schools (121) had only one 1st-grade class, which was split into two classes when the new teacher was hired. The 19 schools that already had two or more 1st-grade classes added another class.

It is important to note that the incentives facing the newly hired teachers differed from those facing civil-service teachers already working in program schools. The new teachers had clear incentives to work hard to increase their chances of having their short-term contracts renewed and of eventually being hired as civil-service teachers—a desirable outcome in a society where government jobs are highly valued. In contrast, the difficulty of firing civil-service teachers implies that they had weak extrinsic incentives and may be more sensitive to factors affecting their intrinsic motivation.

Average class size was reduced from 84 to 46 students in the 140 schools that received funds for a new teacher. The program continued for 18 months, which included the last two terms of 2005 and the entire 2006 school year, and the same cohort of students remained enrolled in the program.

From the 121 schools that had originally only one 1st-grade class, 60 schools were randomly selected to assign students to one of the two classes by chance. We call these schools the “nontracking schools.” In the remaining 61 schools (the “tracking schools”), the children were divided into two sections according to their scores on exams administered by the school during the first term of the 2005 school year. The 50 percent of the class with the lowest exam scores were assigned to one section (the “bottom class”) and the rest were assigned to the other (the “top class”).

After students were assigned to classes, the contract teacher and the civil-service teacher were also randomly assigned to classes. In the second year of the program, all children not repeating the grade remained assigned to the same group of peers and the same teacher.

Data

Our initial sample consists of approximately 10,000 students enrolled in 1st grade in March 2005 in one of the 121 primary schools participating in the study. The outcome of interest is student academic achievement, as measured by scores on a standardized math and language test first administered in all schools 18 months after the start of the program. Trained proctors administered the test, which was then graded blindly by data processors. In each school, 60 students (30 per class) were drawn from the initial sample to participate in the tests. If a class had more than 30 students, students were randomly sampled.

The test was designed by a cognitive psychologist to measure a range of skills students may master by the end of 2nd grade. One part of the test was written and the other part oral, administered one-on-one. Students answered math and literacy questions ranging from counting and identifying letters to subtracting three-digit numbers and reading and understanding sentences.

To limit attrition from the experiment, proctors were instructed to go to the homes of sampled students who had dropped out or were absent on the day of the test and to bring them to school for the test. It was not always possible to find the child, however, and the resulting attrition rate on the test was 18 percent. However, there was no difference between tracking and nontracking schools in overall attrition rates. In total, we have postintervention test-score data for 5,796 students.

In addition, each school received unannounced visits several times during the course of the study. During these visits enumerators checked, upon arrival, whether teachers were present in school and whether they were in class and teaching, and then took a roll call of the students.

To measure whether the effects of the program persisted, the children who had been sampled for the first postintervention test were tested again in November 2007, one year after the program ended. During the 2007 school year, these students were overwhelmingly enrolled in grades for which their school had a single class, so tracking was no longer an option. Most of these students had reached 3rd grade by that time, but those repeating an earlier grade were also tested. The attrition rate for this portion of the experiment was 22 percent. Neither the proportion nor the characteristics of children who could not be tested differed between the tracking and nontracking schools.

The Impact of Tracking

We estimate the impact of tracking on student achievement by comparing the postintervention (18 months after the experiment began) test scores of students in the tracking and nontracking schools. Taking the average of students’ scores on math and literacy exams, we find that students in tracking schools scored 0.14 standard deviations higher than students in nontracking schools overall. When we adjust the comparison to take into account minor differences in student characteristics across the two groups of schools, the effect increases to 0.18 standard deviations. There was no significant difference between the impact of the program on math and literacy scores when we examined the subjects separately.

How large were these effects? A typical student with a literacy score one standard deviation above that of the average student could correctly spell 5.5 of 10 words included on the exam, while the average student could spell only two. Similarly, students with a math score one standard deviation above the average were able to perform single-digit multiplications, whereas those at the mean could not. The average effect of tracking was roughly one-fifth the size of these performance differences.

ednext_20093_64_fig1These gains persisted beyond the duration of the program (see Figure 1). When the program ended, most students had reached 3rd grade, and all but five schools had only one 3rd-grade class. The remaining students had repeated and were in 2nd grade where, once again, most schools had only one large class, since after the program ended they did not have funds for additional teachers. Even so, the test scores of students in tracking schools remained 0.16 standard deviations higher than those of students in nontracking schools overall (and 0.18 standard deviations higher with control variables). The persistence of the benefits of tracking is striking, as many evaluations find that the test-score effects of successful interventions fade over time. It seems that tracking helped students master core skills in 1st and 2nd grade that in turn helped improve their learning later on.

We also examine whether the effect of tracking differs between initially high-scoring students (who are grouped with other strong students in tracking schools) and initially low-scoring students (who are grouped with other low-scoring students in tracking schools). We find that both groups of students benefited from tracking, and by approximately the same amount. A year after the intervention ended, the effect persisted for both the top and bottom classes.

Tracking increases test scores for students taught by contract teachers. In fact, students initially scoring low who were assigned to contract teachers benefited even more from tracking than students who initially scored high. But students who initially scored low showed only a small and statistically insignificant benefit if assigned to a civil-service teacher. In contrast, tracking substantially increased scores for students who initially scored high and were assigned to a civil-service teacher. Below we discuss other evidence that tracking led civil-service teachers to increase effort when they were assigned to high-scoring students but not when assigned to low-scoring students.

Changes in Peer Achievement

Data from the tracking schools allow us to estimate the effect of being taught with a higher-achieving vs. lower-achieving peer group by comparing students with baseline test scores in the middle of the distribution. Because of the way tracking was done (splitting the grade into two classes at the median baseline test score), the two students closest to the median within each school were assigned to classes where the average prior achievement of their classmates was very different.

By comparing pairs of students right around the cutoff, we can estimate the effect of being the lowest-achieving child in the class compared to being the highest-achieving student in the class. We find that, despite the large gap in average peer achievement (1.6 standard deviations in baseline test scores) between the top and bottom classes, the students just below the cutoff have postintervention test scores similar to students just above the cutoff. Moreover, when we compare students around the cutoff at the tracking schools with students of similar ability at the nontracking schools, we find that students at the tracking schools score higher at the end of the intervention than the comparable students in the nontracking schools. These results imply that being the best student in a class of relatively weak students and being the worst student in a class of relatively strong students are both better than being the middle student in a heterogeneous class. This evidence suggests that students benefit from homogeneity because the teacher does not need to spend time addressing the needs of students performing at widely varying levels.

Learning from Peers vs. Learning from Teachers

We took a separate look at students in schools where students were not tracked but instead assigned to classes randomly. The random assignment of students and teachers within these schools made it possible to see whether and how peer achievement affected the performance of individual students when education took place in an untracked setting. We found that it did. If peer achievement was higher—0.10 standard deviations higher, to be exact—students learned 0.04 standard deviations more than they would have otherwise.

These results, taken together with those reported earlier, indicate that peer influence depends on whether or not classes are tracked. In untracked classes, where there is considerable heterogeneity of performance, students learn less if their peers are lower performing. At least in this particular setting, however, the homogeneous classes that are created by tracking seem to allow the teacher to deliver instruction at a level that reaches all students, thus offsetting the effect of having lower-performing peers. Interestingly, combining the direct effect of peer achievement with the fact that the median children in each school did not suffer from being assigned to the bottom track suggests that teachers focus their attention not on the median student in the class, but at students considerably above the median.

Why Did Tracking Work?

Two additional pieces of evidence shed light on the question of why tracking had such clear benefits. First, we look at teacher presence and effort. Do they spend more time in class and teaching? Then, we examine whether the test-score gains in tracking schools were concentrated among simpler or more complex tasks and whether this varied by students’ initial achievement levels. Our results confirm that students in tracked classes seem to have benefited from more-focused teaching and perhaps also from greater teacher effort.

ednext_20093_64_fig2Teacher absence is a major problem in Kenya, as in many developing countries. Only 59 percent of teachers were in class and teaching during unannounced visits to a comparable sample of schools that did not receive an additional teacher. Overall, teachers in tracking schools were 9.6 percentage points more likely to be found in school and teaching during random spot checks than their counterparts in nontracking schools, who were present and teaching only about half of the time. There were, however, large differences across teachers. The contract teachers were much more likely to be found in school and teaching (74 percent versus 45 percent for the civil-service teachers), and their absence rate was unaffected by tracking (see Figure 2). The civil-service teachers were 10 percentage points more likely to be in schools and teaching in tracking schools than in nontracking schools when they were assigned to the top class. This difference is statistically significant and amounts to a 25 percent increase in teaching time. However, the difference between tracking and nontracking school types was smaller and statistically insignificant for civil-service teachers assigned to the bottom classes.

These results suggest that teachers may be more motivated to teach a group of students with high initial scores than a group with low initial scores or a heterogeneous group. Recall that students assigned to the top class with a civil-service teacher benefited more from tracking than those assigned to the bottom class with a civil-service teacher. Increased teacher effort may help explain this pattern.

Another hypothesis consistent with both the tracking results and the effects from random peer assignment is that tracking by initial achievement improves student learning because it allows teachers to focus instruction. Teaching a more homogeneous group of students might allow teachers to adjust the material covered and the pace of instruction to students’ needs. For example, a teacher might begin with more basic material and instruct at a slower pace, providing more repetition and reinforcement, when students are initially less prepared. With a group of initially higher-achieving students, the teacher can increase the complexity of the tasks and pupils can learn at a faster pace. With a heterogeneous group, they may be compelled to cover both simple and advanced material, spending less time on each, which would hurt all students.

One way to examine this is to see whether children with different initial achievement levels gained from tracking differentially in terms of the difficulty of the material that they learned. While the results for language are mixed, the estimates for math suggest that, although the total effect of tracking on children in the bottom class is significantly positive for all levels of difficulty, these children gained from tracking more than other students on the easier questions and less on the more-difficult questions. Conversely, students assigned to the top class benefited less on the easier questions, and more on the more-difficult questions. In fact, they did not significantly benefit from tracking for the easier questions, but they did significantly benefit from it for the more-difficult questions. These results suggest that tracking helped by giving teachers the opportunity to focus on the competencies that children were not mastering.

Conclusion

A central challenge of education systems in developing countries—the context for which our results are most relevant—is that students in the same grades and classrooms are extremely diverse. Our results show that grouping students by preparedness or prior achievement and focusing the teaching material at the most appropriate level could potentially have large positive effects with little or no additional resource cost. One could also target more resources to the weaker group, further helping them to catch up with their more-advanced counterparts. It is often suggested that there is a trade-off between the value of targeting resources to weaker students, and the costs imposed on them by separating them from stronger students. We find no evidence for such a trade-off in this context.

Our results may also have implications for debates over school choice and voucher systems. A common criticism of such programs is that they may hurt some students if they lead to increased sorting of students by initial achievement and if all students benefit from having peers with higher initial achievement. If tracking is indeed beneficial, this is less of a concern.

Esther Duflo is professor of economics at the Massachusetts Institute of Technology. Pascaline Dupas is assistant professor of economics at University of California, Los Angeles. Michael Kremer is professor of economics at Harvard University.

The post Can Tracking Improve Learning? appeared first on Education Next.

]]>
49694842
Return of the Thought Police? https://www.educationnext.org/return-of-the-thought-police/ Tue, 01 Dec 2009 00:00:00 +0000 http://www.educationnext.org/return-of-the-thought-police/ The history of teacher attitude adjustment

The post Return of the Thought Police? appeared first on Education Next.

]]>
ednext_20072_60_1_openingImgCollege campus battles over academic freedom and free speech have become a media staple. One widely publicized 2004 case concerned Ed Swan, an education student at Washington State University (WSU), who openly espoused conservative views, including opposition to affirmative action and permitting gays to adopt. The school’s “professional disposition evaluation” required that students demonstrate, along with a professional demeanor, written communication, and problem-solving and critical-thinking skills, an “understanding of the complexities of race, power, gender, class, sexual orientation and privilege in American society.”

Refusing to consent to the underlying ideology, Swan failed repeatedly. The college threatened to expel him from the teacher training program unless he signed a contract agreeing to undergo diversity training and accept extra scrutiny of his student teaching. After a national civil-liberties group intervened on his behalf, Swan was allowed to continue in the program, and WSU has since revised its evaluation form. The new version requires professors to evaluate students’ “willingness to consider multiple perspectives on social and institutional factors that can impede or enhance students’ learning.” Dean of Education Judy Mitchell explained, “We’ve changed the format and clarified the words, but we haven’t changed the standards.”

Advocates of dispositions assessments of the kind in place at WSU defend the screening of pre-service teachers, whether at program entry or later on in the certification process, as standard practice and argue that “dispositions” are merely those attitudes and behaviors necessary to successful teaching. Critics see the combination of program accreditation standards, revised by the National Council for Accreditation of Teacher Education (NCATE) in 2000; a growing curricular emphasis on “social justice” issues; and a left-leaning education professoriate as yielding a one-sided approach to teacher education and the certification of teachers based on ideology, rather than teaching skills or mastery of content knowledge.

As a historian, I am most struck by the parallels between the dispositions assessments of today’s aspiring teachers and the evaluations of teachers’ mental hygiene and personality that began in the 1940s and continued for two decades. As is the case today, from 1940 to 1960 teacher educators sought to protect the interests of schoolchildren by socially engineering “desirable” characteristics in their teachers. What have changed are the personal qualities deemed most important for success in the classroom.

Assessing Teacher Dispositions

What is the purpose of dispositions assessment? What entity or body is in the best position to make this assessment? If the purpose is to ensure that access to children is denied to those who are truly deviant (sexual predators) or those who could harm children (drug dealers, felony offenders, child abusers), then it seems the assessment is best made by the government, which has the resources and responsibility to identify these people. If the purpose is to ensure that potential teachers have basic characteristics like honesty or fairness, existing standards such as university honor codes in higher education should suffice. If the purpose is to see how a teacher acts in a certain environment (be it an urban, suburban, or rural school, with a diverse or homogeneous student body), then perhaps those in that environment can best perform that assessment, taking into account the standards, mores, and preferences of the community. The ultimate employers of teachers, local school districts, can and do screen for the characteristics they want in their employees. Why, then, is it also necessary for teacher educators to assess the personal and political beliefs of aspiring teachers? Perhaps the policing of teacher personality and dispositions is just a way for teacher educators to extend their control even further into the public school classroom.

The harshest critics of dispositions assessment accuse education schools of acting as ideological gatekeepers to employment in public schools. Indeed, web site after web site shows schools of education that list among their teacher-education program goals the inculcation of political views alongside intellectual curiosity and such work habits as punctuality. The University of Alabama’s College of Education is “committed to preparing individuals to promote social justice, to be change agents, and to recognize individual and institutional racism, sexism, homophobia, and classism.…” In the teacher education program at the Harvard Graduate School of Education, students are asked to  “act as leaders and agents for organizational change in their classrooms, schools, and society…continually examine their own identities, biases, and social locations, seeking knowledge of students’ cultures and communities, and pursuing a complex understanding of societal inequities as mediated through classism, heterosexism, racism, and other systems of advantage.” Some program descriptions explain that requiring awareness of these issues and a commitment to addressing them ensures teachers will teach all children. In an October 2006 letter defending the conceptual framework of Teachers College, Columbia University, against accusations of political screening, President Susan H. Furhman wrote, “We believe that responsiveness to the diversity of students’ backgrounds and previous experiences are [sic] essential for effective teaching” (see Figure 1).

ednext_20072_60_2_fig1

Not all universities make the leap from classroom behavior to ideology: The “Teacher Education Professional Dispositions and Skills Criteria” at Winthrop University in South Carolina are only basic indicators of professional commitment, communication skills, interpersonal skills (among them, “Shows sensitivity to all students and is committed to teaching all students”), emotional maturity, and academic integrity; acknowledging social inequities is not mentioned. The difficulty, however, in assessing dispositions, whether they espouse social justice or are seemingly harmless as at Winthrop, arises when the assessors make value judgments rather than encourage academic freedom and respect freedom of conscience. As the Swan case at Washington State University shows, some teacher education programs clearly demand allegiance to a particular perspective on the politics of education.

If schools encourage students to respond honestly to teacher education assignments, and then use any responses that differ from accepted beliefs as grounds for dismissal, that is political screening and a clear denial of academic freedom. A student accused Le Moyne College, a private, Jesuit-run school, of doing just that. In 2004, administrators dismissed the politically conservative graduate student after he wrote a paper on classroom management that questioned the value of multicultural education and expressed limited support for the use of corporal punishment in the classroom. At the Brooklyn College School of Education, some students complained after a teacher showed the Michael Moore film Fahrenheit 9/11 on the day before the 2004 presidential election. The university asked one student to leave, accused two others of plagiarism, and then denied the two students the right to bring a witness or an attorney to their hearing. K. C. Johnson, a faculty member who questioned the accusation of plagiarism and defended the students in Inside Higher Ed, then faced possible investigation by the university. The hallmarks of a professional program of teacher preparation within a university should be the free exploration of ideas. Yet it seems some teacher preparation programs substitute professional socialization, and the political conformity it requires, for a commitment to academic freedom.

The controversy over political screening of prospective teachers by teacher educators came to a head at the June 2006 reauthorization hearing for the National Council for Accreditation of Teacher Education (NCATE) with the U.S. Department of Education. Within the list of dispositions aspiring teachers might be required to possess, the agency had included “social justice,” a phrase that, to many, signals a value-laden ideology. Under pressure from a number of groups, NCATE president Arthur Wise announced that the agency would drop “social justice” from its accreditation standards; he maintains that social justice was never a required disposition.

NCATE’s definition of “dispositions” and its inclusion of social justice as part of that definition had caused considerable consternation. Among the groups represented at the hearing were the National Association of Scholars, which had filed the complaint, and the Foundation for Individual Rights in Education (FIRE), founded and headed by civil libertarians Alan Charles Kors, professor of history at the University of Pennsylvania, and Harvey Silverglate, a criminal defense attorney. FIRE, an organization dedicated to the preservation of free speech, has accused a number of universities, including Washington State University on behalf of Edward Swan, of evaluating students on the basis of their political views and thereby violating their First Amendment rights.

Arthur Wise has staked out NCATE’s position that dispositions are only “commonsense expectations” for teacher behavior and insists that the accrediting agency does not condone the evaluation of attitudes. Whether or not that is the case, most teacher education programs in this country receive accreditation from NCATE and follow its lead. Even though NCATE has now dropped “social justice” as a disposition, the agency stands behind dispositions assessment and institutions’ use of “social justice” as a curricular theme. The phrase appears in countless teacher-preparation program and course descriptions. Critics are not hopeful that NCATE’s action will curb abuses. In her testimony at the NCATE hearing, American Council of Trustees and Alumni president Anne D. Neal asked that the agency’s reauthorization be denied “until it affirmatively makes clear that teacher preparation programs are not expected to judge the values and political beliefs of teacher candidates and asks that its members review and revise their standards accordingly.”

Judging Fitness Is Nothing New

Society has long been concerned with the behavior, both inside and outside of the classroom, and the character of public school teachers. A century ago, local school boards carefully selected school teachers they deemed “fit to teach,” whose behavior comported with community values. They could not smoke or drink. Female teachers could not socialize with men while unchaperoned. They could not marry. They were not to display or engage in behaviors considered deviant, such as lesbianism. They were to dress conservatively and attend church. Violation could cost a teacher her job.

School officials and boards also scrutinized teachers’ political views. During World War I, the superintendent of the Cleveland public schools suggested firing those teachers sympathetic to Germany, and anti-war teachers did lose their jobs in New York City. In the 1920s and 1930s, more than a dozen states, typically those in which there were anti-communist crusades, required teachers to take loyalty oaths.

In public-school classrooms, as educational progressivism steadily gained influence during the first half of the 20th century, the focus in classrooms gradually shifted from rigorous academic study and discipline to children’s personality development and mental health. Education historian Sol Cohen describes the “medicalization” of education as the “infiltration of psychiatric norms, concepts and categories of discourse” into American education. Cohen reports that by 1950, there was “a national consensus on the role of personality development in American education” and that this included the view that “the school is basically an institution to develop children’s personality and that personality development of children should take priority over any other school objective.”

Attention turned as well toward the “mental hygiene” of the teacher, whose actions and attitudes would no doubt influence the children in her charge. As Douglas Spencer, instructor of psychological counseling at Teachers College, Columbia University, wrote in 1938, the teacher was to “demonstrate in her own personality adjustment sound mental health and emotional maturity.” As the 1940s began, a growing chorus of educators called for teacher qualification and selection to be based on mental health, first and foremost, and many expected this to be achieved through the teacher education process. However, market pressures on teacher education institutions made this problematic. Government policies provided tax funds for training teachers through the publicly supported teachers colleges, which did not have selective admissions requirements. Meanwhile, the number of both school-age children and college attendees grew steadily, with more than one-quarter of college degrees being granted in the field of education.

The rapid expansion of the teaching workforce hindered efforts to select teachers on mental hygienic grounds, even before the teacher shortage that developed in the 1950s. Reports of teachers with mental disturbances and even mental illnesses made professional and public headlines throughout the 1940s and 1950s. Public concern grew about maladjusted or neurotic teachers and their inability to ensure the proper psychological development of the children under their tutelage. Some feared that, as with contagious disease, psychological disorders would spread from teacher to child. Various personality traits of the maladjusted teacher emerged in the literature of the time. Shy, nervous, timid, easily excitable, disorganized, irresponsible, introverted, sexually repressed, or hot-tempered teachers were considered unfit for the classroom. A 1961 text, The Mentally Disturbed Teacher, documented purportedly true incidents about such teachers, suggesting that teachers who used corporal punishment could be mentally ill or that irritability in a teacher may be a sign of alcoholism, to take two examples. One suggestion for improving the mental health of the teaching body was for schools to keep a record of the teacher’s “attainments and attitudes,” including her cultural background and her community leadership.

As early as the 1940s, teacher education institutions began to use rating scales, placement tests, and personal interviews as screening devices for measuring mental hygiene and teacher personality. For some assessments, candidates filled out questionnaires; for others, faculty, administrators, or psychologists observed the teacher and made judgments. The University of Utah required teacher candidates to take the Minnesota Multiphasic Personality Inventory and the Strong Vocational Interest Blank. The College of Education at the State College of Washington used the Minnesota Teacher Attitude Inventory. Still other institutions employed a variety of assessment measures, such as the Rorschach test, James Cattell’s 16 Factor Personality test, the Guilford-Zimmerman Temperament Survey, the Thurstone Temperament Schedule, and a host of other batteries designed to explore the teacher’s behavior, personality, and attitude.

In 1953, Ruth A. Stout, director of field programs at Kansas State Teachers Association and later professor of education at Teachers College, Columbia University, completed a comprehensive study of admission practices in teacher education institutions. Stout surveyed 785 of 865 accredited teacher-training schools and found that a majority identified emotional stability as being of primary importance and that approximately 45 percent actually assessed students’ emotional stability, identifying it as the second most important criterion for determining fitness for teaching, behind academic credentials. Assessment of emotional stability became more important, Stout reported, as students progressed through their teaching preparation, with more institutions using it to determine admission to student teaching than to the teacher education program.

Research on Teacher Personality

Experimental and statistical research on personality development exploded onto the 1940s education scene, replacing earlier anecdotal surveys. The Journal of Experimental Education and the Journal of Educational Research published much of this research, which used psychological or personality indexes to “scientifically” determine the relationship between personality and “good teaching.” The ultimate goal was to connect personal traits with teaching effectiveness, thus enabling better selection of teacher candidates. Sometimes, researchers measured teacher success based on the observation of classroom supervisors. At other times, they used data on students’ class rank, college grades, or other measures of student performance.

The results of the research were as diverse as the assessment instruments used. Some found good teachers were more gregarious, adventurous, frivolous, artistic, polished, cheerful, kind, and interested in the opposite sex than teachers rated poorer in performance. Others found good teachers to be those whose attitudes were positive toward children and administrators. A few studies that tried to correlate teacher factors (both intelligence and personality) with effectiveness found teaching too complex to be influenced by any one or two factors. Nonetheless, institutions pushed forward with the use of personality tests to select among teacher candidates, often using multiple indexes, even as critics warned that some instruments had low predictive validity, that there was inconsistency in results, or that the lack of replication warranted cautious use.

In a 1956 review of the research on “School Personnel and Mental Health,” J. T. Hunt, a professor at the University of North Carolina, noted that “efforts to identify personality differences between superior and inferior school personnel, to isolate a ‘teacher personality,’ or to predict either competence or effectiveness of student teachers by means of psychometric or projective instruments, led to limited results.” Unlike most of the research he reviewed, Hunt recognized that personality was not a monolithic attribute, as there were many kinds and types of teacher personalities and roles. More presciently, Hunt called for research that would consider the “varying value standards of judges.” “Very little attention seems to have been paid,” he concluded, “to the actual attitudes and expectations of persons” who assess teachers. He called for research that placed university administrators under the personality microscope.

University of Chicago professors Jacob Warren Getzels and P. W. Jackson in 1960 followed Berkeley professor Fred Tyler’s lead in arguing that no consensus existed among researchers, and presumably educators generally, as to what was considered good teaching. Getzels and Jackson pointed out that the authoritarian teaching style considered “good” at the end of the 19th century had given way to the personal style brought into vogue with progressive education, which would in time give way to another. Without definitive criteria for good teaching, the personality indexes used in teacher personality research had no validity. The tests, they claimed, were chosen for “irrelevant reason” or for “no apparent reason at all.” Thus, the entire design of research on teacher personality was flawed.

Mental Hygiene as Curriculum

The mental hygiene perspective nonetheless held sway throughout the 1950s, and the concept of personality became as important in teacher education as academic and technical preparation for the classroom—as important as content knowledge and skills. The separation of the teacher into “technician” and “personality,” a distinction noted by mental hygienist Harry Rivlin in 1955, required that teacher education prepare students along both lines. Teacher educators often prioritized personality over other aspects of a teacher’s abilities.

In 1955, Percival Symonds, professor at Teachers College, Columbia University, where he taught mental hygiene, headed a study publicized by the Council for Research in the Social Sciences of Columbia University. His study recommended “a change in emphasis in teacher-training from intellectual courses to experiences for the better personal adjustment of teachers.” For a decade, Symonds had promoted the inclusion of psychotherapeutic principles and methods in the mental hygienic treatment of teacher maladjustment. He used psychotherapy in his classes; his students wrote autobiographies and he analyzed them. As he noted in a Newsweek article, he “first gained the pupil’s confidence to a point where they would feel free enough to drag all the family skeletons out of the closet”; of course, he found maladjustment everywhere. According to a 1955 Education article by Leon Mones, then an assistant superintendent in Newark, New Jersey, and a former principal, Symonds and others were openly advocating that the emotional life of the teacher become the focus of teacher preparation, since “it is the teacher’s personality that is the tool with which he works rather than the content in which he gives instruction.”

Educational psychology courses aimed at understanding children were standard fare for teacher preparation in the 1920s. But even by the mid-1940s, the goal of psychology coursework had become the teacher’s own mental health. Bank Street College of Education in New York, San Francisco State College, the University of Texas, and the University of Wisconsin incorporated lectures on mental health with “psychiatrically supervised individual guidance” of pre-service teachers. The experimental use of psychoanalysis in teacher education even received funding from the National Institute of Mental Health.

At Bank Street College, teacher educator and director of research Barbara Biber extolled the virtues of a program that applied “the concept of the unified nature of cognitive and affective development…on the teacher-training level” and was based on “a process of integrating new knowledge with an old self.” Bank Street faculty members looked for certain dispositions in their candidates: relatedness to children, an orientation to the psychology of growth, their relation to authority, their emotional strength, and their motivation. The Institute for Child Study at the University of Maryland emphasized the ideal of the “self-actualized individual” in its graduate-level instruction. A human relations seminar at the Merrill-Palmer School aimed “to help the individual teacher express and explore the values, meanings, and dynamics of personal and professional experiences, to achieve self-awareness, and to develop sensitive, understanding, responsive attitudes.”

Still, psychiatrists reported that teachers, especially novices, did not know how to handle their negative feelings. I. N. Berlin, a professor of psychiatry and psychiatric consultant to school districts in San Francisco, San Joaquin County, and Stockton, California, argued that some mental pathologies that were causal factors in teacher maladjustment and ineffectiveness in the classroom were, unfortunately, exacerbated rather than alleviated by teacher education. Berlin’s criticism of teacher training reflected the belief of some psychiatrists that there were limits to teacher education’s ability to ensure mentally healthy teachers.

Learning from History

The screening of prospective teachers for maladjustment 50 years ago and the dispositions assessments going on today have remarkable similarities. As William Damon of Stanford has noted, dispositions assessment “opens virtually all of a candidate’s thoughts and actions to scrutiny…[and] brings under the examiner’s purview a key element of the candidate’s very personality.” The same underlying assumption—that scientific means of selection and training could guarantee good teachers—held sway at mid-century with respect to mental hygiene. Teacher educators who guarded entry to the profession used the techniques of science to study, measure, and evaluate the teacher candidate as do those who guard entry today. Only the specific values and attitudes they appraise have changed. Advocates of dispositions assessment claim that their methods are “standards-based” and provide “accountability” —scientific-sounding catchwords that hold considerable weight in the current political climate. Both sets of desirable characteristics—summed up in the terms mental hygiene and social justice—are tied to progressivism and appear as core components of the teacher preparation curriculum, with the effect of deemphasizing academic knowledge, or at least requiring subject-matter learning and even pedagogy to make room for them. And hard evidence was and still is lacking. Researchers could never link with any certainty particular personality traits with effective teaching. Nor, as Frederick Hess explains, is there any scientific evidence that requiring teachers to have certain views about “sexuality or social class” ensures that they teach all students: “Screening on ‘dispositions’ serves primarily to cloak academia’s biases in the garb of professional necessity.”

The history of teacher screening reveals how deeply rooted such practices are in American teacher education. Whether the standard is mental hygiene or possessing the proper political and ideological disposition, the elimination of candidates who do not pass muster gives teacher educators the power to determine who gains access to a classroom based on the values the teacher educators prefer. While the courts have permitted certifying agencies to require “good moral character” of teacher applicants, as legal scholars Martha McCarthy and Nelda Cambron-McCabe note, they “will intervene…if statutory or constitutional rights are abridged.” Thus, while pledging loyalty to federal and state constitutions is a permissible condition for obtaining a teacher license, swearing an oath to progressivism is not. Given the evidence and the history, there should be real concern, as teacher educator Gary Galluzzo has said, that “students’ views and personalities are being used against them” whenever dispositions are assessed. Those committed to academic freedom within higher education should be concerned when professional socialization trumps freedom of conscience in teacher education programs.

Laurie Moses Hines is assistant professor at Kent State University Trumbull campus, where she teaches in the Cultural Foundations of Education program and in the history department.

The post Return of the Thought Police? appeared first on Education Next.

]]>
49696231