Vol. 10, No. 3 - Education Next https://www.educationnext.org/journal/vol-10-no-03/ A Journal of Opinion and Research About Education Policy Tue, 09 Jan 2024 19:31:38 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.5 https://i0.wp.com/www.educationnext.org/wp-content/uploads/2019/12/e-logo.png?fit=32%2C32&ssl=1 Vol. 10, No. 3 - Education Next https://www.educationnext.org/journal/vol-10-no-03/ 32 32 181792879 No Federal Case https://www.educationnext.org/no-federal-case/ Tue, 25 May 2010 00:00:00 +0000 http://www.educationnext.org/no-federal-case/ Court says charter school is not a state actor

The post No Federal Case appeared first on Education Next.

]]>
Teachers and students in public schools who believe that they have been deprived of a right guaranteed by the U. S. Constitution or laws can take their claims to a federal court. Not infrequently they do, to the consternation of school boards and administrators. Whether teachers and students in charter schools have a comparable right can be a tricky legal question, as a recent decision from the Ninth Circuit Court of Appeals shows.

Charter schools are created under state statutes, but they often retain a private character. Can they qualify as “state actors” for a plaintiff’s purpose of using Section 1983 of Title 42 of the U. S. Code, which is the main gateway for achieving relief? In the case from Arizona that the Ninth Circuit decided, the answer was no, and the claims of the plaintiff were dismissed.

The plaintiff, Michael Caviness, had been employed for six years as a teacher of health and physical education and a track coach at Horizon Community Learning Center, a nonprofit corporation that operated a charter school in Phoenix. A female student filed a grievance charging that he had crossed “the student-teacher boundary.” At a hearing, Horizon’s governing board learned that the student had a “crush” on Caviness and that the two had been communicating by telephone. The board concluded that he had exercised questionable judgment and kept him on paid administrative leave until his contract expired. When he applied for a job in the Mesa Public Schools, Horizon’s executive director declined to evaluate him, and Caviness claimed that what the director said to Mesa was “purposely false and incomplete” and intended to harm him. He further claimed that some Horizon employees had defamed him by falsely calling him a pedophile.

Caviness filed a complaint under Section 1983 alleging that Horizon had, without due process, deprived him of his liberty interest in finding work, in that it had not granted him a hearing to clear his name. To establish that the school was a “state actor,” he made five arguments: that Arizona law defines a charter school as a public school; that a charter school is a state actor for all purposes, including employment; that a charter school provides a public education, a function that is traditionally and exclusively the prerogative of the state; that a charter school is a state actor in Arizona because the state regulates the personnel matters of such schools; and that it is a state actor because charter schools, unlike traditional private schools, are permitted to participate in the state’s retirement system.

The district court granted Horizon’s petition for dismissal for lack of federal jurisdiction. It found no evidence “with respect to [Caviness’s] specific employment claims, that Horizon acted in concert or conspired with state actors, was subject to government coercion or encouragement, or was otherwise entwined or controlled by an agency of the State.”

Three circuit judges concurred that the actions that Horizon took or failed to take were all connected with its role as Caviness’s employer, and that what it did as such did not constitute “state action.” State action, it said, “may be found if, though only if, there is such a close nexus between the State and the challenged action that seemingly private behavior may be fairly treated as that of the State itself.”

Caviness failed because he did not establish the close nexus. It was not enough to argue that under Arizona law all charter schools are state actors. Without facts to show that Horizon was acting as “the government,” Caviness had no federal case.

While the Caviness case could be a harbinger of more cases to come, we would be surprised to see federal litigation lead to a broad characterization of charters as private actors. Charters will likely increase in both number and federal financial support under President Obama, and with federal aid comes the force of laws emphasizing charter schools’ public character. Charters are explicitly obliged to abide by federal statutes prohibiting discrimination, for example. And while no federal law applies, the Department of Education’s guidance has made clear that charter schools must be nonreligious as well. Balking at either constraint would put charters at risk of losing not only federal aid but also their status as public schools, which has been critical to the charter movement’s success.

Joshua Dunn is associate professor of political science at the University of Colorado–Colorado Springs. Martha Derthick is professor emerita of government at the University of Virginia.

The post No Federal Case appeared first on Education Next.

]]>
49697400
An Effective Teacher in Every Classroom https://www.educationnext.org/an-effective-teacher-in-every-classroom/ Sat, 22 May 2010 00:00:00 +0000 http://www.educationnext.org/an-effective-teacher-in-every-classroom/ A lofty goal, but how to do it?

The post An Effective Teacher in Every Classroom appeared first on Education Next.

]]>
Proposals to reauthorize No Child Left Behind seek to ensure “equitable” access to effective teachers. The U.S. Department of Education’s Race to the Top fund rewards state plans for “ensuring equitable distribution of effective teachers and principals” and for “ambitious yet achievable annual targets to increase the number and percentage of highly effective teachers…in high-poverty schools.” These objectives pose a number of challenging questions. How readily can we identify effective teachers? And, perhaps most crucially, what are promising strategies for seeking to increase the number of effective teachers in high-poverty schools and communities? Addressing these questions are two of the leading authorities on the topic: Education Trust chief Kati Haycock and Stanford University and Hoover Institution economist Eric Hanushek.

Education Next: What is the evidence that inner-city schools are shortchanged on high-quality teachers?

Eric Hanushek: Inner-city schools and especially those serving the most disadvantaged students routinely display unacceptable achievement levels, ones that seal their students off from further education and from good jobs. Coupled with the general finding that effective teachers are the key to a high-quality school, it is natural to infer that the children most in need are systematically getting the poorest teachers.

Unfortunately, direct evidence on the distribution of teacher quality and its impact for disadvantaged students is hard to come by. Researcher Marguerite Roza and others have produced considerable evidence that teachers in schools serving the most-disadvantaged students have lower average salaries, reflecting in large part the movement of more-experienced teachers away from schools with a higher proportion of minority students and with lower-achieving students. There is also evidence that these schools tend to have more teachers with emergency credentials and without regular certification, although this appears to be declining over time. The problem is that these readily measured attributes of teachers have virtually nothing to do with teacher effectiveness.

Extensive research on teacher quality by me and others suggests that the only attribute of teacher effectiveness that stands out is being a rookie teacher. Teachers in their first three years do a less satisfactory job than they will with more experience. And this has an impact on schools serving highly disadvantaged populations, because the more-experienced teachers who leave these schools are generally replaced with new teachers. The net impact of this on disadvantaged schools is unclear, because there is also some evidence that the experienced teachers who leave these schools are on average not their most effective teachers.

Kati Haycock: No matter what measure of “quality” you look at, poor and minority students—and not just those in inner-city schools—are much less likely to be assigned better-qualified and more-effective teachers. Core academic classes in high-poverty secondary schools are twice as likely as those in low-poverty schools to be taught by a teacher with neither a major nor certification in the subject. The percentage of first-year teachers at high-minority schools is almost twice as high as the percentage of such teachers at low-minority schools. The list of disgraceful statistics goes on and on.

Even if we dismiss traditional measures as imperfect gauges of true teaching quality, new studies employing more-sophisticated measures reveal the same inequitable patterns. When the Tennessee Department of Education analyzed the state’s Value-Added Assessment System—which measures the impact of individual teachers on their students’ tested academic growth—it found that “low-income and minority children have the least access to the state’s most effective teachers and more access to the state’s least effective teachers.” Recently, researchers at the University of Virginia studying teaching practices and learning climate in more than 800 1st-grade classrooms were dismayed to find that lower-income and nonwhite students are much more likely than their counterparts to be placed in “lower overall quality classrooms.”

We also have clear evidence of just how damaging those inequities are. An analysis of data from Los Angeles found that the impact of individual teachers is so great that providing top-quartile teachers rather than bottom-quartile teachers for four years in a row would be enough to completely close the achievement gap between white and African American students. In fact, attending to this problem is the most important step policymakers can take to address the nation’s long-standing achievement gaps.

EN: Can we get higher-quality teachers to inner-city schools? What strategies are most likely to work? Regulation or incentives?

EH: Historically, the first policy response has been to try writing regulations. When these don’t work, the next response is generally to fine-tune the regulations. Developing regulations that ensure that local districts take appropriate action to deal with the teacher quality problem is not likely to be very successful. First, regulations work best when it is possible to measure precisely the underlying attributes that are important to success. Extensive research shows that commonly measured attributes of teachers, such as more than three or four years of experience, master’s degrees, and even state certification, are not related to effectiveness. In fact, all of the regulations that go into defining what is needed to be a fully credentialed teacher neither screen out bad teachers nor ensure that credentialed teachers are any more effective then uncredentialed teachers. Second, many union contracts in effect in inner cities vest rights to fill any teaching vacancies with senior teachers. New or reworked regulations would have to deal with collectively bargained teacher agreements.

An incentive approach must be the centerpiece of improving teacher quality in urban schools and in the most disadvantaged schools. It is necessary to reward success rather than try to regulate it. Unfortunately, we have little experience with how to structure incentives. Attempts to devise universal incentives from Washington or from state capitols are likely to be quite inefficient if not harmful.

Providing strong incentives is increasingly possible, however, as we develop better information linking teachers to student achievement, but incentives linked to so-called value-added measures are likely to be a small part of the overall answer. We need to refine the evaluation of teacher effectiveness, and we need to introduce the serious use of evaluations into the schools, evaluations that guide tenure, retention, and pay decisions.

Research that Steve Rivkin and I have done indicates that the largest variations in teacher quality are found within the typical school, and that quality variation between schools is considerably smaller than that found in any given school, including high-poverty schools. The policy implication of this is quite clear. It is not a matter of trying to swap all of the teachers in high-poverty schools with those in suburban schools. It is very much a matter of focusing on student achievement gains and of keeping those teachers who do a good job while eliminating those who are inept. For this, it is more a matter of will, combined with eliminating the rigidities that have been built into teachers’ contracts.

KH: We know it is possible to bring high-quality teachers into urban schools from recent efforts in New York City and other districts. The question is whether we will do what is necessary to provide low-income and minority students with the kind of powerful teaching they need and deserve. To solve the problem on a large scale, policymakers will need to think beyond simplistic, false dichotomies like “regulation or incentives” and embrace a robust combination of broad reforms coupled with targeted interventions.

First, we should press forward with efforts to provide education leaders with more sophisticated information on teacher effectiveness, to both maximize the impact of strategies that address distribution and to ensure cost efficiency. Education leaders need to be able to identify the strongest teachers in order to recruit and retain them, and assign them to the students who need their expertise the most. Similarly, they need to be able to identify weaker teachers in order to get them the support they need to join the ranks of effective teachers or to move them out of classrooms if they cannot improve. That is why the Obama administration is using the American Recovery and Reinvestment Act to insist that states tear down the “walls” that prevent them from linking teacher and student data and come clean on teacher evaluation systems that rate all teachers “satisfactory.”

But it will take time to develop richer and more sophisticated measures of true effectiveness. Until then, policymakers should use a combination of the best available measures to analyze teacher distribution, report on it, and act to increase equity. A study in North Carolina found that having teachers with a combination of characteristics and credentials can more than offset the gap in annual learning gains between African American students whose parents did not go to college and white students whose parents did. We need to act on the information we have available, even while we work to create more sophisticated measures.

Next, we need new policies that empower local superintendents and principals to use that information to better recruit and distribute highly effective teachers. Districts can move up timelines for teacher resignations and transfers and give principals in hard-to-staff schools first dibs on new entrants and transfers. States and districts can establish a policy of “mutual consent” that gives principals the right to choose their own teachers. States can take actions to pump up the supply of stronger teachers by using data on the effectiveness of graduates to improve teacher training programs, expanding those that produce strong teachers and shrinking or closing those that do not. States and districts can eliminate seniority-based layoffs, which should consider effectiveness instead, and make it easier to transfer or remove ineffective teachers who cannot improve.

Finally, policymakers need to make these schools much more attractive places to work, including but not limited to improving financial compensation. Effective teachers who choose to work in the most challenging schools often sacrifice pay and professional status. State leaders should reverse that relationship, offering such teachers higher pay, visible respect, strong and supportive principals who provide effective instructional leadership, and opportunities to collaborate in meaningful ways.

EN: How can we measure teacher quality on an ongoing basis?

 

KH: Measures of teacher quality should be based primarily on teachers’ effectiveness in promoting student learning, but should also consider evidence of classroom teaching practices known to contribute to greater student learning. All states now have at least the raw capacity to use value-added techniques to measure teachers’ contribution to their students’ academic progress. Where those data are available, they should be front and center in efforts to measure teacher quality. But since the data rely on annual standardized assessments, such analyses will not be available for all teachers. Moreover, since value-added data by themselves do not tell much about why a teacher is more or less effective or how exactly he or she can improve, such “outcome” measures can productively be coupled with new kinds of “inputs” measures, provided the two are strongly correlated.

For example, researchers at institutions such as the University of Virginia, Stanford, and Michigan State and at programs like the Teacher Advancement Program and Teach For America have developed protocols for observing classroom practices and analyzing teaching “artifacts” that produce ratings sufficiently correlated with outcomes. Typically, they use highly specific frameworks and rubrics that describe effective teaching practices, ensure that all evaluators are trained in their use, require multiple classroom observations per year, and employ quality controls to ensure reliability across evaluators. Such systems can help administrators and teachers understand why value-added scores look the way they do and how they can be improved.

Some districts are experimenting with systems that incorporate an even broader range of measures. For example, the evaluation system currently being implemented in Washington, D.C., incorporates a schoolwide value-added measure, a gauge of how much the teacher participates in and contributes to the larger school community, and measures of student growth on instruments other than standardized tests.

EH: We have devoted a lot of research to identifying the attributes of effective teachers, attributes that might be used for hiring or for policy purposes. This research has not succeeded, leading me to agree that the best way to identify a teacher’s effectiveness is to observe her classroom performance. Most other professions are assessed by performance, including that of doctors, lawyers, accountants, and so forth. Indeed, one definition of “profession” might be an occupation in which one is willing to be judged (and rewarded) according to performance.

Research suggests that we can identify effective teachers from the value added to student achievement, although there are limits to the accuracy of doing this. Moreover, Brian Jacob and Lars Lefgren, in the most recent of this research, show that principals reach many of the same conclusions about effectiveness in their evaluations; at least they seem able to distinguish effectiveness in the classroom within broad ranges, i.e., bottom, middle, or top.

The long-run hope would be that we develop both better quantitative measures of a teacher’s value added and better subjective evaluations by principals, supervisors, and peers. This approach is unlikely to satisfy a regulatory view of allocation of quality teachers, but if we are truly interested in improving student achievement, we cannot shy away from incorporating performance information of all sorts into our management decisions.

EN: All the evidence says that experience does not affect teacher quality much after the first three or four years, so should we be concerned that the more-experienced teachers leave for different locations?

EH: It is a concern if experienced teachers systematically leave the most-disadvantaged schools, because the first few years tend to be a little ragged. On the other hand, this fact by itself should not be overstated. Among all rookie teachers there is still a wide variation in skill. Take, for example, Teach For America teachers. On average, they start out looking like the typical experienced teacher from traditional training programs (even though TFA teachers will themselves improve with seasoning). More than that, the best and the worst TFA teachers or other rookies in the system are dramatically different from each other, and the difference is much larger than the performance growth typical for the first few years.

Policies that concentrate on single proxies for skill, like initial years of experience, miss the much larger differences. Yes, if we say we can do nothing about retention related to individual performance levels, it would be good to have more-experienced teachers in the disadvantaged schools. But such a focus overlooks the place where truly large changes are possible.

A policy that simply stabilized movement from these schools would not really accomplish much and might even be counterproductive if no attention were given to actual performance. On the other hand, if we made inner-city schools more attractive places to work and if we developed policies that actively reward high performance by teachers, we would probably get a bonus of lower teacher turnover in our most-disadvantaged schools.

KH: While experience in no way equals effectiveness, we still should be concerned about teacher attrition. Here’s why: high attrition rates in high-poverty schools create a “revolving door” environment with more job vacancies which, because such schools have a harder time recruiting teachers, tend to be disproportionately filled with first-year teachers. And experience does matter for inexperienced teachers. As a group, first-year teachers tend to be less effective than those with even a little more experience, and effectiveness tends to climb steeply for any given cohort of teachers until it begins to plateau after a few years. According to research by Eric Hanushek and others, disproportionate exposure to inexperienced teachers contributes to the achievement gap.

Therefore, policymakers should either seek to limit the number of rookie teachers hired to work in high-poverty and high-minority schools or ensure that beginning teachers come from programs or institutions with a proven track record of supplying teachers who are much more effective than average. Then they should track the effectiveness of beginning teachers in those schools over the first few years, offering substantial retention incentives to those who demonstrate high levels of effectiveness—not only salary incentives, but also career pathways that provide opportunities to exercise leadership while they continue to teach.

EN: If we force teachers to teach in particular schools, will they just leave for another district, or for an administrative position, or leave education altogether?

 

KH: We don’t know, since it’s never been tried on a large scale. More to the point, I would suggest that this is the wrong question to be asking, as nobody thinks forced reassignments are a good solution and nobody is seriously proposing it. Every once in a while, district leaders become frustrated and make noises about the possibility of forced reassignments. But no large district has done it because they know that it would be met with too much resistance and resentment.

Instead, as district leaders are discovering for themselves, a better solution lies in a creative combination of targeted incentives for teachers and policies that empower administrators and school leaders to recruit and retain effective educators.

EH: Coercion is generally costly, particularly when it violates the expectations of workers. The U.S. military found that the draft was not a good policy, even when it allowed them to get soldiers cheaply. With schools, the situation is more complicated. There are many jobs (including the all-volunteer military) where the employer can establish the right to make specific job assignments, but in general the employer must pay for that ability. Today’s urban teachers frequently have a contract that gives the more-experienced teacher certain transfer rights across schools, and changing that provision would generally require bargaining with compensation involving higher salaries or other benefits that the teachers value.

The current contractual arrangements are in many cases overly concerned with teachers’ rights and less concerned about student outcomes than is desirable. It would make sense to work toward more assignment flexibility by school districts. But, again, this may be lower priority than simply having more control over retention based on classroom effectiveness.

EN: If we pay teachers more to teach in inner-city schools, will that really attract the best teachers?

 

KH: Financial incentives can have a positive impact on teacher distribution, but how much of an impact depends on the size of the incentive and to whom it is being offered. Research from North Carolina suggests that smaller financial incentives can help retain teachers in hard-to-staff schools, but experience in places like Dallas and the Charlotte-Mecklenburg school system suggests that incentives need to be fairly large to convince highly effective veterans to transfer and remain there. That shouldn’t stop leaders from offering higher salaries for effective teachers who successfully take on more-challenging jobs. But the qualifiers in that sentence are important: Pay incentives should be offered only to teachers of proven effectiveness, and a portion should be in the form of bonuses contingent on continuing high performance.

Policymakers can free up resources by putting a stop to or limiting counterproductive incentives in current salary schedules. For example, they can set a ceiling on the percentage of teacher compensation districts can base on seniority, and they can stop the practice of paying teachers to earn master’s degrees, which study after study has shown to have no discernible impact on student achievement.

But higher pay alone might not be enough to solve the problem. Some districts have found that even large financial incentives, in the absence of better working conditions, fail to attract and retain strong teachers in high-need schools. The reason is simple: like any other professionals, great teachers place great value on a positive and supportive working environment characterized by strong leadership and opportunities to collaborate with colleagues.

Rather than being discouraged to know it takes more than money to attract stronger teachers to struggling schools, leaders can leverage that knowledge to devise creative solutions. For example, when recruitment bonuses failed to solve the teacher inequity problem in the Charlotte-Mecklenburg schools, leaders came up with a comprehensive “Strategic Staffing Initiative.” The district transferred high-performing principals into targeted schools, allowed them to handpick a team of strong administrators, and gave them the opportunity to recruit up to five highly effective teachers from a roster of volunteers identified and recruited by the district. Everyone who transferred received substantial financial incentives, but, just as important, all were offered the opportunity to work with a team of teachers and administrators committed to achieving success.

EH: There is a simple economic axiom that bad teachers like more money as much as good teachers. Providing higher salaries will do little to improve the quality of urban teachers or teachers of disadvantaged students unless this is coupled with a clearer judgment about effectiveness. If the objective is raising achievement, there is no real substitute for observing achievement and taking actions based on it.

School accountability systems move in this direction when the rewards to principals and teachers are linked to the growth in student learning. At that point, higher salaries, if directed toward more effective teachers and administrators, can be effective. But if higher salaries are awarded by geography and not demonstrated effectiveness, there is little reason to expect improvement.

The central message of this discussion must be that improving student outcomes in the inner city cannot be done by proxy. We must use the direct and available information on teacher effectiveness that comes from objective achievement data and subjective evaluations for both administrators and teachers to guide rewards and management decisions. We may conclude that this is too difficult—because of union contracts, traditions, or other issues. In that case, we must be willing to live with disastrous results or, alternatively, be prepared to give parents the real opportunity to choose better schools. We have a long track record of regulating that schools should “do good”; of following the current ideas, including simply paying teachers more; and of holding out for the perfect, fully tested alternative. We are left with stagnant achievement results that are especially egregious for poor, inner-city kids. More of the same will not work.

The post An Effective Teacher in Every Classroom appeared first on Education Next.

]]>
49697404
Competition Makes a Comeback https://www.educationnext.org/competition-makes-a-comeback/ Thu, 20 May 2010 00:00:00 +0000 http://www.educationnext.org/competition-makes-a-comeback/ Academic bees and bowls attract top students

The post Competition Makes a Comeback appeared first on Education Next.

]]>

Video: George Thampy, winner of the Scripps National Spelling Bee in 2000.


Paige Kimble won the 1981 Scripps National Spelling Bee with “sarcophagus,”  a word that any middle schooler who has studied a unit on the boy king Tutankhamun can use with aplomb.

Now consider the words tossed at the bee’s 2009 finalists, all 12- and 13-year-olds: Laodicean, Maecenas, menhir, apodyterium, herniorrhaphy. Even a computer spell checker doesn’t recognize them.

Palatschinken? What’s happening here?

“The words are getting harder because the level of competition has risen,” says Kimble, who’s now the director of the national spelling bee. There are more children spending more hours studying more words, all for “the opportunity to shine on a national stage,” she adds.

Today’s teachers generally cringe at everything about that development. All those hours spent on one narrow academic focus! All that rote learning! All that stressful competition! And if some children shine on that national stage, what about the self-esteem of every other child whose luster is publicly shown to be not as bright?

Good points, perhaps. But they haven’t slowed the apparent growing interest among middle schoolers in the Scripps spell-off or any of the other bees, bowls, and academic olympiads that will climax in national championships this spring. The Scripps bee claims that 10 million children will take part in its spell-offs this year. Last year, 293 of them made it to the televised finals in Washington after winning local or regional runoffs sponsored by newspapers and community businesses. In 1981, there were just 120 finalists.

The National Geographic Bee, run by the National Geographic Society, claims between 4 million and 5 million yearly participants from 14,000 schools. One finalist from each state and territory will compete for $50,000 in scholarships during the televised finals in May.

MATHCOUNTS, sponsored by the National Society of Professional Engineers and technology companies including Raytheon, says participation is up 10 percent in two years. There’s also a National Science Bowl sponsored by the U.S. Department of Energy, a Bible Bowl, grammar bowls, and an International Brain Bee, where finalists identify the parts and functions of the brain—using human brains.

There may be an element of 21st-century angst in all of this: kids hoping that a national academic championship on their résumé will increase their chances of being accepted by an Ivy League college, at a time when that competition has never been tougher. “I’m setting my sights high, for Harvard or Yale,” says Arjun Kandaswamy, who placed second in the 2009 National Geographic Bee and now, as a 9th grader, has aged out of the contest.

But Arjun would seem to be a strong contender even without a bee victory to his name. He’s making “A”s in Advanced Placement U.S. history, honors literature and chemistry, and precalculus at Westview High School in Portland, Oregon. He’s a member of his school science and debate teams, mentors 5th graders in science—and expects to make the varsity tennis team this spring. He also gushes endearingly about the joys of geography. Even studying it four hours a day, “geography is never a chore,” he assured me.

Indeed, the dozen bee contestants I talked with are high achievers in everything they do: They challenge themselves with the toughest courses their schools offer, and still make time for sports, Key Club, Boy Scouts, piano, or the school robotics team. Some claim Rolodex memories; others attribute their success to hard—really hard—work. “I’m a very goal-oriented person,” said Caitlin Snaring, who won the 2007 National Geographic Bee after creating a series of study guides and color-coded maps, analyzing the tapes of past national bees, and grilling past competitors on their study techniques.

If any of them suffered by not taking home the top prize, they don’t show it. Zachary Zagorski, who came in 17th in the 2009 spelling bee, said his reaction to misspelling “strepitoso” was “OK, fine, I’m gone.” They got involved in their bee, bowl, or olympiad for the same reasons most of us get involved in a hobby or career: they liked it, it held their interest, and “I found out I was good at it,” Zachary added.

They’re the kind of kids that teachers say they don’t have enough of: motivated, articulate, eager, resourceful, and charming. So as bee season swings into high gear, why are some people so uncomfortable about these kids and their victories?

Keeping Score

Americans thrive on competition. It’s why our phones are smarter, our farms are more productive, our athletes run faster, our pop stars are raunchier, and our lives tend to be better—except for the raunchy pop stars—every year. But American schools have been suspicious of competition for generations, and are generally horrified by the idea that success should be accompanied by a reward like a title, a trophy, or a cash prize. Knowledge is its own reward, after all.

Carol Tomlinson, who taught in Virginia public schools for 21 years and is now a professor of educational leadership at the University of Virginia, makes the case against competition, even while arguing that schools have taken it to an extreme. Middle school is “the last time we have to get kids from low-income families to buy into school,” she told me. The surest way to “incorporate and affiliate” those kids is to show them they can succeed; the surest way to lose them to indifference is to hand them proof of their own failure. And what could be clearer proof than to be knocked out of a spelling bee?

Susan Brookhart, former chair of the Department of Foundations and Leadership at Duquesne University’s School of Education and now a consultant on testing and motivation, takes that argument one step further. “Anything that sets up a universe where it looks like being smart and dumb are traits that you’re born with is not good for learning for anyone except—surprise!—the winners,” she told me. She includes classroom star charts in that esteem-crushing universe, as well as anything that ranks youngsters against one another.

Competition “creates this idea among students that there are winners and losers, and ‘puts them in their place’ in that universe,” Brookhart added.

That thinking has reshaped teaching over the past two decades. Classroom work is more collaborative and team-based, especially in math and science, where girls in particular are said to have benefited. Tracking and ability grouping have fallen into disfavor, easing the slower-learner stigma. Portfolio assessments are gaining ground. Report cards set out individualized goals.

“Societally, we view child development differently” than our parents did, and that has spilled over into the classroom, says Frederick J. Morrison, a professor at the University of Michigan’s Center for Human Growth and Development. “We’re much more prone to feeling that optimal development will come through positive messages than through negative feedback or punishment.”

There aren’t a lot of data to back that up, however. Daniel Willingham, a University of Virginia cognitive psychologist, says the research on collaboration vs. competition as teaching method is muddled, and not entirely trustworthy. “People who do research like the idea that there ought to be more cooperation—that’s the sensibility within the education-research community,” he told me. “The danger is that researchers reach the answer they want to find.”

The squeamishness about competition reached its extreme with the self-esteem movement of the 1990s, when researchers decided that low-performing kids would do better in school if they just, darn it, felt better about themselves. Schools dropped honor rolls, the class valedictorian, and assemblies that recognized academic stars, but not, of course, assemblies that recognized football or basketball or golf stars. At the feel-good movement’s most absurd, “authentic experience” triumphed over standardized spelling and grammar. Ethnocentric math had its proponents. Everyone got a “good job” sticker, good job or not.

The self-esteem movement “probably backfired and made kids arrogant for no cause,” said Willingham, who included himself in the self-esteem pack. Willingham and Morrison, among others, now see a change. “It has seeped into the public consciousness that we got that wrong,” Willingham said. “Self esteem does not help with learning; high self-esteem goes with high test scores,” not the other way around.

By eliminating many of those measures that show youngsters where they stand in the classroom, “we make kids feel a lot better about themselves, but we’re not challenging them nearly as much as we did three, four, five generations ago,” added Morrison.

The Drive to Compete

It’s hard to trace the arc of the pendulum swing, but the standards movement—which led to state tests and from there to No Child Left Behind—seems one place to start. The Bush administration education law defines and punishes failure, and there are no extra points for a cocky walk.

Tough economic times are another place to look, says Aaron M. Pallas, a professor of sociology and education at Teachers College, Columbia University. Middle-class kids and their parents are worried about getting into and paying for college. A high-school transcript that doesn’t report grades or class standing doesn’t help; neither does weakness in math and reading.

A national academic championship, or membership in the National Honor Society, might help, though. The number of schools with National Junior Honor Society chapters for middle schoolers has grown to 7,552 from 4,625 since 2000, says the National Association of Secondary School Principals, which runs the program. The number of National Honor Society chapters is up by one-third in the same time.

No Child Left Behind doesn’t say anything about spelling and geography bees, of course, but its impact on academic go-getters is a matter of some debate. Teachers and researchers grumble that the law focuses teachers’ attention on getting youngsters over a bar of minimal competency. There’s no reward for getting stronger students to proficiency, or really bright kids to some advanced level. “Kids in the higher ranges of knowledge or skill find classes pretty desolate these days,” said UVa’s Tomlinson.

No Child Left Behind critics also contend that the law has narrowed learning to what’s on the test, and spelling, geography, and science aren’t. And teachers complain that they haven’t the time to teach anything else, anyway. Kids looking for a challenge may have to look outside their schools, adds Tomlinson, because “classrooms haven’t engaged anyone for a whole academic generation now.”

The bee finalists I talked with had a far brighter view of their schools than that (and most of them attended public schools), although some did complain of teachers who asked little of them and classes they claimed they could sleep through. The encouraging news is that bright, motivated youngsters can usually seek out gifted-and-talented programs, accelerated classes, and daunting amounts of extra work, which is what bee contestants appear to do.

Eric Yang, a Colony, Texas, 8th grader who won the 2009 geography bee, is taking pre-AP classes in science, U.S. history, and English at Griffin Middle School, plus geometry at the local high school. William Lee IV, who finished third in the 2008 geography bee, is taking Italian and Spanish at Woburn High School in Massachusetts, plus “honors classes for everything else.” Caitlin Snaring took her first AP class—and got a perfect AP test score—as a freshman.

For many of these superachievers, bees and bowls are just one more academic challenge, one more way to test themselves. “It’s about me working to improve myself,” said Sidharth Chand, who was knocked out of the 2009 spelling-bee finals on “apodeiterium.” “I didn’t get involved because I didn’t find school challenging; it was an extra thing.” Sidharth, who went to the 2008 spelling bee finals, too, is taking six honors classes at Detroit Country Day School and, as “an extra thing,” is on the school Quiz Bowl and Science Olympiad teams.

Indeed, the kids I talked to load themselves with extra challenges. Eric Yang has been entering science, math, art, and impromptu-speaking competitions sponsored by the University of Texas in Austin since he was in 4th grade—and that’s in addition to the piano competitions he likes. Caitlin Snaring was in a Bible memory program.

Tim Ruiter, a Centreville, Virginia, home schooler, competed in the finals of a national math and science bowl two weeks before the 2009 spelling-bee finals, where he tied for second place after flubbing “Maecenas.”

The internal challenge isn’t the only reason youngsters take on the incredible workload of a national bee, though. There’s the honor of representing their state or hometown, some of them told me. There’s the prospect of a trip to Washington, D.C., for the finals. There’s the chance to spend time with youngsters who share their passion for word roots or river systems or algebra, many said. “I thought it would be fun to meet people who know geography like I did,” said Eric Yang.

Many kids talked of the thrill, and benefits, of competition. “I’m competitive; I just like to win,” said Kirsi Anselmi-Stith, a Rock Springs, Wyoming, 8th grader who will compete in the geography-bee finals this spring for the third time.

“It’s good to have rivals—they push you to be your best,” added Kennyi Aouad, who reached the 2007, 2008, and 2009 spelling-bee finals. Kennyi, the son of Ghanaian immigrants who live in Terra Haute, Indiana, apparently found the pushing helpful: He’s now attending Choate Rosemary Hall in Connecticut on a full scholarship.

A bee is “something you really like doing, and it’s showing everyone I’m the best at what I’m doing and it’s the competition. It was everything coming together,” said Arjun Kandaswamy, the 2009 geography bee runner-up.

The most common refrain I heard, though, was much simpler than any of that. “It was pretty fun,” said Kennyi Aouad.

“It was real great fun,” added Sidharth Chand.

“It was very fun,” said Aishwarya Pastapur, who competed in the 2009 spelling bee.

“It was always fun,” agreed William Lee.

Fun?

Handling Defeat

That’s hard for detractors to imagine. They fret about the stress heaped on the young shoulders of bee finalists and the agony of defeat on tender egos. Indeed, newspaper accounts of the 2009 spelling-bee finals suggest swirling drama, tension, and heartbreak. Sidharth Chand “buried his head in his hands for about a minute” after flubbing his word, the Associated Press reported. A contestant from Las Vegas “took a seat in her mother’s lap and wiped a tear or two.”

The auditorium was “tension-packed,” the audience let out sighs of “nervous exhalation,” young faces “drooped,” and eliminated contestants mingled in the hallway, “stunned by defeat,” the AP added. Talk about child abuse!

The popular image of bee contestants, moreover, is that they spend hours on grinding memorization and mind-numbing rote that robs them of time for creative thought and interdisciplinary learning. Webster’s Third New International Dictionary, the spelling bee’s definitive source, lists 476,000 words that might be called out. The geography bee directs contestants to a 500-page reference book written by a past winner. Are these the kinds of thinkers we want in a 21st-century economy?

But the kids I talked to saw their bees as a happy experience that broadened their knowledge rather than narrowed it. Sidharth Chand may have buried his head in his hands as the AP reported, but “after that, I became involved in my schoolwork again and then it was preparation for high school. There was other work to do and that took precedence over moping around,” he said.

Aishwarya Pastapur, who spelled the Dutch homonym “mynheer” for “menhir,” admitted she “cried for a few days” after tying for second place. “I felt so horrible because I know both words. I still feel horrible sometimes,” she said.

But that hasn’t stopped Aishwarya from going out for the scholastic bowl at her Springfield, Illinois, high school or the International Brain Bee, which was founded by University of Maryland neuroscientist Norbert Myslinski. That contest, for high schoolers only, includes a neuroanatomy practical and a patient diagnosis that Dr. Myslinski pegs to the second year of medical school.

Most of the kids I talked with told me that they were proud that they had come so far, not dismayed that they had fallen just short. “That was the best I’d ever done. My family was proud of me, so there was no reason to be disappointed,” said Kennyi Aouad.

Losing “made me want to win even more,” said Caitlin Snaring, who said her defeat in the 2006 geography bee “got me fired up” to win the 2007 contest.

“It could have gone either way,” said Arjun Kandaswarmy, who lost the 2009 geography bee to Eric Yang on a question that they both were asked about the Timi? River in Romania. “I studied hard, he studied hard. I did everything I could. It’s just bad luck that I got that close and didn’t make it,” Arjun said with amazing equipoise.

Even in losing, some found themselves hometown celebrities, which certainly would have salved any sting of defeat. “Oceanside just embraced him totally,” Shari Zagorski told me about her son, Zachary, and their Long Island, New York, community’s reaction to his trip to the 2009 spelling-bee finals. Oceanside youngsters accounted for 6 of the 31 contestants at the Long Island regional contest this fall, she said. “Spelling suddenly became cool.”

If youngsters are indeed “stunned by defeat,” Mary Lee Elden said she doesn’t see it. Elden started and still runs the geography bee for the National Geographic Society, which fetes the finalists with a tour-filled weekend in Washington before the televised face-off. Elden said she keeps cookies and juice backstage for eliminated contestants, and some years “we’ve had to send people back there to tell them to keep quiet, they’re having so much fun.”

Of course, kids who can’t handle defeat don’t generally get involved in such a high-pressure contest, or don’t make it to the national finals in the first place.

Winning Ways

In the same self-selecting way, kids who don’t find pleasure in the hours of study that generally are part of bee preparations don’t get involved, either.

Several youngsters told me they have near-photographic memories that kept preparations for their bees to a mere hour or so a night. But most said they worked darn hard—and often quite creatively—to master their subjects. Tim Ruiter, the Virginia home schooler, took a class in Greek and Latin word roots to prepare for the 2009 spelling-bee finals. This year, with one year of eligibility left (the bee is open only to those in 8th grade or lower), he is studying German to better understand the spelling patterns in words with Germanic roots.

The best spellers aren’t memorizers, “they’re word sleuths,” the spelling bee’s Paige Kimble told me, spelling out “sleuth,” just as you’d expect a spelling maven to do. The most successful contestants are kids who learn about language patterns and “have an incredible sense of how language is put together,” she added.

Some kids assembled mountains of flashcards and binders of maps, lists, and fact sheets. Arjun Kandaswamy said he studied for the geography bee finals by “layering”—starting with “the basic stuff” like continents and countries, and gradually adding layers of geographic complexity. Remarkably, I thought, only one youngster said he got any help from a teacher: a Bridgewater (MA) State College professor offered William Lee several all-day tutorials before the geography bee.

I checked the spelling and geography bee web sites for the names of bee winners for the past 12 years (the period of the greatest surge in immigration in a century), and found that exactly half were youngsters whose names suggested they are Asian immigrants or the children of Asian immigrants, and that most of those were Indian or Indian American.

Daniel Willingham attributes that in part to the Asian esteem of knowledge and tradition of rote learning. A simpler answer is that the Indian American community has embraced spelling bees in a way no other group has. There are chat rooms and blogs where Indian Americans discuss spelling, bees are widely reported in Indian papers, and winners are heroes—even back in Bangalore and Delhi. Spelling is to Indians, it seems, as baseball is to Dominicans or football to Samoans: a way for strivers to shine.

Anyone uncomfortable with that only has to look at the names of the other winners: Williams, O’Dorney, Wojtanik, Haddad-Fonda. As American as apple pie.

The one common denominator among the kids I talked to is that they read—a lot. Newspapers, cookbooks, novels, travel magazines, nonfiction. “Pretty much everything,” said Zachary Zagorski, whose current favorite is a series of novels about Artemis Fowl, a boy described as “the world’s greatest criminal mastermind.” Geography bee finalists said they also pore over maps, atlases, foreign money, and Google Earth—and have ever since a parent first traveled to Bern or a friend sent a postcard from Kashmir.

The few studies of Nobel laureates and other groundbreaking thinkers suggests that doggedness, even more than raw ability, separates them from other high-level experts in their field, says Daniel Willingham. Nobel winners “tend to be very good, but not amazing,” he told me. “What differentiates them is not that the Nobel winners have more raw horsepower, but that they have a very high threshold for mental exhaustion. They keep working at problems when the rest of us have to get up and go watch ‘So You Think You Can Dance’ or something.”

Maybe that tells us something about bee contestants, and maybe bee contestants tell us something about our kids and our schools. “Standards increase the effort; effort increases the knowledge level,” says the University of Michigan’s Frederick Morrison.

Okay, everyone: Where’s the Limpopo, what’s the currency of Nauru, and is it a-p-o-g-g-i-a-t-u-r-a or a-p-p-o-g-g-i-a-t-u-r-a?

June Kronholz is a former Wall Street Journal foreign correspondent, bureau chief, and education reporter. She has lived on five continents, knows the capitals of Africa, and is a good speller.

The post Competition Makes a Comeback appeared first on Education Next.

]]>
49697439
Evaluating NCLB https://www.educationnext.org/evaluating-nclb/ Wed, 19 May 2010 00:00:00 +0000 http://www.educationnext.org/evaluating-nclb/ Accountability has produced substantial gains in math skills but not in reading

The post Evaluating NCLB appeared first on Education Next.

]]>

How has the No Child Left Behind (NCLB) Act affected student achievement? This is no idle question, as the landmark federal law is long overdue for reauthorization. The Obama administration has recently urged Congress to add the issue to its already crowded 2010 agenda, even going so far as to include an additional $1 billion for K–12 education in its budget proposal if the law is reauthorized this year (a wholly symbolic gesture, given that it is Congress that sets spending levels, but one that indicates the administration’s priorities).

Yet heightened attention to NCLB has not produced consensus over its consequences for students. No Child Left Behind was a reauthorization of the Elementary and Secondary Education Act (ESEA), the central federal legislation relevant to K–12 schooling. NCLB dramatically expanded the law’s scope by requiring that states introduce school-accountability systems that applied to all public schools and students in the state. NCLB requires annual testing of students in reading and mathematics in grades 3 through 8 (and at least once in grades 10 through 12) and that states rate schools, both as a whole and for key subgroups, with regard to whether they are making adequate yearly progress (AYP) toward their state’s proficiency goals. Supporters and critics, in their various approaches to discerning NCLB’s impact, share a significant problem: because NCLB applies to all public school students, researchers lack a suitable comparison group and so have been unable to distinguish the law’s effects from the myriad other factors at work over the past eight years.

The new research we present below takes on this challenge. Our basic insight is that the test-based accountability provisions that are the defining characteristic of NCLB did not come from nowhere, but rather were modeled quite closely on reforms adopted by many states in the 1990s. For states with such accountability systems in place before 2002, NCLB’s most important components may have created some logistical headaches but were largely irrelevant. In contrast, NCLB forced the remaining states to enact accountability systems for the first time. We can therefore estimate the impact of NCLB’s accountability mandates by comparing test-score changes in states that did not have NCLB-style accountability policies in place when the law was implemented to test-score changes in those that did.

We find that the accountability provisions of NCLB generated large and statistically significant increases in the math achievement of 4th graders and that these gains were concentrated among African American and Hispanic students and among students who were eligible for subsidized lunch. We find smaller positive effects on 8th-grade math achievement. These effects are concentrated at lower achievement levels and among students who were eligible for subsidized lunch. We do not, however, find evidence that NCLB accountability had any impact on reading achievement among either 4th or 8th graders.

Assessing NCLB

The broad interest in understanding whether NCLB has influenced student achievement, both overall and for key subgroups, has motivated careful scrutiny of trend data from the National Assessment of Educational Progress (NAEP) and other sources. For example, the authors of a report commissioned by the U.S. Department of Education’s Institute of Education Sciences (IES) note that achievement trends on both state assessments and NAEP were “positive overall and for key subgroups” through 2005. Using more recent data, a report by the Center on Education Policy concludes that reading and math achievement as measured by state assessments has increased in most states since 2002 and that there have been smaller but similar patterns in NAEP scores. Both reports were careful to stress that these national gains are not necessarily attributable to the effects of NCLB.

Other studies have taken a less sanguine view of these achievement gains, arguing that they are misleading because states have made their assessment systems less rigorous over time. University of California scholar Bruce Fuller and colleagues, for example, document a growing disparity between student performance on state assessments and NAEP since the introduction of NCLB and conclude that “it is important to focus on the historical patterns informed by the NAEP.” Using NAEP data on 4th graders, they conclude that the growth in student achievement has actually slowed since the introduction of NCLB.

Turning to the broader literature on school accountability, several researchers have evaluated the achievement consequences of the accountability systems states developed during the 1990s. One study by Martin Carnoy and Susanna Loeb of Stanford, which was based on state-level NAEP data, found that the within-state growth in math performance between 1996 and 2000 was larger in states with higher values on an accountability index, particularly for African American and Hispanic students in 8th grade. Another study, by Eric Hanushek and Margaret Raymond, both also at Stanford, evaluated the impact of school-accountability policies on state-level NAEP math and reading achievement measured by the difference between the performance of a state’s 8th graders and that of 4th graders in the same state four years earlier. They classified states as having either “report-card accountability” or “consequential accountability.” Report-card states provided a public report of school-level test performance. States with consequential accountability both publicized school-level performance and attached consequences to that performance. Hanushek and Raymond found that the introduction of consequential accountability within a state was associated with increases in NAEP scores.

Both of these studies suggest that NCLB-style accountability provisions may increase student achievement and also demonstrate how state-level NAEP data can be used to evaluate accountability systems. The analysis described below effectively extends this important work to cover the more recent state accountability reforms that were compelled by NCLB.

Research Design

Given the various social, economic, and educational factors at work before and after NCLB was implemented, it is difficult to draw strong conclusions about the policy’s impact from a simple comparison of achievement trends before and after enactment of the law. For example, the nation was suffering from a recession around the time NCLB was implemented, which one might expect would have reduced student achievement in the absence of other forces. At the same time, other national education policies and programs were in place that may also have influenced student achievement.

Perhaps the central challenge in evaluation research is to identify a plausible comparison group that was unaffected by the intervention under study. In the case of NCLB, this is particularly difficult, as the policy simultaneously applied to all public schools in the United States.

We address this issue by comparing trends in student achievement across states that had varying degrees of prior experience with state school-accountability policies similar to those brought about by NCLB. The intuition behind this approach is that NCLB represented less of a “treatment” in states that had already adopted NCLB-like school-accountability policies prior to 2002. To the extent that NCLB-like accountability had either positive or negative effects on measured student achievement, we would expect, once NCLB had been implemented, to observe those effects most distinctly in states that had not previously introduced similar policies.

This strategy relies on the assertion that pre-NCLB school-accountability policies were comparable to NCLB—that is, that the two types of accountability regimes are similar in the most relevant respects. The fact that many state officials criticized NCLB, arguing that it duplicated their prior accountability systems, suggests the functional equivalence of the two sets of policies. To ensure that this is the case and relying on a number of different sources, we evaluated the comparison states according to whether the features of their pre-NCLB accountability policies closely resembled the key aspects of NCLB. We found that they were in fact quite similar.

As an additional check on the validity of our treatment and comparison groups, we used our research design to estimate the impact of NCLB accountability on outcomes that we would not expect to be affected, such as the state-level average poverty rate and median household income. The fact that our method does not find any “effect” of NCLB on such outcomes suggests that these states can serve as a plausible comparison group for isolating the impact of NCLB accountability.

We implement our research design in a more fine-grained manner than simply comparing achievement trends in the treatment and comparison states. We define the treatment as the number of years without prior school accountability between the 1991–92 academic year and the onset of NCLB. Hence, states with no prior accountability have a value of 11. Illinois, which adopted its policy in the 1992–93 school year, would have a value of 2. Texas would have a value of 4 since its policy started in 1994–95, and Vermont would have a value of 9 since its program began in 1999–2000. This method implies that the larger the value of this treatment variable, the greater potential impact of NCLB. The total effect we report is the impact of NCLB accountability in 2007 for states with no prior accountability relative to states that adopted school accountability in 1997 (the mean adoption year among states that adopted accountability prior to NCLB).

It is important to note that this research design will capture the impact of the accountability provisions of NCLB, but not the impact of other NCLB components such as the Reading First program or its Highly Qualified Teacher provisions. Additionally, our estimates will identify the impact of NCLB-induced school-accountability provisions on states without prior accountability policies. To the extent that one believes that states that expected to gain the most from accountability policies adopted them prior to NCLB, one might view the results we present as an underestimate of the average effect of school accountability.

Data

This analysis uses data on math and reading achievement from the state NAEP, which offers a representative sample of student achievement in each state at regular intervals. Participation in the state NAEP was voluntary prior to NCLB, although roughly 40 states did participate. NCLB made participation mandatory. The main advantage to using NAEP data for our analysis is that it is a low-stakes exam that is not directly tied to any state’s standards or assessments. Instead, NAEP aims to assess a broad range of skills and knowledge within each subject area. Consequently, NAEP data should be relatively immune to concerns about accountability-driven test-score inflation, such as may result from “teaching to the test.”

Because our research design depends on measuring achievement trends prior to NCLB, we limit our sample to states that administered the state NAEP at least twice prior to the implementation of NCLB. We include 2002 as a pre-NCLB data point in our analysis because, given the timing of the passage and implementation of the law, it seems unlikely that spring 2002 scores could have been substantially influenced by NCLB (see sidebar). All states administered NAEP in 2003, 2005, and 2007.

Our sample includes 39 states for 4th-grade math, 38 states for 8th-grade math, 37 states for 4th-grade reading, and 34 states for 8th-grade reading (see Figure 1). With a few exceptions, our analysis sample closely resembles the nation in terms of student demographics (e.g., percentage African American and percentage Hispanic), observed socioeconomic traits (e.g., the poverty rate), and measures of the levels and pre-NCLB trends in NAEP test scores.

20103_DeeJacob_fig1-small

Results

We find that the accountability provisions of NCLB increased 4th-grade math achievement by roughly 7.2 scale points (0.23 standard deviations) by 2007 in states with no prior accountability policies relative to states that adopted accountability systems in 1997. How large is this effect? As one point of reference, consider that the difference between the average scores of 4th and 8th graders in our sample suggests that students gain roughly 12 scale points per year. By this measure, the NCLB impact is equivalent to roughly two-thirds of the average annual gain in scale points. Consider also that the achievement gap between black and white 4th graders on the NAEP math exam is roughly 30 scale points (1 standard deviation), which means that the impact of NCLB is equivalent to about one-quarter of this difference. The effect for 8th-grade math is smaller (0.10 standard deviations) and falls just shy of achieving conventional levels of statistical significance. We find no effects for 4th- and 8th-grade reading.

The design of NCLB necessarily focused the attention of schools on helping students attain proficiency. Figure 2 presents our estimates of the effects of NCLB accountability on the percentage of students achieving at or above the basic and proficient performance levels on NAEP. Although states’ definitions of proficient vary widely, very few set the proficiency bar as high as NAEP and most correspond more closely to NAEP’s basic performance level. We find that NCLB accountability increased the share of students performing at or above basic in math by 10 percentage points among 4th graders and 6 percentage points among 8th graders. Math proficiency rates among 4th graders also increased by 6 percentage points. Again, however, we do not find consistent evidence that NCLB increased reading performance at either grade level.

20103_DeeJacob_fig2-small

Given NCLB’s focus on proficiency, one would expect the law to disproportionately influence achievement among previously low-achieving students. Our results showing larger increases in the percentage of students reaching the performance level of basic on the NAEP are broadly consistent with this theory. However, in contrast with some previous research and commonly voiced concerns, we do not find that the introduction of NCLB harmed students at higher points on the achievement distribution. Indeed, NCLB accountability seemed to increase achievement among higher-achieving students, if by a smaller amount than it did among their low-achieving peers. For example, in 4th-grade math, we find that NCLB increased scores at the 10th percentile by roughly 0.29 standard deviations compared with an increase of only 0.17 standard deviations at the 90th percentile (see Figure 3).

20103_DeeJacob_fig3-small

One of the primary objectives of NCLB was to reduce inequities in student performance by race and socioeconomic status. Indeed, this concern drove the requirement that, under the statute, accountability ratings be determined by subgroup performance in addition to aggregate school performance. Hence, it is of particular interest to understand the effect of NCLB accountability on specific student subgroups.

In 4th-grade math, these estimated effects are somewhat larger for Hispanic students relative to white students. Similarly, the effects were substantially larger among students who were eligible for subsidized lunch (regardless of race) relative to students who were not eligible. We also found relatively large effects for black students but only when our analysis weighted the state-year NAEP data by the corresponding enrollments of black students. This pattern suggests that NCLB generated more meaningful improvements in the achievement of black students in states where public schools served larger numbers of black students. The effects were roughly comparable for boys and girls.

In 8th-grade math, we find extremely large positive effects for Hispanic students and small, only marginally significant effects for white students. Unfortunately, the results for black students are too imprecisely estimated to warrant interpretation. The effects for students eligible for subsidized lunch are large and statistically significant. Interestingly, for 8th graders the effects are substantially larger for girls, with boys experiencing little if any benefit of accountability.

Unintended Consequences?

One concern about NCLB and most other test-based school-accountability policies is that they may cause schools to neglect subjects other than math and reading. NAEP data offer some opportunity to test this hypothesis in the context of NCLB. A sizable number of states administered state-representative NAEP tests in science. Unfortunately, during our analysis period, the 4th-grade science exam was only administered in 2000 and 2005 and the 8th-grade science exam was administered in 1996, 2000 and 2005. The lack of multiple pre- and post-NCLB measures of student achievement limit the power of our research design. Nonetheless, when we apply our research design to these data, we find no statistically significant effects at either grade level at any point on the achievement distribution. Moreover, we are able to rule out effects larger than roughly 0.10 standard deviations. While these results should be taken with a grain of salt, they cast doubt on some claims that NCLB accountability has had an adverse impact on student performance in science.

Another major concern with test-based accountability, including NCLB, is that it provides teachers an incentive to direct energy toward the types of questions that appear most commonly on the high-stakes test and away from other topics within the tested domain. As noted above, one of the benefits of the analysis presented here is that it relies on student performance on NAEP, which should be relatively immune from such test-score “inflation” since it is not used as a high-stakes test under NCLB or any other accountability system. It is nonetheless interesting to examine whether NCLB accountability has improved student achievement in any particular topic within math or reading. The NAEP math exam measures student performance in five specific topic areas: algebra, geometry, measurement, number properties and operations, and data analysis, statistics, and probability. Our results suggest that NCLB had a positive impact in all math topic areas for the 4th-grade sample. Among 8th graders, NCLB had a moderately large and statistically significant impact in data analysis and marginally significant effects in number properties and geometry.

The NAEP reading exam measures student competency in several skills related to comprehension: reading for information (i.e., primarily nonfiction reading), reading for literary experience (i.e., primarily fiction reading), and (for 8th grade only) the ability to perform a task (e.g., students apply knowledge from reading bus schedules or directions for repairing something). We find no significant differences in student achievement effects by topic area in reading; that is, NCLB accountability did not appear to have significant effects on student achievement in any of the three reading competencies. Keep in mind, however, that our research design does not allow us to comment on the effects of other aspects of the law, such as the Reading First program, that were explicitly designed to boost reading performance.

Summing Up

So how has NCLB accountability affected student achievement? Our results suggest that its consequences have been mixed. Specifically, we find that the accountability provisions of NCLB generated large and broad gains in the math achievement of 4th graders and somewhat smaller gains for 8th graders. Our results suggest that NCLB accountability had no impact on reading achievement for either group.

The mixed results presented here pose difficult but important questions for policymakers considering whether to “end” or “mend” NCLB. The evidence of substantial and almost universal gains in math is undoubtedly good news for advocates of NCLB. But the lack of any effect in reading, and the fact that the policy appears to have generated only modestly larger impacts among disadvantaged subgroups in math (and thus made only minimal headway in closing achievement gaps), suggests that the impact of NCLB has fallen short of its extraordinarily ambitious goals. Some commentators have argued that the failure of NCLB and earlier accountability reforms to close achievement gaps reflects a flawed, implicit assumption that schools alone can overcome the achievement consequences of dramatic socioeconomic disparities.

An effective redesign of accountability policies like NCLB may need to pay more specific attention to the processes and practices operating within schools. Along those lines, it is interesting to note that our evidence of differential effects by grade and subject is broadly similar to the results from evaluations of earlier state-level school-accountability policies. Understanding the sources of these differences is likely to be particularly useful as policymakers discuss the future design and implementation of school-accountability systems. For example, the unique effectiveness of NCLB in improving the math skills of younger students could be related to the biological evidence that cognitive skills are more malleable at early ages. These outcomes may also result from the specific ways in which schools and teachers have adjusted their instructional practices, perhaps differently for mathematics and reading. Much evidence suggests that school decisions about curricula (e.g., textbooks, instructional software, and the corresponding pedagogy) can have comparatively large effects on student achievement. Further research that can credibly and specifically examine how school and teacher responses have contributed to the achievement effects documented here would be a useful next step in identifying effective policies and practices that can reliably improve student outcomes.

Thomas Dee is associate professor of economics at Swarthmore College. Brian Jacob is professor of education policy and economics at the University of Michigan.

The post Evaluating NCLB appeared first on Education Next.

]]>
49697493
Summer 2010 Correspondence https://www.educationnext.org/summer-2010-correspondnce/ Fri, 14 May 2010 00:00:00 +0000 http://www.educationnext.org/summer-2010-correspondnce/ Readers Respond

The post Summer 2010 Correspondence appeared first on Education Next.

]]>
Charter High Schools

For far too long, studies and reports about our nation’s high schools have been great at diagnosing prob­lems and highlighting failures. “The Unknown World of Charter High Schools” (research, Spring 2010) offers a refreshing change from the typical “gloom and doom” by providing evi­dence that public charter students in Chicago and Florida have significantly higher graduation and college atten­dance rates than their peers in tradi­tional public schools.

“The Unknown World of Char­ter High Schools” is an important research document for two reasons. First, it focuses not on student achieve­ment, but more importantly, on edu­cational attainment, specifically, high school graduation and college matric­ulation. Unfortunately, this “bottom line” research focus is rare. While studies showing growth on standard­ized tests can prove helpful, schools exist to prepare students to be produc­tive and successful adults. Educational attainment is a much clearer indicator of school quality. A similar bottom-line approach has been central to our success at YES Prep Public Schools, and it is why we require every stu­dent to secure acceptance into a four-year college in order to receive a high school diploma.

Second, the methodology used in the study effectively addresses the usual creaming and self-selection arguments that arise with any study demonstrating positive student out­comes in public charter schools. By limiting the high school students in the study to those who attended a charter school for 8th grade, the authors account for the argument that charter students perform at higher levels simply because they are more motivated or come from families in which the parents are more involved in their education.

This outcomes-based focus and thoughtful research design gives the study the credibility that it needs to serve as an important “proof point” that extends beyond charter high schools. The study serves as an important step in identifying factors in school success. With this knowl­edge of “the what,” we can confidently dig deeper and better understand “the how.” Research like this com­bined with over a decade of practical experience and significant results at high-performing charter public high schools like YES Prep will unlock “the how” to high school reform so we can move past diagnosing the prob­lem and begin implementing real and effective solutions for increasing high school and college completion rates across the country.

Chris Barbic
Founder and Head of Schools
YES Prep Public Schools

Coleman’s Legacy

Thanks to Paul Peterson for inves­tigating the links between James Coleman’s adolescent experiences and his studies of adolescent life and high schools (“A Courageous Look at the American High School,” features, Spring 2010). Peterson provides a great service to scholars.

Peterson mentions Coleman’s experience at Manual High in Louis­ville, Kentucky, where he adjusted by becoming a member of the school’s football team. Coleman’s athleticism had roots deeper than the limited opportunities at his high school, however. His father and grandfather were both football heroes. I recall a comical scene at a graduate-stu­dent baseball game. Jim wanted two captains to choose their teams the old-fashioned way: one player at a time. Considering that most gradu­ate students were working from their own adolescent experiences (i.e., their lack of childhood athleticism), a revolt was quickly organized. No one should have to be the last one chosen! All in jest, Jim settled for odd and even birth dates to establish the teams.

Coleman’s adult interest in ado­lescence was not limited to scholarly analysis. Most know of his attempts to develop academically related games that could stir the interest of adolescents. Fewer know of his weekly commitment to tutor a pub­lic high school’s mathematics team in Chicago.

While his competitive instincts remained with him as a scholar, so did his sense of fair play. As Tom Hoffer and I waded through all the commentaries and critiques of the study of public and private high schools, Jim had strict rules of engagement. Roughly, they were these: Concede well-founded criti­cisms first. Play on the critics’ court (i.e., you can’t use sociological argu­ments to criticize an economist). Protect the junior scholars and give seniors fair hits.

Sally B. Kilgore
President and CEO
Modern Red SchoolHouse Institute

In reading Paul Peterson’s thoughtful account of James Coleman’s research and its role in history, and of Daniel Patrick Moynihan’s reaction, I was reminded that Coleman’s big study came out a year after the Moynihan Report (1965). (I had done the research for Moynihan.) At that time, Moyni­han’s report was in the middle of a firestorm, and I know he found some relief in learning from that study how important the family was.

While I have always thought that the family and neighborhood conditions were a very large factor in achievement differences, I have not thought that the Coleman report itself established the relative contributions of school and family. Poor neighborhoods and low-quality schools are interrelated, and it is very hard to sort it out.

Very much later I stumbled onto a 1972 article by Coleman titled “Pol­icy Research in the Social Sciences” and found that Coleman did not think his study had established such rela­tive contributions. He said that “The plan of the analysis was not appro­priate for study of the relative effects of background and school variables, but it was correct for study of relative weights of different school variables.” One wonders how many people heard this from him.

As the father of the concept of “social capital,” Coleman would be pleased to know how far that concept has come, and that it has been applied in the monumental longitudinal study by a team led by Anthony Bryk (Organizing Schools for Improvement: Lessons from Chicago, 2010). The study established the strong relation­ship between the success of school improvement efforts and the strength of social capital in the neighborhoods where the schools were located. Our debt to Coleman is huge, as a pioneer on many important fronts.

Paul E. Barton
Education writer and consultant

 

Universal Pre-K

Elizabeth Cascio (“What Hap­pened When Kindergarten Went Universal,” research, Spring 2010) has estimated the effects of uni­versal kindergarten to inform the debate about universal pre-K. She claims existing research provides little insight into the relative merits of universal programs and those tar­geted to specific groups.

While Cascio’s results are not fully consistent with other stud­ies, the estimated one-fifth drop in incarceration for whites is intrigu­ing. Ultimately, her effort is unsatis­fying because her methods and data provide a weak basis for conclusions, and there is far more relevant infor­mation on the long-term effects than she acknowledges.

Too often the results of complex models such as Cascio’s owe more to the assumptions and idiosyncra­sies of the way data are selected and coded than to reality. Despite the model’s complexity, there is too much that cannot be adequately taken into account: for example, the potential for schools to use the resources freed by state support for kindergarten to fund other services or reduce class sizes for older children; the effects of large, sud­den increases in kindergarten enroll­ments on quality; large increases and decreases in cohort size over the time period studied; and immigration pat­terns over time. Among other prob­lems, Cascio’s speculations about Head Start fail to consider the impacts on children who begin Head Start a year earlier as kindergarten replaced Head Start for those who were age five.

Cascio seems unaware of sub­stantial evidence on the longer-term effects of preschool education pro­grams other than model programs and Head Start, evidence that bears more directly on the question at hand. Several literature reviews (including Barnett in 2008 and Nores and Bar­nett in 2010) have summarized much of this work. The evidence includes the longitudinal study of Child Par­ent Centers operated by the Chicago Public Schools and studies of the effects of several state pre-K pro­grams (including universal pre-K in Georgia) that find positive effects on achievement and reductions in grade repetition. Studies from abroad have found universal pre-K increased test scores, improved behavior, decreased grade repetition, and increased edu­cational attainment. Finally, interna­tional comparisons indicate that as participation in pre-K moves beyond 60 percent toward universal, average test scores at age 15 rise and inequal­ity in these scores declines.

Steve Barnett

Milagros Nores
National Institute for Early Education Research

 

Cascio responds:

Drs. Barnett and Nores leave the impression that I have overlooked a vast and relevant literature on the long-term effects of universal pre­school. Yet almost all the U.S. pro­grams they reference were targeted, not universal; short-term outcomes like test scores are not deterministi­cally related to adult well-being, which was my focus; and experiences of other countries—with very different policy landscapes and populations—provide at least as weak a basis for drawing conclusions for the U.S. Moreover, I estimate the net effects of a large public investment in early education, not the effects of attending preschool per se. Large interventions may have effects that offset any benefits from atten­dance. That my estimates incorporate such responses may make them more, not less, instructive.

Vouchers in New Orleans

Thanks to Education Next for pub­lishing Michael B. Henderson’s informative article on the voucher pro­gram in New Orleans (“In the Wake of the Storm,” features, Spring 2010). With so much attention being focused on the expansion of charter schools after Hurricane Katrina, these schol­arships tend to be overlooked. Mr. Henderson’s piece serves as a useful reminder of the program’s existence as well as an informative description of how the legislation was passed.

Unlike the charter schools, which have received broad support since their inception, the voucher program was a “heavy lift” for Governor Bobby Jindal. He and the legislature deserve much credit for taking this on. It would have been easy for reformers to use the continuing expansion of charter schools as an excuse for inac­tion on the voucher front, but thanks to their commitment hundreds of children can now attend the school of their choice.

In some respects, the expansion of charter schools made it harder for voucher advocates to make a com­pelling case for their need. But as Mr. Henderson describes, effective advocacy by organizations including the Archdiocese of New Orleans and the Black Alliance for Educational Options helped build support for these scholarships.

As Mr. Henderson points out, a number of conditions made it possible for New Orleans to become a hotbed of school reform. Some of these con­ditions may be replicable in other cit­ies and some may not. But what these reforms can do is lay the groundwork for change around the country.

Perhaps success in New Orleans will serve as a springboard for expanding school choice in cities that still cope with inflexible unions and reluctant policymakers. That could be a more likely, and more beneficial, outcome than hoping that someone can replicate the unusual path to school choice that has been taken here in New Orleans.

Kevin Kane
President
Pelican Institute for Public Policy

The post Summer 2010 Correspondence appeared first on Education Next.

]]>
49697485
Competition and Charters Spur Innovation https://www.educationnext.org/competition-and-charters-spur-innovation/ Fri, 14 May 2010 00:00:00 +0000 http://www.educationnext.org/competition-and-charters-spur-innovation/ School markets are creative, not static

The post Competition and Charters Spur Innovation appeared first on Education Next.

]]>

It is in the nature of markets that some succeed, some are middling, and others fail.” That is the static view of the marketplace that induced Diane Ravitch, in her new book, The Death and Life of the Great American School System, to turn against accountability, charter schools, and school choice.

Economist Joseph Schumpeter saw it another way. In his view, it is in the nature of markets that good producers “cre­atively” destroy firms of the middling variety, then are elimi­nated themselves by still better competitors. Few doubt that the public school today is a troubled institution. If school districts were firms operating in the marketplace, most would quickly fall victim to Schumpeter’s law.

Yet Ravitch sees no hope for choice and competition in education, asking us to leave public schools alone apart from articulating voluntary national standards without holding any­one accountable for meeting them. She blames the sad state of affairs on events occurring long after schools had stagnated: a federal law, No Child Left Behind, enacted in 2002; mayoral governance recently instituted in a few cities (see “Palace Revolt in Los Angeles?”); and a small number (4,638) of charter schools that—despite steady growth—still serve less than 3 percent of the nation’s students.

According to a 2009 Education Next survey, the public approves steady charter growth. Among African Americans, those favoring charters do so by a four-to-one margin. Even among public school teachers, the percentage favoring char­ters is greater than the percentage opposed.

A school can have short-term popularity without being good, of course. The best studies of school quality are randomized experiments, the gold standard in both medical and education research. Stanford’s Caroline Hoxby and Harvard’s Thomas Kane have organized randomized experiments that compare students who win the charter lottery with those who applied but lost. The students lucky enough to win the lottery and be admitted to a charter school subsequently scored higher on math and reading tests than did those who lost the lottery and remained in district schools.

What makes charters so important today is not so much their current success, on average, but their long-term poten­tial to innovate. When RCA sneered at transistor radios, Sony captured the audio market by first putting out tinny pocket transistors for teenagers, then expanded its base with steady technological improvement. In a decade or two, RCA fell vic­tim to Schumpeter’s law.

Educational opportunity is about to be revolutionized by powerful notebook computers, broadband, sophisticated cooperative and competitive game playing over the Internet, curriculum in three dimensions, and the open-source develop­ment of curricular materials. If American education remains stagnant, the innovations will spread slowly, if at all. But if the charter world continues to expand, the conditions ripen for competition among charters, districts, and state virtual schools that can be truly transformative. It is “in the nature of markets” that those who make the best use of new technologies will become dominant—to the benefit of us all.

The post Competition and Charters Spur Innovation appeared first on Education Next.

]]>
49697489
Out of the Mainstream https://www.educationnext.org/out-of-the-mainstream/ Wed, 12 May 2010 00:00:00 +0000 http://www.educationnext.org/out-of-the-mainstream/ Staying there isn’t easy

The post Out of the Mainstream appeared first on Education Next.

]]>
I spoke recently with a teacher at an alternative public high school. His students had been kicked out of their neighborhood schools for fighting, truancy, and drug abuse, and his job was to remedy the students’ behavior so they could return to their neighborhood schools. I wondered, what happened to the alternative school I remembered from the 1970s? It seemed so different from the alternative schools of today.

Alternative East High School in Wyncote, Pennsylvania, was modeled after the famous Parkway alternative school in Philadelphia. From 1971 to 1983, Alternative East drew students from Philadelphia and the surrounding suburban school districts of Abington, Cheltenham, and Springfield. The principal, Gisha Berkowitz, took the job after first becoming known as an “active parent.”

At Alternative East, students could create their own courses. As long as the course met college entry requirements, students could develop it, find a faculty member to teach it, and then advertise the class on a poster. If 15 students expressed interest, they could register for the course during master scheduling days held twice during the year. Students seldom sat in classrooms all day. Instead of looking at slides, for example, an art class piled into a van to visit local galleries.

Alternative East was continually evaluated and received positive reviews. Berkowitz carefully kept the budget from getting “out of balance.” So why did the school close?

As is often the case, the answer at the time was money. In 1983, Abington’s school board, in a 5–4 vote, withdrew the district’s participation, forcing the school to close its doors. Nevertheless, minutes from board meetings praised Alternative East and its programs, which included production of a children’s play at a local mall and learning activities in genetics. The board justified its decision by saying that district schools had “highly skilled, highly paid people, and we should be able to provide for the needs of these [students].”

The underlying causes were probably more deep-seated. Times had changed. When the school opened, according to Berkowitz, students were politically alienated by the Vietnam War, racial segregation, and traditional schooling. There was a passion for hands-on, personally relevant education. But by the 1980s, Berkowitz explained, the students at Alternative East were “less interested in exploring.” The teachers weren’t as enthusiastic either, and that sapped energy out of the school. “The political milieu has to be [there]—everything has to be ‘right’…and unfortunately, [that] doesn’t happen enough.”

Even the storied Parkway Program, which in 1970 Time magazine called “the most interesting high school in the U.S. today,” fell victim to the changing political climate. Parkway was known as the “school without walls,” because students learned about journalism at local newspapers, auto mechanics at auto shops, and art from museum historians. I spoke with Dr. Leonard Finkelstein, the second director of Parkway, who said that as a concept, Parkway was “magnificent.” But reality did not always match up to its promise. Some students thrived in the loosely structured environment, while it became a “free-for-all” for others.

Dr. James Lytle, Parkway’s first principal, said that by the late 1970s and early 1980s the middle-class students angry at the system had disappeared. Parkway became a safe alternative to the neighborhood schools and had to recruit “very aggressively” to maintain a diverse student population.

In 1990, the district asked Ms. Odette Harris to become Parkway’s principal. For more than 30 years, Harris had been the principal of William Penn, a large, traditional urban high school. Her style and Parkway’s had little in common, and she remained principal long enough to alter most things alternative. As Ms. Catherine Blunt, Parkway’s union representative at the time, put it, the school changed “because we were in the district.”

As districts like Philadelphia seek to “turn around” their public schools, let’s not forget the lesson of the lost alternative schools. Inventive programs, even when successful, are easily swept aside and replaced by standard fare.

Lynne Blumberg is an ESL and English instructor and freelance writer.

The post Out of the Mainstream appeared first on Education Next.

]]>
49697450
Edutopian Vision https://www.educationnext.org/edutopian-vision/ Tue, 11 May 2010 00:00:00 +0000 http://www.educationnext.org/edutopian-vision/ George Lucas reimagines the American classroom

The post Edutopian Vision appeared first on Education Next.

]]>
Teaching, not politics, is the art of the possible. Teachers are optimists for a living. We believe all students will learn. We believe ignorance is no match for education. We believe in our personal powers of persuasion and influence. The arc of the teacher’s universe is long, but it bends toward progress. We believe, in short, in Edutopia.

And Edutopia believes in us.

Let politicians and pundits speak darkly of the need to weed out bad teachers. Let them hold tests and accountability over our heads like the Sword of Damocles. In Edutopia, teachers rule. We are confident and inspiring. Enlightened administrators are courageous and brave. Grateful parents swoon, while bright, cheerful students meet their academic manifest destinies as their awesome teachers reject the discredited orthodoxies of industrial-age schooling in favor of hands-on projects and authentic, real-world tasks. In the bright light of Edutopia’s soul it is always six o’clock in the morning, and you cannot wait to jump out of bed and get to school.

More seductive than a fitness magazine on New Year’s Day, Edutopia inspires me. Edutopia gets me. Edutopia sees the teacher I am capable of becoming—no, the teacher I will be—and it wants to help me. True, I haven’t helped inner-city high-school students design and build a hybrid car that runs on fuel made from soybeans like that guy in Philadelphia. OK, I haven’t nailed down donations to buy an old farm so my students can garden and read Thoreau in the bosom of nature like that teacher in Vermont. Hell, I haven’t even found the time for that cool unit where my kids create digital avatars and use them to explore body issues. But I will. Yes, in fact, that’s exactly what I’m going to do.

Right after the tests are over. It’s possible.

Edutopia comes by its name honestly. Beyond aspirational, it is teacher porn. But here’s the thing: it’s serious. The George Lucas Educational Foundation, the 19-year-old organization that runs Edutopia, has given itself a mission to “spread the word about ideal, interactive learning environments and enable others to adapt these successes locally.” Its name notwithstanding, Edutopia does not see itself as peddling pie-eyed idealism.

Many people in education were only dimly aware of Edutopia until early 2009, when the organization suddenly became more aggressive about promoting its vision and products. Driven by a ubiquitous underwriting campaign on National Public Radio (NPR), Edutopia claims 10,000 paid members and a total monthly audience of over 300,000 educators for its web site and videos, a 70 percent jump in the past year. Its six-year-old bimonthly magazine, Edutopia, reached 100,000 subscribers until the foundation decided to go online-only starting in the spring of 2010.

Its unabashed idealism and cheerful optimism make it impossible to dislike Edutopia, which bills itself somewhat grandly as “What Works in Public Education.” What’s harder to define is Edutopia’s on-the-ground impact on America’s classrooms and the efficacy of its unique, ultraprogressive ideas. Lucas’s money has purchased an impressive collection of reported articles, videos, and web pages gathered on-site at schools across the country that practice at least bits of what Edutopia preaches. Still, foundation officials are hard-pressed to identify any school that has adopted its strategies as a whole. Thus a better Edutopia tagline might be, “What We Think Would Probably Work in Public Education If Schools Would Stop Being So Old-Fashioned and Just Try It. Plus George Lucas Thinks It’s a Good Idea.”

That might not make a compelling NPR underwriting credit. But it would be more accurate.

What Works in Public Education?

For Edutopia, “What Works in Public Education” boils down to six “core principles”: comprehensive assessment, integrated studies, project-based learning, social and emotional learning, teacher development, and technology integration (see sidebar). Project learning and technology get the biggest push, but even these two favorites serve a bigger picture. “The six core principles can be summarized in six words,” says Dr. Milton Chen, senior fellow and executive director emeritus of the George Lucas Educational Foundation. “‘School life should resemble real life.’ That’s what we’d really like to see happening in schools.”

Edutopia does not consult with schools or districts. It makes no grants. It offers no professional development or teacher training. Essentially, it’s a nonprofit media company. “Working for a filmmaker, we make films,” says Chen. “And we surround those films with other kinds of information that can support learning about how these innovative classrooms came to be.” The foundation has an annual budget of $6 million and a full-time staff of 18 editors, videographers, and web producers who work out of sleek and modern offices at Lucas’s Skywalker Ranch, a 4,700-acre retreat in the Marin County hills near Nicasio, California.

Edutopia’s web site has more than 10,000 pages of content, plus videos, podcasts, and webinars that seek to redefine what is possible—even practical—in U.S. schools: Inner-city schools that stress empathy, collaboration, and personal responsibility. Green schools whose smaller carbon footprints reduce absenteeism and improve test scores. Schools where kids work alongside trained chefs to create school lunches made from scratch with fresh ingredients grown in once-abandoned local greenhouses. If these sound like the kinds of schools where you’d like to teach, that’s exactly the point. “The reaction we’d like people to have is to say, ‘I’d like that for my students,’” says Chen. “‘Whether I’m a superintendent or a parent, I want that kind of education for my kids.’ And then we have to answer the question, how do you do it?”

Let George Do It

George Lucas is an unlikely education philanthropist. The creator of the blockbuster Star Wars and Indiana Jones film franchises, Lucas’s $3 billion net worth places him in the top quartile of the Forbes 400 list of the richest Americans, along with Bill Gates, Eli Broad, and members of the Walton family, all of whom are more closely associated with funding education initiatives than Lucas, who by all accounts was a bored, indifferent student growing up amid the farms and factories of Modesto, California.

“There wasn’t much as a kid that inspired me in what I did as an adult,” he said in a 1999 interview. As a teenager, Lucas spent most of his time under the hood of a car dreaming about automobile racing. He liked photography and briefly entertained the idea of going to art school, an idea shot down by his father, a stationery store owner, who once remarked, “George never listened to me. He was his mother’s pet. George was hard to understand. He was always dreaming things up.”

A near-fatal car crash days before his high-school graduation had a profound effect on Lucas. “The idea of trying to make something out of my life wasn’t really a priority,” he said in a 2007 interview with the Academy of Achievement. “But the accident allowed me to apply myself at school.” After dabbling in film at Modesto Junior College, Lucas won admission to the University of Southern California’s prestigious film school in 1967. USC Film School, said Lucas, “really ignited a passion in me, and it took off from there.”

And how. American Graffiti (1973) was Lucas’s second film and his first hit. That was followed by Star Wars (1977), which became the third-highest-grossing film series in history behind James Bond and Harry Potter. Waiving his director’s fee in favor of the licensing rights to the Star Wars characters earned Lucas hundreds of millions of dollars from toys, games, and action figures. His Lucasfilm studio, along with Skywalker Sound and Industrial Light & Magic digital-film effects companies made it nearly impossible to go to the multiplex without seeing Lucas’s thumbprint. At 47, the age at which Barack Obama won the White House, George Lucas took home the Irving G. Thalberg Memorial Award for lifetime achievement in the film industry.

Clearly, boredom and daydreaming have been very, very good to George Lucas. But how did a gearhead kid with little interest in school end up making public education the object of his philanthropy? Chen describes listening to Lucas reflect on his childhood. “He said, ‘I know there are many, many students out there like me who are disengaged from school, who are kind of bored, not doing well, who in fact have skills and talents and curiosities. If harnessed they could be really great students.’”

A bit of Hollywood mythmaking could be at work here. Lucas has given mixed messages about his own public education. “Frankly, I was not very engaged in my classes,” Lucas said in an e-mail sent to me via Chen. “Occasionally, I had a teacher who would inspire me.” However, he sounded a much more generous note in accepting the Thalberg award at the Oscars in 1992, going out of his way to thank “a group of devoted individuals who, apart from my parents, have done the most to shape my life—my teachers. From kindergarten through college, their struggle—and it was a struggle—to help me grow and learn was not in vain. And it is greatly appreciated.”

Edutopia’s fixation with hands-on projects and technology is certainly consistent with Lucas’s lifelong interest in cars and computers. The source of the foundation’s other education touchstones, however, is not as easy to discern. An e-mail request for Lucas to identify his guiding lights in education went unanswered. Members of Edutopia’s National Advisory Council, which include teachers, administrators, technology experts, and ed school professors, report little influence of or even contact with Lucas. Who has his ear on “What Works”? “I have heard him talk about Daniel Goleman’s emotional intelligence work,” says Chen. “Also he has spoken of Howard Gardner’s theory of multiple intelligences.” Are Edutopia’s core principles the fully formed vision of a creative genius and polymath, self-educated in pedagogy? “Those core principles were developed in close communication with Mr. Lucas,” says Chen, who insists Lucas is “quite active” in Edutopia’s work. “Those are things that George Lucas feels are the linchpins of what he’d like to see in a modern school.”

Fair enough. But are those ideas—from wherever they sprang—any good? Are they “What Works in Public Education”?

Back to the Future

For all its earnestness, Edutopia can sometimes give the sense that it has a poor grasp of history. It is forward-looking to a fault. One senior Edutopia executive was genuinely surprised to learn that project-based learning is neither a new or revolutionary concept in education, but one that traces its roots to William Heard Kilpatrick’s 1918 essay “The Project Method.” No obscure figure, Kilpatrick was “the most influential teacher in the nation’s leading college of education,” spending nearly 30 years on the faculty of Columbia University’s Teachers College, notes education historian Diane Ravitch. In her 2000 book Left Back, Ravitch describes how progressive educators immediately hailed Kilpatrick’s work and its Edutopian call for “whole-hearted purposeful activity proceeding in a social environment,” as the quintessential statement of the child-centered school movement.

“Kilpatrick thought of the project as not just a method but a fundamental reinvention of education. The project was an activity undertaken by students that really interested them,” Ravitch observed. “Furthermore, it fulfilled Dewey’s demand that education should be ‘life itself’ and not merely a preparation for future living; what could be ‘a better preparation for later life than practice living it now?’”

In other words, Edutopia’s mantra—school life should resemble real life—has a century-old provenance. And while teachers are revered, “school” can be a dirty word in Edutopia. An article titled “Beats the Heck Out of School” describes a project that uses hip-hop to teach students critical thinking, technology, and business skills. “What do you think this is—school?” quips a student approvingly in another article about experimental outdoor education. Search “real life” on Edutopia’s web database and you turn up over 200 articles, videos, and blog posts. Search “hands-on” and find 400 more. Somewhere, William Heard Kilpatrick smiles quietly. Dewey, too.

“Project learning is an incredibly important tool. I think there’s ample evidence that it increases student engagement and the ability of kids to retain information,” says Nínive Clements Calegari, a member of Edutopia’s National Advisory Council and the founder of 826 Valencia, a San Francisco education nonprofit. “Every classroom should have old-fashioned multiple-choice tests and good old-fashioned lectures. But if you can engage the kids in a project that has the good tenets of project learning, the impact is more profound,” she says.

Cognitive scientist Daniel Willingham points out that most teachers believe in project-based learning and the methods promoted by Edutopia, yet classroom observation studies show that whole-class instruction and “seat work” account for more than 90 percent of the class time of American 5th graders. If teachers agree that project-based learning equals good teaching, if it has 100 years of momentum and George Lucas’s millions pushing it, why is so little of it happening in our schools? Teachers “do not yet have widespread support from principals, districts, and states to learn how to implement it,” says Chen. Another possibility is that even those who believe in it do precious little project-based learning because it’s nearly impossible to do well. Willingham points out that teachers, like all human beings, have “cognitive limits.” We can only pay attention to a small number of the stimuli that are competing for our attention at any moment. Small groups working independently to overcome unforeseen and unpredictable obstacles make effective planning a challenge. “This doesn’t mean that students should never do projects. It means that we should be clear-eyed about the challenges that projects present, and have a plan to meet them,” says Willingham. “Project learning is great when it’s done well, but it’s very hard to pull off,” he notes.

Edutopia is on firmer ground in its technology advocacy, where there is broad agreement on the capacity of technology to transform education, even if there is little consensus on implementation. “When done well, technology can positively impact student learning outcomes. The challenge is that most school systems are not doing it well for a variety of reasons,” says Scott McLeod, an educational technology expert and associate professor at Iowa State University. “The failings have been more in the doing, not the knowing,” adds McLeod, who credits Edutopia with helping schools think through technology implementation and get it right. “They see excellent and exciting things happening in various isolated locations around the world, tell those stories, and then try to learn and extrapolate from those to schools at large,” he says.

Technology is central to the Edutopian vision, and Chen and his colleagues are unabashed enthusiasts. “Regardless of the politics of human resistance, technology continues to show often a better and less expensive way of doing things,” says Chen. “We feel that corner is being turned in education.”

To its credit, Edutopia seems not to adhere to a rigid orthodoxy in its coverage of schools. Its impressive “Schools That Work” series, in which Edutopia throws all of its multimedia resources into detailed coverage of an individual school, recently featured YES Prep, an urban charter-school network often mentioned in the same breath with KIPP, Achievement First, and other “no excuses” schools championed by advocates of test-driven education reform. The Houston-based schools have extended days, learning contracts signed by students and parents, school-issued cell phones for teachers, and classrooms bearing the names of colleges—the now-familiar features of what David Whitman dubbed “New Paternalism” schools in his 2008 book Sweating the Small Stuff (see “An Appeal to Authority,” features, Fall 2008). While Yes Prep’s fondness for project learning was highlighted, much of Edutopia’s coverage focused on how to re-create the school’s college-bound culture and tough-love discipline code.

“Story selection is driven first by our core values. For the most part we look for stories in these arenas. Second, we look for innovation and new approaches to reform so as not to become repetitive,” says Edutopia editorial director David Markus. “But in the end, it is about audience. Will the topic and our execution of our coverage plan quench their thirst for new insights and new solutions to improve the learning process?”

“Our core principles are very ambitious compared to where most schools are today,” Chen concedes. “So if a school is doing a great job on two or three of them, that’s a good candidate school for us. It’s very hard, for instance, to find a school that’s really doing the integrated studies piece well. That’s a complete change in the curriculum, certainly at the secondary level.”

Creating Edutopia in U.S. Schools

For all the True Believer energy and aggressive efforts to push an agenda, it remains difficult to discern the impact of Edutopia, either in winning converts to its vision for public education or changing the classroom practice of individual teachers. Most of its staff come from the media world and default to audience metrics as a proxy for influence. “People who use it feel connected to it and celebrated by it. It is absolutely successful for those individuals,” says Calegari, a former teacher. “When I was in the classroom I felt so isolated. It could have created a community for me of like-minded teachers,” she says.

Unlike fellow eduphilanthropists, Lucas has had little to say publicly about education reform. A private 501(c)(3), Edutopia does not lobby or explicitly advocate policy, “Our main role is to provide our media so that policymakers can be informed about and advocate for the policies behind the schools we cover,” says Chen.

Washington ed policy hands are skeptical whether Lucas’s “What Works” vision can gain the traction it needs to usher in an era of, well, Edutopia. “Gates, Walton, and Broad are driven by theories of action that emphasize structural reform” such as systems, incentives, and measures, says Andrew Rotherham, co-founder of Education Sector and author of the Eduwonk.com blog. “Edutopia seems more in the camp that what we need are additions and incremental changes to the current system. They’re not nearly as disruptive.” That’s ironic, he quips, “because you have to think that Luke Skywalker would have been more with Gates, Walton, and Broad. He was all about upending an established order that didn’t work.”

Edutopia rejects the comparison. “We consider our core agenda, when implemented at scale, to be very disruptive,” says Chen, who hopes to create more demand for the ideas Edutopia promotes from teachers, principals, parents, businesses, and others. “We leave it to policy experts to create the policies needed to bring them to scale,” he says.

A former 5th-grade teacher, Robert Pondiscio writes about education at the Core Knowledge Blog.

The post Edutopian Vision appeared first on Education Next.

]]>
49697472
Fueling the Engine https://www.educationnext.org/fueling-the-engine/ Tue, 04 May 2010 00:00:00 +0000 http://www.educationnext.org/fueling-the-engine/ Smarter, better ways to fund education innovators

The post Fueling the Engine appeared first on Education Next.

]]>

Video: Frederick Hess on funding innovation


20103_Hess_Open_small

In Education Unbound, Frederick Hess, director of education policy studies at the American Enterprise Institute and Education Next editor, argues for new education service-delivery organizations that, free from the constricting norms and rules of traditional providers, focus single-mindedly on executing their model. The challenge for reformers is to recognize that enabling such providers is not just a matter of promoting “school choice,” but also of freeing up the sector to a wealth of different approaches and cultivating conditions in which problem solvers can succeed and grow. Hess argues in the selection below that funding is the fuel required for innovators to thrive.

Greenfield is a term of art typically used by investors, engineers, or builders to refer to an area where there are unobstructed, wide-open opportunities to invent or build.
— Chapter 1, Education Unbound

From Education Unbound: The Promise and Practice of Greenfield Schooling (pp. 114–125), by Frederick M. Hess, Alexandria, VA: ASCD. © 2010 by ASCD. Reprinted with permission.


New ventures can neither launch nor grow without money. In the absence of funding, greenfield efforts become soul-sucking endeavors for their founders, proceed much more slowly than necessary, or never get off the ground at all. The famous KIPP academies almost died before seeing the light of day because founders Mike Feinberg and David Levin had trouble assembling the few thousand dollars they needed to get started. Raising those funds required the two to write scores of letters and make countless appeals to Houston-area donors. As Washington Post reporter Jay Mathews has wryly recounted in his colorful history of KIPP, Work Hard, Be Nice, “Out of more than one hundred letters, only about a third responded. Most said, in polite corporate language, that they had never heard of KIPP and didn’t like the sound of it. None promised money.”

Teach For America’s Wendy Kopp also struggled to find funding when launching TFA. She has described [in Public Affairs] being schooled by Princeton faculty in just how hard it would be to raise the requisite funds, remembering, “What [Professor Bressler] really wanted to know, he said in his booming voice, was how in the world I planned to raise the $2.5 million…. He didn’t seem convinced. ‘Do you know how hard it is to raise twenty-five hundred dollars?’ he asked.”

Kopp has described sitting down with Texas billionaire and former presidential candidate Ross Perot, trying to get that $2.5 million:

All I remember is Mr. Perot talking. He talked a lot, and I had trouble following much of what he was saying. I was mostly just thinking ‘I need to stay here until I get $1 million from this man.’ When Mr. Perot suggested that I contact Sam Walton and other philanthropists instead, I insisted that he himself was the best possible prospect. Finally, after two hours of back and forth, Mr. Perot agreed to offer us a challenge grant of $500,000. We would have to match his money three to one. I’m not sure what ultimately led Mr. Perot to this idea. He must have realized that I wasn’t planning to go anywhere until he committed to something.

Kopp remembers that Perot’s grant was “the catalyst we needed,” with other donors following his lead and supplying the remaining funds “in relatively short order.”

Only the most hard-headed or selfless of entrepreneurs muscle through. Those with less stomach for frustration, as well as those interested in doing well in addition to doing good, will steer their energies elsewhere. It’s not just about dollars, though. The impact of venture capital  in entrepreneurial hotbeds like Silicon Valley is also a product of the personal networks, mentoring, and expertise that come with it. These networks help new enterprises get a foot in the door, and mentors provide assistance with mundane, but crucial, tasks like organizational bookkeeping, strategic planning, and governance.

Equally crucial is the quality control implicit in venture funding. Those who worry that greenfield efforts may not be publicly run, or who are hesitant to give funds to new ventures with unproven quality, often overlook the fact that competition for venture funding in the private sector comes with intensive screening. In a community like Silicon Valley, as a general rule only 10 percent of business plans that venture capitalists receive warrant any response at all, and only 1 percent are ever funded. To be sure, venture investment also has its share of blemishes. During the late-1990s dot-com bubble, for instance, investors frequently left their skepticism behind as they flocked to a slew of dubious ventures. So, it is not that this process is flawless, but only that it tends to exert a healthy discipline overall.

A particular challenge for schooling is that venture capital is not geographically dispersed. While schools operate in every corner of the country, venture capital is highly concentrated. In 2006, one-third of all venture capital investments were made in California’s Silicon Valley. That figure increases to about half of all investments if Los Angeles, Orange County, and San Diego are included, and to three-fourths of all U.S. venture investment if one adds the Route 128 corridor outside Boston, New York, and metropolitan Washington, DC. In other words, about three-fourths of all investment is made in a few California locales and in the Boston–New York–Washington nexus. Given this natural dynamic, we cannot expect 15,000 school districts to become hotbeds of educational entrepreneurship. Instead, the expectation should be that the requisite funding, infrastructure, and networks will likely emerge in some limited number of locales. Greenfielders need to invest in and build these hubs, and then take care to encourage and support the ventures that are able and willing to deliver their services more broadly.

The quality control and support that the investment process provides are driven by investors tending to their self-interest and happen naturally and invisibly in places like Silicon Valley. They impose a certain flexible but hardnosed quality control even while creating an entire ecosystem and equipping promising new ventures to take root. For too long, these quality assurances and development processes have been overlooked by both K–12 reformers who wonder why innovations fizzle and school choice enthusiasts who seemingly expect manicured flowers to spring from a barren, rubble-strewn plain.

The Three Phases of Investment

Though all education entrepreneurs need financing to get off the ground (venture capital) and to support expansion (growth capital), the capital market for for-profit organizations is markedly different from the one that nonprofit organizations can access (see Figure 2). While for-profit ventures can theoretically rely on their profits, nonprofits rely on a continuous funding stream (sustaining capital) even once they mature.

Startup Capital
Education entrepreneurs creating for-profit enterprises traditionally raise their initial capital from individuals (“angel investors”) or venture capital firms. As explained in the sidebar, these investors put up cash in exchange for an ownership stake (“equity”) in the new organization, and they expect that their investment will eventually yield a profit.

In 2004, just over $50 million was privately invested in businesses addressing the Pre-K–12 sector. With success stories like Amazon, Apple, and Google, one might think that early venture investors typically do quite well for themselves. But the reality is much more complex. In Fool’s Gold, Scott Shane, a professor of entrepreneurial studies at Case Western Reserve University, argues that observers focus on fabulously successful entrepreneurs, but what they do not realize is that these success stories are incredibly rare. Only a small number of entrepreneurs are really, really successful—and, by extension, only a small number of venture investors see large returns. The media contribute to this misperception because it is easy to tell the story of Google and of early Google investors, but it is much less interesting and more difficult to write stories about failure.

Nonprofit education entrepreneurs generally raise their startup capital from venture philanthropy firms like NewSchools Venture Fund and the Charter School Growth Fund, or from individual donors and foundations. Only a few foundations are comfortable with taking a risk on entrepreneurial education organizations. Those that do make these early funds available—usually multimillion-dollar grants over the course of several years—tend to be younger foundations, like the Eli & Edythe Broad Foundation, the Milton Friedman Foundation, the Michael and Susan Dell Foundation, and the Bill & Melinda Gates Foundation, that have embraced the modern school of venture philanthropy.

Before the relatively recent emergence of these new foundations, funders tended to provide these early grants in only small increments, forcing entrepreneurs to spend enormous amounts of time and energy on fundraising from multiple donors. In addition, foundation officials found it far more palatable to support a host of small, capacity-building grants than to make concentrated bets on greenfield ventures. Foundation officials rarely get in trouble for failing to have an impact, but can quickly get into hot water for supporting politically contentious measures. For this reason, traditional funders have historically preferred to support professional development, curricular reforms, mentoring programs, and similar efforts that are broadly popular and appear to be risk-free.

What Is Venture Capital?

Crucial money for greenfield ventures is startup fund­ing—the kind of investments that are often referred to in business magazines or popular culture as “venture capital.” Venture capital plays a key role in launching and supporting the firms responsible for innovation and growth in the U.S. economy.

Companies backed by venture capital include many of today’s titans, like Intel, Microsoft, Medtronic, Apple, Google, Genentech, Starbucks, Whole Foods, and eBay. In 2007 and 2008, the National Venture Capital Association reports that there were more than 2,400 venture capital deals worth more than $13 billion in the United States, with the bulk of activity concentrated in knowledge-driven industries like software, biotechnol­ogy, medical devices, and energy. One would normally expect to see education comfortably ensconced on a list like that—yet it is nowhere in sight.

Since such funding is largely alien to most individuals involved in K–12 education, it is worth taking a moment to understand how venture capital typically works. What exactly is a venture capital fund? It is typically an invest­ment fund initiated by a group of partners who contrib­ute their own money and then raise additional dollars from outside investors. The partnership agreement spec­ifies both the lifespan of the fund (typically 10 years) and the management fee. As Joe Keeney and Daniel Pianko have explained [in Hess, The Future of Education Entre­preneurship], “The typical management fee structure is ‘two and twenty’—that is, 2 percent per year of the total capital raised, plus 20 percent of the profits after…100 percent of their invested capital [has been recovered] at the end of the fund’s life.” Over those 10 years, venture firms raise funds, pursue promising investments, and eventually exit by selling their stakes.

Given the risks, venture capital investors seek to win big or cut their losses. For this reason, they typically provide only enough funding for a venture to reach the next stage of development, so that it can attract sup­port from those with a smaller tolerance for risk. This need to realize investment returns leads new ventures to focus on becoming successful enough to attract buyers, which involves a private transaction or “going public” and selling shares of stock. And a venture capi­talist’s aim—to win big on the front end and get out fast once the profit is made—leads venture firms to identify an exit strategy early on.

Growth Capital
For an education entrepreneur, finding startup capital is challenging, but fundraising for growth can be even tougher. For-profit companies that have a good track record may find that venture capital firms such as Quad Ventures are willing to invest in growth for later-stage education organizations with promising early results. Even venture capital firms that don’t focus on education are willing to entertain the notion if they see a successful business emerging.

Nonprofits, on the other hand, have a much more difficult time attracting growth funds. They struggle to raise the kind of large, multiyear investments needed to support expansion because even terrific nonprofit ventures cannot deliver a handsome return to investors. In addition, there is a perverse incentive for growing nonprofit organizations: The better the organization is doing, the more likely donors are to drop their support, believing they have done their part or are no longer needed. As such, many foundations seem willing to support strong nonprofit organizations and help them expand on a limited scale, but few are willing to sustain an organization as it grows over time.

It is especially difficult to raise large amounts of funding from foundations because, according to federal regulations, program officers need only spend 5 percent of the foundation’s total assets each year in the form of grants and other expenses. Except in unusual cases, the other 95 percent of a foundation’s assets are not used to fund grantees but instead are invested for the long term to preserve its endowment. If foundations are to seek a bigger impact, they may need to tap these endowments more aggressively.

One possible strategy for augmenting the available funding relies on program-related investments, which are loans that come from endowment funds. Several foundations, including the Walton Family Foundation and the Annie E. Casey Foundation, have made program-related investments to help charter school entrepreneurs secure facilities for their schools. There is room for more such investment: According to the Foundation Center, foundations nationwide hold nearly $500 billion in their endowments, but use just over $200 million of that for charitable loans or program-related investments—less than one-twentieth of 1 percent.

Nonprofits and philanthropies that have taken on the explicit mission of helping other nonprofits grow include the Growth Philanthropy Network, the Draper Richards Foundation, the Robin Hood Foundation, and the Tipping Point Community. The Draper Richards Foundation, for instance, was founded by famed venture capitalist Bill Draper and seeks to give nonprofits both management knowledge (a Draper Richards board member sits on participating nonprofits’ boards) and capital in their infant stages ($100,000 per year for three years).

Another foundation that is doing things differently is SeaChange Capital Partners, which makes multimillion-dollar infusions to help established nonprofits grow. SeaChange was founded by Chuck Harris, a retired Goldman Sachs partner. Harris had previously worked with nonprofit organizations and noted a serious problem. He explains [in Philanthropy News Daily]:

I was involved with a couple of non-profit organizations that had fantastic management, good results, a fair amount of financial discipline, and were ambitious. And if they had been for-profit businesses at a similar stage of development, they would have gone out and raised a multi-million-dollar, multi-year round of funding tied to their business plan. Instead, they were sending out scattershot proposals for relatively small amounts of money over short periods of time. In other words, there was no financial certainty…[and] the most senior people in the organization were spending a disproportionate amount of their time fundraising as opposed to driving the ship. It seemed to me to be a very ad hoc, inefficient, and restrictive way to grow.

SeaChange adopts Wall Street methods to support proven nonprofits with ambitious growth plans. Harris explains the key shift is “seek[ing] to fund the business plans of these nonprofits rather than [to] fund a piece of their program…. We plan to conduct the financing much like a private placement in the business sector, with the goal of raising $5 million, $10 million, $15 million for organizations on the threshold of a growth phase.”

Scrambling for Startup Capital

Eric Adler is cofounder and managing director of the SEED Foundation, a grades 7–12 boarding school in Washington, DC, that has won awards from Harvard University’s Kennedy School of Government and other entities for its astonishing success sending at-risk kids to college. Adler relates how he and cofounder Rajiv Vinnakota struggled to find funding for the initial DC boarding school. At first, Adler explains, “We thought we were going to build a private school.”

After a quick survey of boarding program costs and what it would require in terms of annual funding or raising an endowment, however, Adler and his partner concluded that “it was not economically feasible. We would have been talking about many hundreds of millions of dollars of endowment. Or it would have meant raising money hand-to-mouth year after year.” Instead, Adler and Vinnakota began looking at nonprofit models in which the government might provide startup capital and then SEED would raise money annually to sustain the school. “You get the slug up front because everyone needs some activation energy and some capital to get going and then after that you raise the money year after year,” Adler explains. But, he adds, “We…pretty quickly concluded that that wasn’t going to work, either. Because, again, it was going to involve a level of annual fundraising that just wasn’t sustainable.”

After dismissing those two stratagies, Adler wondered, “Could [we] reverse it? Could [we] go to the private sector and get the upfront slug of money in exchange for getting the public sector to promise the operating costs indefi­nitely?” This led the SEED Foundation to charter schooling. Adler recalls Vinnakota and himself approaching DC and fed­eral officials and saying, “In exchange for the private sector putting up a whole bunch of new facility money, would you be willing, then, to pay the difference between the regular day cost and the boarding cost?” And they were talking simul­taneously to philanthropists and private-sector investors, saying, “Yes, we need to raise a bunch of money from you now, and we’ll still have to raise some in the first few years while we’re getting up to scale. But once we get up to scale, we promise we’ll never come back to you saying we won’t survive unless [you’re willing to provide additional support].” This strategy allowed the SEED Foundation to raise the required $25 million for the 1999–2003 launch of the school.

Sustaining Capital
Entrepreneurial K–12 ventures launch and grow with private capital or philanthropic support. Once up and running, however, sustainable ventures seek to rely on earned income from fees or the sale of products or services. However, despite increasing acceptance of income-generating for-profit and nonprofit organizations, few education entrepreneurs have built models that sustain themselves on these revenues alone. And, as Dan Katzir and Wendy Hassett of the Eli & Edythe Broad Foundation have observed [in Hess, With the Best of Intentions], “Many foundations will not support a grantee for more than a specified number of years, regardless of where the organization is in terms of its growth cycle.” This means that nonprofits scramble to offset the loss of philanthropic support by finding ways to sell their services or by finding new funders, while for-profits seek to achieve a scale that makes them economically viable. One of the few successful school builders to have addressed this challenge is National Heritage Academies, a for-profit charter operator that enrolls 35,000 students in 57 schools across 6 states and has managed to attain profitability while generating impressive academic outcomes. Even academically successful ventures, however, have found it challenging to mimic NHA’s financial success.

Although some nonprofit education entrepreneurs can support their organization’s ongoing operations through public funding—such as by per-pupil dollars that flow to charter management organizations—most rely, at least in part, on fundraising from individuals and foundations. The limits to this approach are legion, however, as scholars estimate that total philanthropy to K–12 probably amounts to less than $3 billion a year—or less than 1 percent of all K–12 spending [as shown in Figure 1]. To date, entrepreneurial ventures have been disproportionately funded by this tiny sliver of funding—and especially by funds from younger foundations with roots in the 21st-century economy.

Some leading “new” philanthropies, like the Gates, Walton, and Broad Foundations, have attempted to adapt the venture investment mind-set to the social sector. Funders have begun to weigh criteria like scalability and financial sustainability more heavily, have taken seats on nonprofit boards, and have requested regular performance updates. This marks a shift in thinking—though it’s a development that has also encountered skepticism as to how willing these funders actually are to take bold chances and whether their efforts sometimes cross from smart oversight into micromanagement. Whatever one makes of such concerns, it is clear that support from philanthropic funders has proven instrumental in launching or expanding heralded greenfield ventures like KIPP, New Leaders for NewSchools, Aspire Public Schools, College Summit, Green Dot, and Achievement First.

In education circles, the two best-known venture philanthropies may be the decade-old NewSchools Venture Fund and the much younger Charter School Growth Fund. The San Francisco-based NewSchools Venture Fund secures investments from both for-profit and nonprofit sources and then seeks to provide startup capital to ventures—both nonprofit and for-profit organizations—that are sustainable and designed to achieve scale. The Colorado-based Charter School Growth Fund, with over $150 million in support, provides grants and loans to promote the growth of high-quality charter management and support organizations. These venture philanthropists accept that some investments will fail, so long as the failures are the product of efforts to address hard, important challenges. As the Broad Foundation’s Katzir and Hassett have explained, “We do not regard our grantmaking as charity…[but] think of our work as making investments in areas in which we expect a healthy return.”

The post Fueling the Engine appeared first on Education Next.

]]>
49697424
A Closer Look at Charter Schools and Segregation https://www.educationnext.org/a-closer-look-at-charter-schools-and-segregation/ Tue, 27 Apr 2010 00:00:00 +0000 http://www.educationnext.org/a-closer-look-at-charter-schools-and-segregation/ Flawed comparisons lead to overstated conclusions

The post A Closer Look at Charter Schools and Segregation appeared first on Education Next.

]]>
In January 2010, the UCLA-based Civil Rights Project (CRP) released “Choice without Equity: Charter School Segregation and the Need for Civil Rights Standards.” The study intended to report on, among other things, levels of racial segregation in charter schools across the United States. The authors use 2007–08 data from the U.S. Department of Education’s Common Core of Data (CCD) to compare the racial composition of charter schools to that of traditional public schools at three different levels of aggregation: nationwide; within 40 states and the District of Columbia; and within 39 metropolitan areas with large enrollments of charter school students. Based on these comparisons, the authors conclude, incorrectly in our view, that charter schools experience severe levels of racial segregation compared to traditional public schools (TPS).

We will show that, when examined more appropriately, the data actually reveal small differences in the level of overall segregation between the charter school sector and the traditional public-school sector. Indeed, we find the majority of students in the central cities of metropolitan areas, in both charter and traditional public schools, attend school in intensely segregated settings. Our findings are similar to those in a 2009 report by RAND, in which researchers focused on segregation in five large metropolitan areas (Chicago, Denver, Milwaukee, Philadelphia, and San Diego) — areas that were also included in the CRP report. The RAND authors, with the benefit of student-level data, follow students who move from traditional public schools into charter schools and conclude that these transfers have “surprisingly little effect on racial distributions across the sites.” The authors of the RAND report write:

Across 21 comparisons (seven sites with three racial groups each), we find only two cases in which the average difference between the sending TPS and the receiving charter school is greater than 10 percentage points in the concentration of the transferring student’s race.

The RAND report, based on a superior methodology, provides strong evidence that the CRP claims are off base. Their findings, coupled with our own, offer a significantly different portrayal of segregation in charter schools than the CRP report. We find no basis for the allegations made by the CRP authors, who argue that charter-school enrollment growth, based on the free choices of mostly minority families, represents a “civil rights failure.”

While we find fault with the methodology employed by the CRP authors, and with their conclusions, we recognize that the questions addressed by the CRP, in this report and in scores of earlier ones, concern issues of importance for policymakers and the public alike. With the billions of dollars invested each year in public schools, both traditional and charter, and the millions of hours that we compel our children to attend these schools, it is critical that we have a basic understanding of the school environment that we are providing. Moreover, given the history of forced racial segregation in our nation’s schools, we must be ever-attentive to these issues.

Indeed, because these questions are of such significance, it is imperative that they be addressed carefully and correctly.

The Wrong Approach

Unfortunately, the analyses employed in the CRP report do not meet this standard. The authors begin by presenting a great deal of descriptive data on the overall enrollment and aggregate racial composition in public charter schools compared to traditional public schools. Based only on enrollments aggregated to the national and state level, the authors repeatedly highlight the overrepresentation of black students in charter schools in an attempt to portray a harmful degree of segregation. But comparisons of simple averages at such a high level of aggregation can obscure wide differences in school-level demographics among both charter and traditional public schools. It is like having your feet in the oven and your head in the icebox, and saying that, on average, the temperature is just right.

After this descriptive overview, the authors address the question of racial segregation in a more appropriate way. In this analysis, the CRP authors define as “hypersegregated” any school with a 90 percent minority population or a 90 percent white population. Their aim is to determine if charter students nationwide are more or less likely to attend school in such hypersegregated environments. However, a critical flaw undermines this comparison and all of the analyses that follow. In every case, whether the authors examine the numbers at the national, state, or metropolitan level, they compare the racial composition of all charter schools to that of all traditional public schools. This comparison is likely to generate misleading conclusions for one simple reason, as the authors themselves point out on the first page of the executive summary and then again on page 57 of the full report: “the concentration of charter schools in urban areas skews the charter school enrollment towards having higher percentages of poor and minority students.”

In other words, the geographic placement of charter schools practically ensures that they will enroll higher percentages of minorities than will the average public school in the nation, in states, and in large metropolitan areas. Further, because serving disadvantaged populations is the stated mission of many charter schools, they seek out locations near disadvantaged populations intentionally. Instead of asking whether all students in charter schools are more likely to attend segregated schools than are all students in traditional public schools, we should be comparing the racial composition of charter schools to that of nearby traditional public schools. Employing this method, we could compare the levels of segregation for the students in charter schools to what they would have experienced had they remained in their residentially assigned public schools.

If we acknowledge this standard for valid comparisons, we can quickly dismiss the national and state-level comparisons, which constitute the bulk of the CRP report. According to the authors’ own numbers in Table 20, more than half (56 percent) of charter school students attend school in a city, compared to less than one-third (30 percent) of traditional public school students. Thus, any national comparisons are inappropriate, as these two groups of students are inherently dissimilar. The authors employ this same flawed strategy individually for each of the 40 states included in their analysis. Again, comparing the segregation in charter schools in a state, which are concentrated in heavily minority central cities, to that in traditional public schools throughout the state, reveals nothing about the reality of racial segregation in charter schools.

The examples that the authors draw from these state-level comparisons are almost humorous at times. For example, consider the following point from page 43 of the report:

In some cases, like Idaho, charter school students across all races attend schools of white isolation: majorities of students of all races are in 90–100% white charter schools.

No kidding! The state of Idaho is nearly 95 percent white. Obviously, this is not a charter phenomenon, yet the authors brazenly use this as evidence for their claims without making any mention of the corresponding figure for the traditional public schools in the state.

Finally, the authors consider the hypersegregation in charter and traditional public schools individually within 39 metropolitan areas. But even within the large Census Bureau–defined Core-Based Statistical Areas (CBSAs) used as proxies for metropolitan areas, charters are still disproportionately located in low-SES (socioeconomic status) urban areas, while traditional public schools are dispersed throughout the entire CBSA. For example, the authors note that in the Washington, D.C., CBSA, 91 percent of students in charter schools attend hypersegregated schools, while only 20 percent of students in that same area attend hypersegregated traditional public schools. A quick look at the geographical placement of charter schools in the D.C. metro area, however, shows why such a comparison is inappropriate. The D.C. metro CBSA contains 1,186 traditional public schools, 1,026 of which are in Virginia, Maryland, and even West Virginia; only 13 percent of the traditional public schools in the D.C. CBSA are actually situated in the racially isolated District of Columbia. On the other hand, 93 percent of the charter schools in the D.C. CBSA are located in D.C. In other words, nearly all of the area’s charter schools are in D.C., while the vast majority of the traditional public schools the authors use in their comparisons are located in the largely suburban or exurban areas of surrounding states. For the 39 CBSAs examined by the authors, only 22 percent of the traditional public schools were located in central cities, compared to 51 percent of the charter schools.

A Tighter Comparison

It is indeed likely that, with the right analysis and the proper questions, the conclusion would not be as clear as portrayed by the CRP authors. We modified the CRP analysis by comparing the percentage of students in hypersegregated minority charters within the central city of each CBSA to the percentage of students in hypersegregated minority traditional public schools within the same central city. For example, for the Washington, D.C., CBSA, we included only schools located within the District of Columbia. The data we obtained for this comparison are publicly available from the Common Core of Data, so the CRP researchers could have conducted their analysis at this level. Of course, even this analysis is not perfect. Only following students at the individual level would reveal precisely what effect charters are having on segregation.

We focus our reanalysis on the data presented by the authors in their report, (Table 10). The focal measures in this table are shown in the last two columns, where the authors present the percentage of charter school students (from the entire metropolitan area) in schools with greater than 90 percent minority students alongside the similar figure for traditional public schools. The problematic figure in this table is the percentage of traditional public school students in hypersegregated schools used as the point of comparison. (See Table 1) which shows the bias entailed for the 8 largest metropolitan areas by the CRP report.

Whether or not we believe that charter schools are more segregated than traditional public schools depends largely on which set of traditional public schools serve as a comparison. The data for these eight very large metropolitan areas, representing more than half of the enrollment for the entire dataset, demonstrate how the CRP method overstates the relative levels of segregation in the charter sector. For example, under the CRP method, 91.2 percent of the charter students in the DC CBSA are in hypersegregated minority schools, as compared to just 20.9 percent of the students in traditional public schools. Using the central-city method, the percentage of students in hypersegregated minority charters stays roughly the same, but the percentage of students in hypersegregated minority traditional publics skyrockets to 85 percent.

In fact, in the vast majority of the 39 metro areas reviewed in the CRP report, the application of our central-city comparison decreases (relative to the flawed CRP analysis) the level of segregation in the charter sector as compared to the traditional public school sector. (Click here to view a table with these figures for all 39 CBSAs.) Importantly, unlike the CRP authors, we also compute and present the overall average results. Using the best available unit of comparison, we find that 63 percent of charter students in these central cities attend school in intensely segregated minority schools, as do 53 percent of traditional public school students (see Figure 1). Thus, while it appears that charter students are, on average, more likely to attend hypersegregated minority schools, the difference between the charter and traditional public sector is far less stark than the CRP authors suggest.

The Right Question

Our analysis presents a more accurate, but still imperfect, picture of the levels of racial segregation in the charter sector relative to the traditional public-school sector. Ideally, to examine the issue of segregation, we would pose the question, Are the charter schools that students attend more or less segregated than the traditional public schools these students would otherwise attend? Unfortunately, our data linking schools to cities do not allow for this analysis.

Even within many of the central cities in the metropolitan areas listed above, there is a great deal of racial segregation. And most available data suggest that charter schools are popping up in areas where the students are poor and disadvantaged and need additional educational options. Public charter schools are simply less likely to open in economically advantaged, mostly white neighborhoods. Thus, even our analysis likely underestimates the true levels of racial segregation in the specific traditional public schools that charter students are leaving. Indeed, a more fine-grained analysis (similar to the study conducted by RAND) in which we compared the levels of segregation in public charter schools to that of the traditional public schools in the same neighborhood would be preferable. The RAND report is particularly relevant here because it focuses on student-level data from Chicago, Denver, Milwaukee, Philadelphia, and San Diego, five metropolitan areas highlighted in the CRP report. By examining student-level transfers, the authors are able to determine the extent to which students move into schools with higher concentrations of their own race and thereby increase the overall level of segregation. Using this strategy, the RAND researchers found,

Transfers to charter schools did not create dramatic shifts in the sorting of students by race or ethnicity in any of the sites included in the study. In most sites, the racial composition of the charter schools entered by transferring students was similar to that of the TPSs from which the students came.

Our own similar analysis of student-level transfers to charters in the Little Rock, Arkansas, area over the past five years tells much the same story. While many of the students transferred into Little Rock charter schools that were racially segregated, these students generally left traditional public schools that were even more heavily segregated.

Conclusion

The authors of the Civil Rights Project report conclude,

Our new findings demonstrate that, while segregation for blacks among all public schools has been increasing for nearly two decades, black students in charter schools are far more likely than their traditional public school counterparts to be educated in intensely segregated settings.

Our analysis suggests that these claims are certainly overstated. Furthermore, the authors fail to acknowledge two significant truths.

First, the majority of students in central cities, in both the public charter sector and in the traditional public sector, attend intensely segregated minority schools. Neither sector has cause to brag about racial diversity, but it seems clear that the CRP report points its lens in the wrong direction by focusing on the failings of charter schools. As the authors themselves note, across the country only 2.5 percent of public school children roam the halls in charter schools each day; the remaining 97.5 percent are compelled to attend traditional public schools. And we know that, more often than not, the students attending traditional public schools in cities are in intensely segregated schools. If we are truly concerned about limiting segregation, then this is where we should look to address the problem.

Second, and perhaps more important, the fact that poor and minority students flee segregated traditional public schools for similarly segregated charters does not imply that charter school policy is imposing segregation upon these students. Rather, the racial patterns we observe in charter schools are the result of the choices students and families make as they seek more attractive schooling options. To compare these active parental choices to the forced segregation of our nation’s past (the authors of the report actually call some charter schools “apartheid” schools) trivializes the true oppression that was imposed on the grandparents and great-grandparents of many of the students seeking charter options today.

Gary Ritter is professor of education policy at the University of Arkansas. Nathan Jensen, Brian Kisida, and Joshua McGee are research associates in the Department of Education Reform at the University of Arkansas.

The post A Closer Look at Charter Schools and Segregation appeared first on Education Next.

]]>
49697415