Saturday, February 1, 2014

Worth a thousand words?

I saw this picture on the side of one of the regional transit shuttles in our area.



It plays on and invokes the oft-cited statistics about graduation rates and reading.  Seems simple enough...if Billy can't read by 3rd grade he has a much higher chance of dropping out than William, who can.

The story and the causal relationships embedded therein are complicated, though. Statistically, the correlations work, but discerning causality within those correlations is more tricky.

The presumed causality represented in that picture is that if we make sure Billy can read by 3rd grade, his chances of graduating will become much higher.  Education being a complex process, though, Billy's learning to read by 3rd grade is only part of the story.  For instance, the number of "sample" children in the picture would likely be similar if we were creating a claim about being underfed.  

"One of these (3?, 4?) children won't graduate if they're underfed."

The point is that many factors go into "graduating," which implicitly stands in for "gets educated" in this claim.  Reading is no doubt critical, but many factors contribute to the process called "learning to read," and it's just possible that some of them are (chrono)logically prior to "reading by third grade."

In other words, just relying on a connection between Billy's reading by third grade and his graduation assumes a host of prior and subsequent factors that we need to be more careful to consider.  

Imagine this scenario.  Billy is behind in his reading in second grade, for a wide variety of reasons.  Some sort intervention program gets him caught up in third grade, so that he is "reading" by third grade.  We changed the story, as the billboard says.  

But the story is hardly over.  Quite likely, the reasons that Billy was behind in 2nd grade are still present.  He's underfed (i.e., he lives in poverty, which has lasting effects on educational performance), he lacks educational support outside school, his family circumstances distract and distress him, or a combination of all 3 (and others).  

Billy may find that he routinely slips behind.  In fact, school has not been a particularly pleasurable pursuit (at least not academically), so he neglects it.  If reading and "schooling" more generally are not supported and encouraged (we have to have signs like the one above because education competes with a lot of non-educational social impulses in our culture, after all), Billy may well retain his disinterest in school, even though he was able to "read" in 3rd grade.

What is "reading by 3rd grade" after all?  Even the best 3rd grade reader would be woefully unprepared for education or life if their reading abilities remained at 3rd grade level permanently.  So the claim on the poster seems to presume that if we could just make sure children can read by third grade everything else thereafter will happily?, comfortably?, reliably?, automatically?, effortlessly? fall into place.

But if Billy struggled for 3 years prior to finally "getting it," school may have become an unpleasant enough process that he will forever have a distaste for it.  Getting caught up in his reading may not unlock the necessary enthusiasm, commitment, organization, etc., required to successfully do the remaining 8 years to graduation.

And what is "graduate"?  Some day, people will realize that the markers we've established as proof of "education"--both that earned by students and produced by schools--are beyond dubious, they're ridiculous.  "College and career ready" is a shibboleth, and probably more than traditional high schools can do.  (More on that some other time.)  The curtain to pull back today, though is the one that hides the fact that "graduation" and "college/career ready" play out very differently in high schools.

I'm not sure exactly why people don't realize that when you incentivize principals, teachers and schools to improve their graduation rates you will cause them to scramble to get students graduated by whatever means they can.  As more than one high school colleague has told me, "We bend over backwards to get these kids to graduate."  And that often includes so-called credit retrieval programs that aren't exactly the regular course of school study.  But as long as people don't take too close a look at what those programs are, and whether they actually give any kind of worthwhile education to those students who use them, we can all be proud of our increasing graduation rates.

Please don't misunderstand....you should go volunteer somehow to help the Billys of the world do better in school.  Because education is an arduous, sloppy, time-consuming process, it's going to be more difficult than the advertisement makes it appear.


Thursday, January 30, 2014

The Objects of Education


If you've ever watched The Wire, or you're interested in education, you might like to read "Political Geographies of the Object," a quite interesting analysis about the way the show presents “the test” and schools. (Contact me, I can set you up with the whole article--I've pasted in the section on the test below.)

Preceding the discussion of the test, the authors explain “object-oriented philosophy.”  Basically, they contend that objects—wiretaps, cell phones, standardized tests—have potent capacity to affect behavior, relationships, and especially power.  As best I can tell, objects both empower and constrain actions, and the authors are particularly concerned with how objects shape “stateness” and expressions of state authority in the lives of people.  The wiretap itself, for instance, was first used in the 1930s, and the court initially said that conversations were not protected “things” (so the absence of a warrant did not invalidate those initial taps).  When the court overturned this decision in the 1960s, the authors observe, it was effectively acknowledging that conversations are protected “things.”  The wiretap caused a reconsideration of what a conversation is and how those things may or may not be governed by state authority and power.  In other words, the object (wiretap) caused a reconsideration of the conversation as “thing,” which caused a review of state power and behavior.  Along the way, the wiretap and the conversation moved to a status as “object” that requires understanding and evaluating their nature and role in the power relationships between the state and the people.


The authors point out that the show makes a similar analysis of the standardized test….

From the article:
The test
Surveillance technologies like wiretaps and cameras are perhaps the lowest-hanging fruit, the most obvious tools in facilitating a state effect. The mundane and routinized school test of Season 4, however, is perhaps the most potent of all objects on The Wire. In the process of examination to determine competency, a test elicits excitement, hope, determination, confidence, and even hubris; it also upsets stomachs, causes anxiety and headaches, euphoria and suicide. A test may evoke strong emotions, but it achieves more: the test e and its allies e increasingly organizes and cultivates a state effect in the lives of children. Tests restrict the exchange of information between teachers and students to a circumscribed set of possible connections and pathways, standardizing the discovery of knowledge.

The test, too, is an object. The reduction of a test, however, to its brute materiality --pens and paper, or computers and mice-- completely misses the action that the test itself mobilizes in the world. An object like the test doesnt replace the humanas the sole explanandum of stateness (any more than the human is able to fully produce the state effect); rather it enlarges it, opens it up, and sees power as it is performed in action, constantly made and remade by the bits and pieces of the world. While educators design and create the test, tests are also autonomous, able to transform their creatorsthrough the (metaphysical) conditions they set in motion. This is the reverse adaptationthat Langdon Winner (1977, p. 229) describes as the adjustment of human ends to match the character of the available [technological] means.

Over the past 25 years, standardized tests have reversed engineered the US public educational system. The Season 4 test is a simulacrum of the mandated achievement test that emerged in response to the 1983 report of the US National Commission on Excellence in Education, A Nation at Risk. The report warned that if the country were to remain economically competitive at the inter- national level, the skills of the nations workforce would have to improve dramatically. By 2001, the standardized achievement test became the cornerstone of the Bush Administrations No Child Left Behind policy. Nearly all US states have reset content and performance standards, intended to enforce more rigorous teaching and learning expectations, through new systems of school and teacher accountability for test scores (Hurst, Tan, Meek, & Sellers, 2003).

In Season 4, administrators, teachers and students, textbooks, classrooms, and the teachers lounge at Edward J. Tilghman Middle School are pulled into the tests force field: shaping how lessons are taught and ultimately reinforcing the already limited options of these underclass students from inner city Baltimore. Not only is the test deployed to assess the capabilities of students but it also becomes, by association, a test of Tilghman (as an institution) and of the teachers (and their ability to teach effectively). As such, the test becomes one of a multitude of objects (including books, computers, pencils, uniforms, hall passes, school lunches, etc) that collaborate to affect how the students relate to each other and to their teachers and how the teachers relate to each other and to administrators.

Importantly, the test also resists the aims of its original formulation. Based on the premise that setting high standards and establishing measurable goals can improve individual outcomes in education, the test instead tends mostly to measure how well students are trained to take it. Moreover, the incentives for continued improvement of student scores has caused many states to actually lower their official standards. One result of this variability in standards was identified in a study by the National Center for Education Statistics (2007), which reported that the differences in the fifty statesobserved test scores were largely due to differences in the stringency of each states standards.

The paradoxical relationship between testing and learning is demonstrated in The Wire through the character of Prez, who by Season 4 has left the police force and now teaches math at Tilghman. By mid-season, after some false starts, Prez actively engages the students in math exercises that encourage them to use their knowledge of the streets and the illicit economies in which many of them operate. Students are ecstatic: they solve probabilities using dice games, building confidence, joking around, and working in teams. But during later episodes, Prez is increasingly pressured to switch from this organic form of learning to working through abstract problems e phrased in the dry language of the Maryland State Assessment test e as test daygets nearer. In a scene from episode 9, assistant principal Marcia Donnelly informs Tilghman teachers that they all must dedicate class time to help students prepare for the reading comprehension section of the upcoming state test, in order to raise the schools overall test score. Even Prez, as a math teacher, must take on reading comprehension. In ensuing scenes, his students grow bored and restless while he attempts to instruct them on how to correctly answer test questions through reference to material on classical Rome. Unsurprisingly, the topic has no intuitive resonance with the students and it soon becomes clear that the lesson is a terrible failure, signaling as it does, future failure. In episode 4, Howard BunnyColvin --a former police major who eventually becomes a field researcher on a University of Maryland grant studying repeat offenders among Baltimore youth e makes a cogent observation:

Bunny: Kids right. This is bullshit. 
Parenti: Test material doesnt exactly speak to their world. 
Bunny: Yeah, it dont speak loud to mine, neither.

Bunnys terse observation recognizes the test as having the power to configure learning as a theoretical activity rather than a situated educational moment in the lived experience of the students. As viewers, we can also see the test at work organizing a set of expectations about students as laborers-in-training being prepared to participate in an imagined future workforce and a way of life that simply isnt open to them.

Perhaps the most forceful aspect of the test is its ability to produce statistics that script the future of the schools, its students, and its teachers. The Wire demonstrates how the test unleashes a catalog of statistics that drive teacher and course preparation; circulate between the classroom and the teacherslounge; and cause anguish and disagreements as well as resignation and defiance. US educational research has demonstrated how statistics are a highly problematic measure of achievement (Popham, 1999) forcing students to become consumers of certified knowledge rather than guided producers of enabling knowledge and informed action. As research by Porter-Magee (2004) found, in the United States the standardized test and the resultant focus on achievement statistics also inhibits teacher quality by constraining the autonomy of teachers as situated pedagogues and turning them instead into agents of mass production. Even more powerfully, the statistics open or close doors to student futures, producing myriad practices that in most cases aggravate rather than solve their problems of underachievement. Again, Bunny Colvin, in episode 10, makes a telling point about the test in a conversation with his University of Maryland boss, Dr. David Parenti.

Bunny: Hold on, hold on. Look, what hes saying is this: you can put a textbook in front of these kids. Put a problem on the blackboard, teach em every problem on some statewide test -- it wont matter, none of it. Cuz they not learninfrom our world, they learninfrom theirs. And they know exactly what it is they training for and exactly what it is everyone expects them to be.

The test -- and the subsequent statistics that facilitate its generalizable meaning -- serves to draw a boundary around teaching and learning practices. It enables some ideas to be thought while others become peripheral, outside the bounds of legitimate knowledge. The result is that the subjects being taught in school get narrowed down to put more emphasis on the subjects being tested, which inevitably constrains the studentsrange of knowledge, not to mention their confidence and expectations. Ultimately, as Guisbond and Neill (2004, p. 13) argue, the emphasis on the standardized test in the United States ignores real factors that impede improvements in teaching and learning, such as large class sizes, inadequate books, and outmoded technology, as well as nonschool factors like poverty and high student mobility. These problems are no more apparent than at Tilghman, where students like Dukie face homelessness and Michael has to care for his little brother (even picking him up at parent- teacher night) and drug-addicted mother, while scrimping together a household budget from welfare.

The test also reconfigures the spaces in which it operates. While it would be exaggerating the power of the test to suggest that it determines everything that happens in the middle school class- room, it would be equally problematic to ignore the profound effects and affects it produces. When the mode of teaching shifts from students solving math problems by relating them to calculations that are a part of their daily lives to one where they are expected to solve standard abstract word problems based on unfamiliar normative assumptions, the classroom becomes a site of frustration and boredom where pleasure, excitement, enthusiasm are curtailed along with improvisation, creativity, and questioning. Not only does the test shape the intimate spaces of the classroom, it also affects e as Guisbond and Neill (2004) contend with respect to US education more generally e the ability of all schools to attract teachers, with low achieving schools in poor neighborhoods being doubly disadvantaged. Because academic progress is measured through the test e with all the problems that attend to it such as cultural bias, failure to measure higher-order thinking, and the problem of measurement error -- an urban geography of uneven educational achievement results.

As Season 4 reveals, when the schools in the largely white and more affluent suburban Baltimore County get compared to the schools in the largely black and lower socioeconomic neighbor- hoods of the city of Baltimore, a geography of achievement and failure becomes solidified, condemning some schools to further impoverishment while others grow more affluent in resources. As well, the test produces a hypothetical and homogeneous national space of content standards and curricular preferences while the sites of its actual application are ones where heterogeneity proliferates. The test generates a force field that reorients bodies, other objects, and spaces e all of which must, in the words of Assistant Principal Donnelley, teach to the test. Encountering the test in The Wire is to recognize it not as a benign entity that neutrally proceeds along innocuous pathways; instead, it activates, sorts, elevates, rejects, overwhelms and deactivates the objects and assemblages of objects it encounters constituting a geography of success and failure that reshuffles life chances by devaluing organic and experiential knowledge production for the sterility of certified facts.


Saturday, December 28, 2013

April 21

The Normal Accident Theory of Education: Why Reform and Regulation Won't Make Schools Better is due out in April, from Rowman & Littlefield.  I've offered up some of this before, so I won't say a lot about it.  If you've read this blog through the years, you'll recognize some of the material, though not all of it.  

I enjoyed the whole process of writing this book enough that I'm already considering the next one--Why the Common Core State Standards Won't Ruin Education...Even Though They're Bad Enough To Do So. Clunky title, so maybe I'll work on that.  The point is that I've just started looking at CCSS material in more depth, for some "professional development time" I'm doing with my next door neighbor colleague.  

The standards are fine enough--for English they aren't all that different from what I've been doing.  What people say about the standards can be a bit--well, more than a bit--bizarre.  I'll start with this gem. "Reading, like any activity, is never subjective."  This, according to the purported authors of the CCSS (nobody is quite sure precisely who authored them) is why we should teach text only and strip away background and context.  For instance, see the explanation of why a teacher should mention nothing of what or why about the Gettysburg Address...just start 'em in on reading the text.  

The idea here is to plunge students into an independent encounter with this short text. Refrain from giving background context or substantial instructional guidance at the outset. It may make sense to notify students that the short text is thought to be difficult and they are not expected to understand it fully on a first reading — that they can expect to struggle. Some students may be frustrated, but all students need practice in doing their best to stay with something they do not initially understand. This close reading approach forces students to rely exclusively on the text instead of privileging background knowledge, and levels the playing field for all students as they seek to comprehend Lincoln’s address.


Problem is, of course, nobody actually reads or thinks like this.  And anything like knowledge or wisdom certainly does not pass on or cumulate through such a reading process.  Such an orientation does reflect, though, the intensive "skills" emphasis in reading teaching.  This (the CCSS process, not just the Gettysburg Address) seems to treat the skills of lower level reading mechanics (say, phonemic awareness) the same as higher level skills like inference and discernment of cause and effect the same.  

It's not at all clear to me why we think everybody can achieve the same level (no matter how high or low we set the level--if you set it low, some will go far above it) in reading and math, but we all know--without even thinking about it--that no matter how much we all train at dancing, singing, golf, painting or any number of other things, some will always be better than others.  (As is so often the case, Gladwell sketches dubious causation.  It's not that 10,000 hours will make you a virtuoso.  Rather, by sampling on the dependent variable--virtuosos--he "found" that they practiced for 10,000 hours.  Some initial conditions, namely, proclivities or gifts in the skill area, were present, thus motivating the greater commitment to practice.)

Reading's importance doesn't mean that all will achieve highly in it.   Education could be organized more effectively if we would all accept this.

Wednesday, November 20, 2013

The Tale of Turnaround in Three Tacoma Schools, or not

Percentages of student passing each standardized test in three Tacoma middle schools--Giaudrone, Jason Lee, and Stewart. The test years covered by the SIG were 2011, 2012 and 2013. 2009 and 2010 are included for comparison between SIG and pre-SIG performance. There are, then, at least two broad evaluations to make. First, pre-SIG and SIG scores. Second, growth during the SIG period. The score in parentheses is the percentage of 7th grade students passing the writing test. Only 8th graders take the science exam.  All data available on the OSPI report card web site.

Giaudrone
Reading
2009
2010
2011
2012
6th Grade
50.3
49.2
56.4
67.3
7th Grade
39.7 (54.9-Write)
46.6 (50.8)
38.0 (55.5)
56.7 (54.1)
8th Grade
55.4
58.3
64.1
58.8

6th grade scores show what seems to be a healthy improvement. 7th grade reading scores show improvement in the second year of the SIG, though writing scores remained essentially the same.  8th grade scores showed an initial bump, but returned to essentially where they had been before the SIG.
Following a student cohort (by moving one cell to the right and one cell down) reveals another mixed pattern.  2009 6th graders drop in reading at 7th grade, while they pass writing at the same rate as they passed reading in 6th grade. As 8th graders, they show significant improvement in reading. 2010 6th graders improve some in writing but drop significantly in reading at 7th grade. As 8th graders they show healthy reading improvement over their 6th grade scores. 2011 6th graders remain essentially the same in both reading and writing in 7th grade.


Giaudrone
Math
2009
2010
2011
2012
6th Grade
27.1
27.6
38.3
55.1
7th Grade
35.0
24.1
41.0
49.3
8th Grade
26.2
36.2
39.4
45.7

All 3 grades improved substantially over the 4 years. Follow the student cohort, and similar patterns of gain remain. Math, in other words, showed much more consistent improvement than did reading.

Giaudrone
Science
2009
2010
2011
2012
8th Grade
31.2
37.4
38.8
51.8



Jason Lee
Reading
2009
2010
2011
2012
6th Grade
51.5
37.1
40.5
63.4
7th Grade
38.8 (41.0)
36.9 (56.3)
35.8 (54.5)
51.9 (61.0)
8th Grade
60.5
44.4
49.0
50.7

6th and 7th grade showed improvement across the years, but 8th grade dropped. Following student cohorts shows little change for the 2009 6th graders. (It seems likely that their 7th grade year was more devoted to writing than reading.) 2010 6th graders showed writing improvement in 7th grade and reading improvement in 8th. 2011 6th graders showed substantial improvement in both reading and writing as 7th graders.

Jason Lee
Math
2009
2010
2011
2012
6th Grade
33.3
37.1
24.4
61.5
7th Grade
28.1
30.1
43.1
36.4
8th Grade
27.4
13.3
37.7
35.3

6th grade showed a sizable gain in the second year of the SIG. 7th and 8th showed modest gains, perhaps barely more than statistical wobbles. Student cohorts also showed fairly insignificant gains, except 2011 6th graders as 7th graders. By contrast with the Giaudrone, this school likely focused more on reading than math.

Jason Lee
Science
2009
2010
2011
2012
8th Grade
21.7
28.1
48.3
38.8



Stewart
Reading
2009
2010
2011
2012
6th Grade
57.0
37.3
49.0
48.3
7th Grade
39.9 (56.1)
33.9 (54.2)
36.7 (37.3)
53.8 (32.4)
8th Grade
54.7
52.9
47.1
40.0

The only worthwhile gains in reading were in 7th grade in the second year of the SIG. Cohort changes were insignificant, or negative.

Stewart
Math
2009
2010
2011
2012
6th Grade
33.0
19.6
30.6
34.2
7th Grade
33.7
24.3
25.9
18.7
8th Grade
29.8
27.6
25.2
11.7

By grade level and student cohort, there are no real gains here.

Stewart
Science
2009
2010
2011
2012
8th Grade
23.2
25.3
35.0
39.1