It's not often that I laugh out loud when I'm reading but I did when I read this (via Instapundit):
He was stunned by how complete the correlation was between length and score. "I have never found a quantifiable predictor in 25 years of grading that was anywhere near as strong as this one," he said. "If you just graded them based on length without ever reading them, you'd be right over 90 percent of the time." The shortest essays, typically 100 words, got the lowest grade of one. The longest, about 400 words, got the top grade of six. In between, there was virtually a direct match between length and grade.
He was also struck by all the factual errors in even the top essays. An essay on the Civil War, given a perfect six, describes the nation being changed forever by the "firing of two shots at Fort Sumter in late 1862." (Actually, it was in early 1861, and, according to "Battle Cry of Freedom" by James M. McPherson, it was "33 hours of bombardment by 4,000 shot and shells.")
Dr. Perelman contacted the College Board and was surprised to learn that on the new SAT essay, students are not penalized for incorrect facts. The official guide for scorers explains: "Writers may make errors in facts or information that do not affect the quality of their essays. For example, a writer may state 'The American Revolution began in 1842' or ' "Anna Karenina," a play by the French author Joseph Conrad, was a very upbeat literary work.' " (Actually, that's 1775; a novel by the Russian Leo Tolstoy; and poor Anna hurls herself under a train.) No matter. "You are scoring the writing, and not the correctness of facts."
How to prepare for such an essay? "I would advise writing as long as possible," said Dr. Perelman, "and include lots of facts, even if they're made up." This, of course, is not what he teaches his M.I.T. students. "It's exactly what we don't want to teach our kids," he said.
SAT graders are told to read an essay just once and spend two to three minutes per essay, and Dr. Perelman is now adept at rapid-fire SAT grading. This reporter held up a sample essay far enough away so it could not be read, and he was still able to guess the correct grade by its bulk and shape. "That's a 4," he said. "It looks like a 4."
It's a parody of good writing, but it might explain why I always had such trouble with it in school. I could never master the prose-for-its-own-sake genre. I always wanted to say something worthwhile - coming up with the content was the hardest part.
Posted by David Boxenhorn at May 4, 2005 04:54 PM | TrackBacksI understand bypassing minor grammatical errors and spelling errors in favor of intelligent discussion of fact, I can understand letting minor details slide. But having a basic grasp of the material is, well, basic, I would think.
Posted by: Rachel Ann at May 4, 2005 05:49 PM Permalink"Facts" are hegemonic.
Seriously, do you doubt that graders with any self-respect will take off for grossly mistaken facts?
Posted by: Attila (Pillage Idiot) at May 4, 2005 07:29 PM PermalinkI wouldn't think it's fair to take off for mistaken facts in a case like this, but I think that doing well on such a test is a special skill that has little to do with good writing. It's also likely to be unclear to the student just how it is graded.
Posted by: David Boxenhorn at May 4, 2005 08:04 PM PermalinkI am horrified. My flabber has never been so ghasted. Make it all up? This cannot be serious.
Posted by: Expategghead at May 5, 2005 09:41 AM PermalinkSomebody at ETS forgot to specify that it's a fiction-writing test.
Posted by: savtadotty at May 5, 2005 09:59 AM PermalinkIt makes sense when you think of the journalists who write such garbage.
http://me-ander.blogspot.com/2005/05/this-answers-some-questions.html
The irony here is that many school districts are getting rid of their writing tests because it's so difficult to create consistent prompts, teachers teach to the test- which is not supposed to happen, and grading them is complex and very, very expensive.
The SAT people are really behind the curve on this as I see it. The analogies were too difficult for your average student, so it seems to me they just kind of came up with this for lack of a better solution.
I think these tests are fine for mathematics, but really think that English grades should be used to determine writing skills.