Automated essay grading leads to more writing

My standard advice for learning how to write can be boiled down to six words: Read a lot. Write a lot. If brevity is essential, three words are enough: Write a lot. I can even make do with one word: Write.

So I’m sympathetic to the argument that students will write better if they write more, with feedback on their efforts. But teachers don’t have the time to read and respond to every draft of every paper.

Automated essay scoring lets teachers assign more writing and focus their own time on “higher order feedback,” argues Tom Vander Ark on Getting Smart. In response to an attack on scoring engines in the New York Times, Vander Ark summarizes and links to the case for automation.

Measurement is a friend to creativity, he writes in another post.

The online scoring engines use the same rubrics to score essays as human graders.  Any ‘standardization’ of writing is not a function of the method of scoring but the nature of the prompt, i.e., if a state requires every 8th grader to write a five paragraph essay every year it may lead to formulaic teaching—that’s a teaching issue driven by a testing issue, not a scoring issue.

People are sick of standardized tests “because most states are using old psychometric technology to administer inexpensive tests with little real performance assessment.”

. . . we’ve been using these tests for more than they were designed for—to hold schools accountable, to manage student matriculation, to evaluate teachers, and to improve instruction.But remember the state of the sector in the early 90s before state tests were widely used. There was no data, chronic failure was accepted, and the achievement gap was largely unrecognized. Measurement is key to improvement.

Soon, “essay graders will soon be incorporated into word processors and will be used as commonly as spell-check,” Vander Ark predicts. Students will get more assessment to help them improve.

Update: Machines Shouldn’t Grade Student Writing — Yet, writes Dana Goldstein on Slate.

A modest proposal: No student loans till 30

Frank Fleming offers a modest proposal to solve the student loan and debt problem: Set a minimum age of 30 for college loans.

In a sane world, if a teenager walked into a bank and said, “I would like a $50,000 loan to major in modern dance,” the bank manager would call security, who would then pummel the stupid kid, and everyone would end up smarter for it. But what happens instead is that Uncle Sam walks by and says, “I like his moxy. Give him the loan; I’ll guarantee it. And I’ll make sure he can’t ever get out of his stupid choice through bankruptcy.” So they give this giant amount of money to a dumb kid, and then the colleges are waiting outside, saying, “Hey! They’re giving huge loans to moron teenagers; we need to get some of that money!” So we have colleges preying on these gullible saps, increasing costs while their diplomas plummet in value in a complete mockery of our capitalistic system.

We don’t let 18-year-olds buy alcohol,  Fleming points out. Why let them borrow huge sums of money? If the borrowing age for student loans was set at 30, borrowers “might actually have some idea of what money is and what debt means.”

And having had to make a living without a college education, by age 30 they’ll hopefully understand what they need higher education for and get a functional degree instead of majoring in something like philosophy (and it’s kind of ironic, because if you major in philosophy, you obviously do need more training in how to think).

Fleming also has suggestions for the inevitable bailout of student debtors:  ”We should at least randomly select some of them to fight to the death for our amusement in the Debt Games.”

Subsidizing student loans benefits middle-class — and sometimes affluent  – students at a time when grants to low-income students are about to go over a “funding cliff.”

 

Schleicher: China’s students are ‘remarkable’

China: The world’s cleverest country? asks the BBC. Shanghai students ace PISA (Programme for International Student Assessment). Now Andreas Schleicher, who runs PISA for the OECD (Organisation for Economic Co-operation and Development) says Chinese students all over the country excel in reading, math and science.

“Even in rural areas and in disadvantaged environments, you see a remarkable performance.”

In particular, he said the test results showed the “resilience” of pupils to succeed despite tough backgrounds – and the “high levels of equity” between rich and poor pupils.

. . . “In China, the idea is so deeply rooted that education is the key to mobility and success.”

The results for disadvantaged pupils would be the envy of any Western country, he says.

Asian culture encourages students to work hard, Schleicher tells the BBC.

“North Americans tell you typically it’s all luck. ‘I’m born talented in mathematics, or I’m born less talented so I’ll study something else.’

“In Europe, it’s all about social heritage: ‘My father was a plumber so I’m going to be a plumber’.

“In China, more than nine out of 10 children tell you: ‘It depends on the effort I invest and I can succeed if I study hard.’

“They take on responsibility. They can overcome obstacles and say ‘I’m the owner of my own success’, rather than blaming it on the system.”

The high-scoring Asian countries expect all students to succeed, Schleicher believes. School is not a “sorting mechanism” to find the brightest students.

I’m surprised to hear China described as an egalitarian education system. China’s best (and most politically connected) students attend well-funded  ”key” or “super” schools, which lead to top universities, complains this China.org story. Rural students are disadvantaged.

Colorado’s 2-year colleges claim $3 billion impact

Colorado’s community colleges provide $3 billion in economic benefits to the state, a new study estimates.

Erie, Pennsylvania hoped to revive a depressed economy by building a community college to provide affordable job training. But it didn’t happen.

New test for new teachers: Can she teach?

More than 10,000 teachers-in-training in 25 states will field-test a new way to evaluate classroom competence, writes Sarah Butrymowicz on the Hechinger Report. Eventually, states may use the Teacher Performance Assessment to decide who qualifies for a teaching license.

Currently, most states require would-be teachers to take pencil-and-paper exams — usually multiple choice — covering basic skills and knowledge of specific subjects, writes Butrymowicz. “Some states also include tests that focus on teaching strategies.”

(TPA follows) candidates through a classroom lesson over the course of a few days, complete with detailed pre-lesson plans from teacher candidates, in-class video, and post-lesson reflection.

Aspiring teachers will be graded on a scale of 1 to 5 by national reviewers, who will look for evidence of student learning. Developers of the assessment recommend making the lowest passing score a 3, but states will be free to set their own passing mark.

Stanford is working with Pearson Education to develop the assessment. Ray Pecheone, co-executive director of the Stanford School Redesign Network, streamlined his model for evaluating  already-certified teachers.  He predicts 10 to 20 percent of would-be teachers will fail the field test, but that will fall to under 10 percent with time.

University of Massachusetts teacher candidates are refusing to send the classroom videos for evaluation, reports Michael Winerip in the New York Times.

The UMass students say that their professors and the classroom teachers who observe them for six months in real school settings can do a better job judging their skills than a corporation that has never seen them.

Lily Waites, 25, who is getting a master’s degree to teach biology, found that the process of reducing 270 minutes of recorded classroom teaching to 20 minutes of video was demeaning and frustrating, made worse because she had never edited video before. “I don’t think it showed in any way who I am as a teacher,” she said. “It felt so stilted.”

Pearson advertises that it is paying scorers $75 per assessment, with work “available seven days a week” for current or retired licensed teachers or administrators. This makes Amy Lanham wonder how thorough the grading will be. “I don’t think you can have a genuine reflective process from a calibrated scorer,” said Ms. Lanham, 28, who plans to teach English.

In traditional evaluations of student teachers, nearly everybody passes.

New York, Illinois, Minnesota, Ohio, Tennessee and Washington plan to adopt TPA in the next few years. Other states are waiting to see how it works.

One third ace 8th-grade science test

Eighth graders did a bit better on a national science exam, but fewer than one-third reached the proficient level. The National Assessment of Educational Progress (or NAEP) found achievement gaps are narrowing, slightly.

 

‘Pell runners’ steal $1 billion in aid

“Pell runners” — scammers who scram once they’ve collected their federal grants — are having a tougher time, but they still manage to steal an estimated $1 billion in aid annually.

Teaching in 3 languages — but not well

A Los Angeles charter school with low test scores will stay open, reports the LA Times. Academia Semillas del Pueblo has friends on the school board who overruled a closure recommendation by administrators.

The school teaches in English, Spanish and Nahuatl, an indigenous language of Mexico, notes the Times. The co-founders are “dedicated to teaching culture that stretches back to before colonial Mexico.” An International Baccalaureate program has been added.

But students test poorly compared to similar students in other schools, including those taught in languages other than English.

Perhaps los ninos need more time on reading, ‘riting, ‘rithmetic and English and less time on Nahuatl and pre-colonial Mexico.

Co-founder Marcos Aguilar came to the school board meeting dressed as an Aztec warrior, reports the LA Weekly. A police officer made him unclip his ankle rattles and leave his “ceremonial staff, a hatchet-sized stick with an eagle’s head” at the door. But he won another five years anyhow.

 

Carnival of Homeschooling

This week’s Carnival of Homeschooling is hosted by NerdFamily Blog.

Touchscreen toddlers

Interactive screen time can be educational for toddlers, writes Lisa Guernsey in Slate.  But . . .

Seventy-two percent of iTunes’ top-selling “education” apps are designed for preschoolers and elementary school children, according to a recent report.  Yet we don’t have much research on interactive apps for preschoolers.

A 2010 Georgetown study found children 30 to 36 months old were better at remembering where puppets were hiding if they had to touch a space bar to spot the puppets (or saw a live puppet show), compared to toddlers who watched a video of the puppet show.

In earlier studies, slightly younger children—24 months—struggled with these “seek and find” tasks after watching non-interactive video, unless they had a guide on-screen, a person or character, whom they felt compelled to respond to or communicate with. Even easier tasks, such as pointing to an object introduced a few minutes before, are more difficult for very young children after watching video compared with being taught face-to-face. It is this “video deficit,” which has cropped up in numerous other studies with infants and toddlers, that partially informed the American Academy of Pediatrics’ recommendation against screen time among children younger than 2. (The AAP has other concerns, too, such as whether parents are replacing human-to-human connections with screen time.)

The pediatricians were focused on “passive” media, such as TV and videos, not interactive media, Guernsey notes.

Still, interactive may be more distracting than educational, Guernsey warns.

. . . the wow factor of the device and the presence of interactive “hotspots” on e-book pages may interfere with children’s ability to recall the story line of the book. This isn’t just a problem of electronics. Even traditional print-and-cardboard pop-up books can lead children at 2½ and 3 years old to learn less from the story than they would have otherwise, according to research at the University of Virginia conducted by Cynthia Chiong.

Most education apps now on the market dictate how children will play, Guernsey writes. Instead of exploring, kids must follow the program. However, new products are being introduced that encourage creativity, such as “DoodleCastItzaBitza and in-development computer programming software for preschoolers called Scratch Jr.

This is off-topic, but fun: