"I know no safe depository of the ultimate powers of the society but the people themselves; and if we think them not enlightened enough to exercise their control with a wholesome discretion, the remedy is not to take it from them, but to inform their discretion by education. This is the true corrective of abuses of constitutional power." - Thomas Jefferson 1820

"There is a growing technology of testing that permits us now to do in nanoseconds things that we shouldn't be doing at all." - Dr. Gerald Bracey author of Rotten Apples in Education

Search This Blog

Showing posts with label NAEP. Show all posts
Showing posts with label NAEP. Show all posts

Friday, August 9, 2013

More Numbers Games with Common Core Assessments

New York city's numbers are in for the first major round of common core testing and the news looks bad.  According to the New York State Education Department only 26 percent of students in 3rd-8th  grade passed the state exams in English, and 30 percent passed in math.  You may remember that last year Kentucky saw similar results. The news headlines are declaring this proof that better standards and tests were necessary.  But is it really, or is it just a numbers game to create the type of crisis Rahm Emmanuel likes to take advantage of that nudges us, as Cass Sunstein wants to do, into making the "right" choices?

Note that the figures reported are for students who "passed" the test, not raw scores of the percentage correct on the exam. Some body determines what "passing" means, usually referred to as cut scores, and that number can be set low, as Oklahoma did with NCLB assessments, or set high, as many are claiming the New York Regents just did with their latest assessments. There are problems with both approaches.

The situation in Oklahoma is actually one of the major justifications for common standards and assessments. On paper, OK students looked great because percentage wise so many of them were passing their state exams. That is because they set the passing bar fairly low. Unfortunately, most businesses don't take the time to really study a state's education figures (they don't do their homework) and OK was able to lure companies into their state by touting inflated student performance figures. The other governors wanted to put a stop to that. That is what gave us SBAC.

New York has a different agenda. They want to prove that their previous tests were too easy and that their kids NEED common core's "rigor." 

Leonie Haimson, Executive Director of Class Size Matters provided this look at the numbers.
As you may have probably heard, the new state test scores were released to the press and they are disastrous.

Only 31% of students in New York State passed the new Common Core exams in reading and math. More than one third — or 36% — of 3rd graders throughout the state got a level I in English; which means they essentially flunked. In NYC, only 26 percent of students passed the exams in English, and 30 percent passed in math – meaning they had a level 3 or 4. Only 5% of students in Rochester passed.

Though children’s individual scores won’t be available to parents until late August, I urge you not to panic when you see them. My advice is not to believe a word of any of this.

The new Common Core exams and test scores are politically motivated, and are based neither on reason or evidence. They were pre-ordained to fit the ideological goals of Commissioner King and the other educrats who are intent on imposing damaging policies on our schools.

Here are five reasons not to trust the new scores:

1- The NY State Education Department has not been able to produce a decent, reliable exam with a credible scoring system in at least ten years. That’s why there have been wild gyrations from year to year in the percent of students making the grade. For example, 77% of NYS students were at level 3 or 4 in English in 2009; this dropped to 53% in 2010 and 31% now. The last two years of exams created by Pearson have been especially disastrous; from the multiple errors in questions and scoring on the 2012 exams (including the infamous Pineapple passage) to the epic fail of this year’s tests – which were too long, riddled with ambiguous questions and replete with commercial logos for products like Mug Root Beer. (emphasis added) Top students were unable to finish these shoddy exams, and many left in tears and had anxiety attacks. To make things worse, the exams featured reading passages drawn straight from Pearson textbooks which were assigned to some students in the state and not to others.

2- For nearly a decade, from at least 2003-2010, there was rampant test score inflation in NY state, with many of the same people who are now supporting the current low scoring system claiming with equal conviction that the earlier, rising test scores showed that NYS and NYC schools were improving rapidly. The state test score bubble allowed NYC Mayor Bloomberg to coast to a third term, renew mayoral control and maintain that his high-stakes testing regime was working, when the reality was that, according to everyone who was paying attention, the exams had gotten overly predictable and the scoring too easy over time. At the same time as the state exams showed huge increases, scores on the more reliable national exams called the NAEPs showed little progress. In fact, NYC made smaller gains on the NAEPs than nearly any other large school district in the country during these years.

3. The truth is that the new cut scores that determine the different proficiency levels on the state exams – which decide how many kids “pass” or are at Level 3 and 4 — are arbitrary and set by Commissioner King. He can set them to create the illusion that our schools are rapidly improving, as the previous Commissioner did, or he can set them to make it look that our public schools are failing, as King now is doing, to bolster support for his other policies.

4. The primary evidence that Commissioner King now bases his overly-harsh cut scores upon is that the results are mirror the percent of students who test “proficient” or above on the NAEPs. Yet while the NAEPs are reliable to discern trends in test scores, because they remain relatively stable over time, the cut scores that determine the various NAEP achievement levels are VERY controversial. See Diane Ravitch on how the NAEP’s benchmarks are “unreasonably high”; or this article that reveals that even the National Academy of Sciences has questioned the setting of the NAEP proficiency levels, and how many experts believe that level 2 on the NAEPs – or basic — should be used instead to estimate which students are on track for college:

Fully 50% of 17-year-olds judged to be only basic by NAEP ultimately obtained four-year degrees. Just one third of American fourth graders were said to be proficient in reading by NAEP in the mid-1990s at the very time that international assessments of fourth-grade reading judged American students to rank Number Two in the world.

In fact, by using NAEP levels as support for his cut scores, King is either confused or disingenuous about what these levels really represent.

5. So why are King, Arne Duncan, Joel Klein and the billionaires like Bill Gates and Rupert Murdoch who are pulling the strings so determined to prove that more that 69% of the students throughout New York State are failing? This is the Shock Doctrine at work. Naomi Klein has observed that when you scare people enough, it is easier to persuade them to allow you to make whatever radical changes you want, since the status quo will be perceived as so disastrous.

In the case of Commissioner King, Bill Gates and Arne Duncan, they would like to convince parents that their corporate agenda, including a steady diet of developmentally unsound standards, the Common Core’s rigid quota for “informational text” and overemphasis on testing, and their favorite policies of closing schools and firing teachers based on test scores, expanding charter schools and online learning, data-mining and outsourcing educational services to for-profit vendors will somehow improve the quality of education in our state, even though there is little or no evidence for any of these policies.

NYSED has even tried to persuade parents to accept their unethical plan to share the personal data of the state’s children with inBloom and for-profit vendors by saying this will help ensure these students are “college and career ready.” (By the way, as Politico reported last week, North Carolina became the fifth state to pull out of inBloom; now only New York, Illinois, and Colorado are still involved, and Massachusetts is sitting on the fence.)

Joel Klein, who wrote an oped for Rupert Murdoch’s NY Post this morning, appropriately entitled the The Good News in Lower Test Scores, now heads Amplify, Rupert Murdoch’s online learning division, which is the largest contractor for inBloom. For Klein and Murdoch, the drastic fall in state test scores is indeed good news, because it will help them market their computer tablets, data systems, and software products to make more profit. In the case of Pearson, the world’s largest educational corporation, more schools will now be convinced to buy their textbooks, workbooks, and test prep materials, as 900 NYC schools have now done – in hope that their students may do better on the Pearson-made exams, that may even include the same reading passages as happened this year.

Rick Hess, the conservative commentator at Education Week, revealed the motives behind the promoters of these exams in a column called the “Common Core Kool-aid”:
This last paragraph foretells what currently complacent suburban schools with good statistics should be on the look out for in the very near future.
First, politicians will actually embrace the Common Core assessments and then will use them to set cut scores that suggest huge numbers of suburban schools are failing. Then, parents and community members who previously liked their schools are going to believe the assessment results rather than their own lying eyes… Finally, newly convinced that their schools stink, parents and voters will embrace “reform.” However, most of today’s proffered remedies–including test-based teacher evaluation, efforts to move “effective” teachers to low-income schools, charter schooling, and school turnarounds–don’t have a lot of fans in the suburbs or speak to the things that suburban parents are most concerned about….Common Core advocates now evince an eerie confidence that they can scare these voters into embracing the “reform” agenda.

Friday, May 17, 2013

Tying Socio-Economic Status to Test Scores

In speaking to groups about common core and the data collection that is occurring because of it and simultaneously to it, we often get the question, "What is the government's plan for all that data? What are they going to do with it."

USA Today reported on a a new white paper released, the U.S. Department of Education which may partially answer that question. The paper (Improving the Measurement of Socio-Economic Status  for the NAEP)  "proposes classifying students by more than just their parents’ income or education levels. It explains the federal government should be able to tie test scores to a host of indicators, including: whether parents own or rent their home, how many times a family has moved in the past year and whether anyone in their household gets medical assistance."

And what will they do with the  socio-economic classification? "It would allow us to target resources better," Sean Reardon of the Stanford Graduate School of Education.

The paper calls for better ways of collecting data on students and discusses how the NAEP currently collects this information, through a 13-question survey that eighth-grade students fill out at the end of the test. It asks them how  much school their parents completed. It can also include questions such as: "Does your family get a newspaper at least four times a week?" and "About how many books are there in your home?" For fourth-graders, it has asked whether they have Internet access, a dishwasher or a "clothes dryer just for your family."  The only good news here is that people recognize what poor reporters our kids are of this kind of information, making it only a slight indicator of SES.

However, that doesn't stop them from trying to use the kids as data collectors. The report suggests "Cognitive laboratory studies should be conducted on various question types for collecting student reports on parental occupation." So rather than ask mom and dad what they do for a living, let's ask better questions to get the kids to tell on them.

The report also acknowledges that data collection will likely require sharing with data collected by other government departments. "In addition, the development of a new SES measure is likely to incur both anticipated and unanticipated side effects, including the requirement to coordinate with other federal programs within and outside NCES, and consequences such as attention given to equity and educational resource distribution."

For those that want a deeper understanding of the data collection landscape, both with Common Core and with the P-20 Council, we have posted a great page on MO Against Common Core under the Topics tab called Data Collection. This is a great resource to learn more about government data collection on students.

Monday, December 12, 2011

Arne Duncan Needs an Educational Tip from Dorothy in "The Wizard of Oz"


The New York Times has an article on the results on the National Assessment of Educational Progress (NAEP) test.  Public education is having difficulty closing the achievement gap between black and white students.   

However, there are some schools making good progress on the NAEP test and they outperform the traditional public schools. Where are these successful students learning?  They are taught on military bases.  Reporter Michael Winerip interviewed a principal and a parent (not educational theorists and politicians) and asked them why these schools worked.  How are schools on military bases different than traditional public schools and what can the "experts" learn about the success of base schools?

They would find that the schools on base are not subject to former President George W. Bush’s signature education program, No Child Left Behind, or to President Obama’s Race to the Top. They would find that standardized tests do not dominate and are not used to rate teachers, principals or schools. 

They would find Leigh Anne Kapiko, the principal at Tarawa Terrace Elementary, one of seven schools here. 

Test preparation? “No,” Ms. Kapiko said. “That’s not done in Department of Defense schools. We don’t even have test prep materials.” 

At schools here, standardized tests are used as originally intended, to identify a child’s academic weaknesses and assess the effectiveness of the curriculum. 

Ms. Kapiko has been a principal both inside and outside the gates and believes that military base schools are more nurturing than public schools. “We don’t have to be so regimented, since we’re not worried about a child’s ability to bubble on a test,” she said. 


Zounds, Batman.  That's how education is SUPPOSED to work:  
  • no federal overreaching, smothering mandate like NCLB (or the waiver), 
  • no endless assessments to satisfy federal testing requirements for diversity purposes (tests instead are for purposes of identifying weakness and effectiveness of curriculum), and 
  • autonomy and innovation of teachers and principals is a job expectation (not a top down pyramid of regulations mandated by the Department of Education, CCSSO and NGA).
What is the achievement difference between base schools and traditional public schools?

In the last decade, the gap in reading between black and white fourth graders at base schools has decreased to 11 points this year (233 compared with 222), down from a 16-point difference in 2003 (230 compared with 214), a 31 percent reduction. In public schools, there has been a much smaller decrease, to a 26-point gap this year (231 compared with 205) from 30 points in 2002 (227 compared with 197), a 13 percent reduction. 

Schools operate differently on the bases and they are working for these children, parents, teachers and administrators.  They have autonomy and support each child (and their parents) based on his/her abilities:


Nevin Joplin, a sergeant in the Air Force, has a son in the sixth grade at Maxwell Air Force Base in Alabama. Sergeant Joplin, who is black and a single father, said both he and his son, Quinn, had been given ample opportunities to succeed. Quinn has been placed in a gifted program, and Sergeant Joplin said he had been treated fairly in the military promotion system. “My records go to the board, my name is blacked out, anything that would identify me is blacked out; they only see what I’ve done and decide on the merits,” he said. 

 How does principal view the children she is responsible for in her base school?


Military children are not put through test prep drills. “For us,” Ms. Kapiko said, “children are children; they’re not little Marines.” 

 Base schools operate under these beliefs:
  • children are children (not units for assessing)
  • teachers can really teach (not follow a list of common core standards crafted by private companies unanswerable to voters)
  • principals can make educational decisions (unlike having to follow the prescribed script from Washington)
  • parents (in their military jobs) and students (in their base classrooms) are graded on their accomplishments

What's absent in the base method of education that's pervasive in public schools?  The base schools don't operate under the assumption of "people and thought control" and trust the adults running the schools are competent and professional:


“We don’t micromanage,” said Marilee Fitzgerald, director of the Department of Defense Education Activity, the agency that supervises the military base schools and their 87,000 students. “Individual schools decide what to focus on.” 

Imagine what traditional public schools would look like if children were nurtured and the staff and students were not micro-managed.  Our schools would have the possibility of results realized by the base schools.  This paragraph from the NY Times article reminds me of Dorothy's proclamation in the Wizard of Oz: "There's no place like home":

It has become fashionable for American educators to fly off to Helsinki to investigate how schools there produce such high-achieving Finns. But for just $69.95 a night, they can stay at the Days Inn in Jacksonville, N.C., and investigate how the schools here on the Camp Lejeune Marine base produce such high-achieving Americans — both black and white. 

Dorothy had all her answers in her own backyard.  She didn't need to go to Finland or the Emerald City and neither do our politicians and education gurus. 

  






Thursday, June 16, 2011

Why Worry About American History When You are a Global Citizen?


Arne Duncan has weighed in on the disastrous history test results for public education students in recent National Assessment of Educational Progress (NAEP) Test:

"These results tell us that, as a country, we are failing to provide children with a high-quality, well-rounded education."

Are you surprised when "International Education Week" receives more information on the DESE site than "Constitution Week and Citizenship Day"?

What do students learn in "International Education Week"?

International educational exchanges help students and educators around the world to understand one another better. Together, we must respond to the challenges of poverty and hunger, climate change, public health, and economic revitalization.

There was voluminous information on the DESE site on International Education Week last year but nothing on Constitution Week. Arne Duncan shouldn't be surprised children aren't being supplied with a "well-rounded" education when the emphasis is placed on being a global citizen vs an American citizen. Why should today's students learn about Abraham Lincoln? What does he have to do with hunger, climate change, public health, and economic revitalization anyway?

Here's the calendar for the school year 2011-12. No International Education is being observed by DESE this year, but some special days and events listed are: World Environment Day, UN Day, UNICEF Month, Peace Corps Anniversary.

Based on what Arne Duncan stated about not providing a well-rounded education, it would seem the social issues are covered fairly well. Do you think this schedule lends itself to improving history scores based on what's listed as "special days and events"?

Constitution Week STILL has no accompanying information. Wouldn't you think the agency could at least give parents and taxpayers a brief description of how districts will celebrate this rather important document in our nation's history? But then again, whatever does the Constitution (like Lincoln) have to do with hunger, climate change, public health, and economic revitalization?

Thursday, February 24, 2011

Your Child's Test Answers...Invasion of Your Privacy?

Do you know the extent and usage of information being gathered on your family and your child when your child answers certain tests? It's not just information learned from a textbook, it's also about your student's and your family life. From the National Assessment of Educational Progress (NAEP):

Specifically, under the No Child Left Behind Act, NAEP is required to collect information on and report achievement results disaggregated by the following variables, when possible: gender, race and ethnicity, socioeconomic status (SES), disability status, and English language learner (ELL) status.

Sound benevolent? Maybe, maybe not. Read on:

One new approach NCES is currently investigating is the creation of a new and improved measure of socioeconomic status (SES). NCES commissioned a literature review of how SES has been defined and operationalized in other education studies and other fields such as health and marketing. This led to the idea of adopting a two-pronged approach to measuring SES. This approach involves (1) creating an enhanced student background questionnaire with items that probe resources in the home, parents’ education level, and parents’ employment status, among other variables; and (2) using geocoding software to link students’ home addresses to aggregate SES data available from the United States Bureau of the Census. Development of the new SES measure commenced in 2005, with the goal of piloting it in 2009 and possibly implementing it in 2011.

We know the Longitudinal Data System is to be linked to the Departments of Labor and Health and Human Services. The NAEP is already connected to the Census Bureau, so we'll see if the Census Bureau will be a repository for LDS data as well. Does that make you uneasy your child's address is geocoded to gather more information? Is anyone concerned about privacy issues?

We'll be highlighting what is in the data sets in different longitudinal data systems and tests the next few days. We know the government is asking personal questions in the NAEP. Here are two questions an 8th grader was asked on the test this week in Missouri:

VB330870
11. How far in school did your mother go?
She did not finish high school.
She graduated from high school.
She had some education after high
school.
She graduated from college.
I don’t know.
VB330871
12. How far in school did your father go?
He did not finish high school.
He graduated from high school.
He had some education after high
school.
He graduated from college.
I don’t know.
Site Meter