Testing and the Flux Capicitor

Imagine having the power to influence the future.  You could go back in time and undo all the wrongs and make things "right." Essentially that's what every teacher has when they administer the SOL test to their classes.  Of course that would only be if we received the proper feedback after testing.  The social studies EOC reports are less than helpful and seem designed to keep everyone involved as much in the dark as possible about what actually went on.  For my kids that pass I receive a nebulous number which means very little to anyone who lives in the real world and not the criterion referenced normed testing world.   I spent the better part of 6 hours trying to determine what pass proficient(400-499) and pass advanced(500-600) mean only to discover they mean very little.
 Most movies I recall dealing with time travel involve the moral dilemma of changing the future and touch upon the unforeseen consequences of trying to do right and fix the past.  Looking at my results I am not sure I would actually know what to go back and do better.  For me movies on time travel tend to be predictable and boring...my hope is to avoid the same fate for this post.  My recent SOL results have been anything but predictable.   The most notable film was Back to the Future.  That is exactly where we are headed with all this testing.  Backwards.  No one except Dr. Emmett Brown(Christopher Lloyd) knew exactly how the Flux Capacitor worked and it caused a bunch of trouble for Marty(Miachael J. Fox), these tests are much the same.  Difference here is we don't see them so we wouldn't know what to fix.

I observed recently while my students took the World History up to 1500 SOL test.  It was a painful experience and makes you feel about as powerless as one could possibly be. This feeling is one which today's teachers are growing more familiar with.  As I monitored them with the other proctors I could not help but imagine they were missing all kinds of questions as they took the 60 question online assessment.  Surely they were making stupid mistakes on content we have drilled on in the previous weeks and more importantly learned earlier in the year.  These were smart kids and most wanted to do well on this SOL and yet somehow I could just sense they weren't....ARGH!  Much of this anxiety stemmed from the results of last semester's test, which were unexpectedly lower than they had been in the past. 

So there's your plot for the movie.  The protagonist... the teachers... against this antagonist testing culture.  I could have walked around and looked at the test and maybe grunted or found some other way to inform them of their mis-steps.  But I did not, which is unlike what appears to have happened in DC and elsewhere.   Believe it or not most schools are actually staffed by ethical people who follow the rules.  Though these individuals are overlooked by the news in favor of the student punching, criminal, just plain bad people teachers who do sometimes hold jobs in our profession.  But back to the testing ...the whole process is cloaked in so much secrecy it can sometimes be rather dumb.  I'll admit I am not even certain what they are being asked and how it is being asked and I teach the course! 

During the test I sat stone faced with the other proctors while they worked and my mind played out all the scenarios.  I knew many of them were missing questions.   Would that mean little Susie will fail?  What about little Johnny...he's not that good with tests and can't concentrate for more than 5 minutes.  I know I had asked similar questions of them recently in the run up to the test, but I had likely done so in a slightly different way(I'd say better). Will that mess them up?  For those that don't know these tests are in fact rather easy for most kids.   Higher level kids know this and as a result few do any "real" preparation.  I did ask them to take a post SOL survey on how many had "studied" beyond the reviews we had done in class.  Only 7 of 29 students raised their hands.   Awesome.  Speaking generally all they care about is the test and yet, it appears they don't care.  Despite being "easy" to pass it appears hard to receive a Pass Advanced score.  And what of the kids whose skill set means any form of testing is a challenge?  I have found too often their level or preparation quite similar.  But too many of them do not do as well.  Thinking more globally on the impact the weeks leading up to the test we went into test shutdown mode and these weeks after have been like waiting in line at the grocery store(all you want to do is get out).  Tell me again how this is learning?

Thanks to the State Board of Ed what they did now affects how I am evaluated.  Am I mad?  What do you think?  All I know is this test doesn't really hold them accountable.  School yes, teacher yes, them no.  When they miss a bunch of easy questions it hurts me not them(and the scores say they did miss questions).  I would be hurt no matter the result if they did poorly which was the case for some of them.  These kids wanted to do well but not quite as much as I wanted them to do well.  I think that's part of what makes them kids.  The only impact from recent value added legislation so far is that I am more disillusioned with the whole process.  And keep in mind this I am referring mostly to the highest achieving population at our school.  Our district ranks pretty well compared to the rest of the state. So does this really measure me as a teacher?   Click Here to Link to an executive summary that was sent along with individual results.  It is an overall summary sent to each teacher measured by the assessments.  It is highly scientific and I think I understood it properly.    It was signed by John Winger.  Seriously though... I questioned my impact when I saw a big drop in Pass Advanced scores for my kids.  I'll save my analysis for another post but the process of analysis was mind numbing.  One might understand my frustration when you see there is nothing on the VDOE site that references or even defines the terms Pass Advanced/Pass Proficient/Fail  for social studies End of Course Tests.  Click here for Detailed Performance Level Descriptors

Compared to last year the message was clear...overall average-down, number of perfect scores-way down, pass advanced-down, the trend is uniform and absolute.  My results were similar to those from my first semester students though my year long classes did perform slightly better(Click Here to see my reaction earlier in the year)  Most teachers shared  similar experiences.   One senseless revision to the testing process is the fact that when they are done I now read from a script when they submit their test.  Hypothetically speaking if a student has left 3 questions blank and says they are done, I am forbidden from saying something like "Hey there Bobby-Joe, you left two questions blank, come on now... let's finish up and maybe answer those last couple...what do you say?"  I know, I know a kid that leaves questions blank deserves what they get.  But it could be they have to use the restroom and just want to finish.  Maybe they can no longer stand being in a gym filled with 200+ kids.  Maybe their parents got in another drunken brawl last night and for the moment at least this test doesn't matter much.  Get my point?  Yet I cannot do the most human thing and remind them to answer all the questions.  How does that assess what they really know or even what the teacher has given them in terms of value?

This test and all the tests leave much to be desired as does how we value and use them.  I'll play devil's advocate and ask why since 2000 they have only released 1 full test and only 13 additional questions in Social Studies  (This page shows every other testing area has released tests).  For some reason Earth Science and History are kept locked inside Fort Knox Kentucky.   Sad to think this is the best we can do.  I know we could do better.  I have and do all year long in my classroom yet the last weeks schools are consumed by this maelstrom of testing.  The disjoint between those IN the classroom working with kids and those IN control of policy only continues to grow wider.  Who is at fault?  Based on everything I read it is the opinion of policymakers that the problem must be at the bottom. That mentality is our biggest problem.   If you've been down with the Underground then I think you have a pretty good idea how I feel about that.  So if I could travel in time what would I do?  I'd don't think I'd go backwards so much as forwards....That would then give me the proper insights to affect positive change today.  I'd find that bolt of lightning that finally saved Marty and generated enough electricity to propel the DeLorean to 88 MPH and use it to steer our schools in a better direction.  Towards the future.   Deep stuff ... I know...


Hey the Underground is gonna be at half speed for summer so there will be a drop in the frequency of our posts.  We'll do our best to maintain the quality but come on...we are teachers after all.