Wednesday, May 5, 2010

Is Testing Education's Red Herring?


flickr CC image via timparkinson

I'm blown away by the volume of Twitter posts addressing the issue of testing in education. An inordinate amount of time and energy is being spent on the controversy, and I'm of the opinion that this is taking us away from the real task of getting on with creating effective strategies addressing the assessment challenge, and also from other educational issues that have been pushed aside by the volume of debate over testing. Before you get all riled up about the title of this post, hear me out just a bit.
  • I'm all for improving the manner in which we assess and evaluate students... we should never, never stop doing this.
  • There are undoubtedly strong arguments favouring alternatives to high-stakes, one shot win or lose forms of summative assessment.
  • We must evaluate students if we are to call ourselves professionals. To do so is responsible, necessary and important professional work.
I worry that the frenetic pace with which teachers around the world are slamming traditional forms of assessment is taking away from the real work of suggesting viable alternatives, and I don't mean alternatives that are so far removed from conventional wisdom that they don't have a chance in you know where of becoming common practice. There are logistical problems... how do we ensure that all kids are assessed fairly and comprehensively to establish appropriate educational transition plans, and to ensure that every one of them feels supported and enabled to approach their dreams without prejudice? This is no small task. I hear a lot of statements about what is wrong with the state of assessment in education, but beyond the regular "ban multiple choice exams" rhetoric, (perhaps there are viable alternatives,) I don't hear many really solid solutions to the problem... just bandwagon-jumping complaints addressing the inadequacy and inappropriateness of conventional testing methods.

Like it or not, education can't happen for free, and as long as taxpayers are paying government to provide an education system, there will be requirements for government to be accountable to them for their investment. This is not inherently bad really, is it? In turn, why shouldn't the education system be expected to be accountable for its investment in learning? It's not whether we should be accountable for what we do in education, but rather how we'll be accountable, that we should be discussing intelligently and openly. Whether students, parents, teachers or government, we should all be targeting the same outcomes surrounding and supporting student success... why not do this collaboratively in their best interests?

Cardinal rule  number one when making decisions affecting how we support kids- ask whether the decision is in their best interest to the exclusion of any other variable. If the answer is yes, you're likely on the right track, and I refuse to believe there is as agenda out there that intentionally damages kids... no matter the group, we need to default to a perspective that assumes people are doing the best they can for kids with the knowledge and experience they represent, and if that's not enough, we need to talk rationally about why, and where to go next.

Let's stop bandwagon-jumping and get talking about alternatives that have hope; alternatives that are viable enough to satisfy the testing gods on high because their effectiveness is undeniable. Let's be smarter than the problem. Let's do our homework, and instead of illuminating the problem, let's illuminate some solutions.

7 comments:

  1. I've been thinking the same thing for years. We can't throw assessment completely, but the tests have got to go. As Daniel Pink points out - they are only assessing logic based thinking and dismissing a whole brain approach as unimportant.

    The solution I keep thinking about is portfolio assessments. Bits and pieces of student work that show not just what they have learned, but the progression of their learning. Unfortunately I think the bigger problem is the logistics of using anything but the stand. test for assessing students.

    Namaste

    ReplyDelete
  2. We need some deep thinking on the format of assessment... I like portfolios too, but if they're jsut a collection of samples, that won't work re. assessment... we need a process to evaluate teaching and learning through what we collect in the portfolio- an entirley doable concept in my opinion.

    I also really like the Standards-Based Learning model, but as you say, the conventional wisdom may not necessarily favor the SBL model citing inefficiency and logistical issues... that's why we need unconventional wisdom;o) (LOVED "A Whole New Mind")

    Namaste!

    ReplyDelete
  3. The issue as I see it is that standardized testing is at fault for distacting us from what we need to do in the classroom. I also don't think that tests are designed to intentionally hurt kids and education, but that is what is happening. Even when other assessment practices are in play, alot of teachers feel pressure to have their kids perform well on these things at the expense of other meaningful oportunities in their classrooms. We need a model(and I think it is coming because of my conversation with the minister's aide this weekend) that tests the health of the system and gives teaches the respect they deserve (eg. sample testing)

    ReplyDelete
  4. Hi Kelly,
    As you know, there are different contexts to standardized tests, and an infinite array of methods to "test" kids skills, knowledge, insight...whatever. It's my perspective that the large-scale, norm-referenced standardized tests like the PAT's are the ones being vilified, and fair enough- not sure I agree with the comparative nature of these tests myself.

    I must say, however, that criterion referenced tests designed to determine what test takers can do and what they know, not how they compare to others (like the common assessments in our District) are a different element and one I have no issue with.

    Additionally, standardized tests used to justify funding, placement, to determine a LD or other issues relative to the student's personal learning plan are also fine in my opinion- I have administered hundreds of these and experienced their benefits to students in real-time.

    Using uniform procedures for administration and scoring of a test (standardizing) in order to assure that the results from different people are comparable isn't necessarily a bad thing. I do agree with you that the whole routine has been bastardized and that teachers are feeling held at ransom over them, but amidst the "issue" we've really lost our way. That's what I mean by the "red herring" bit.

    It will take intelligent analysis (like it sounds the minister is engaged in) and not flash point, reactionary opposition to make any change stick. If we know anything about this government we have, and particularly the current Ed Ministry, we know that incremental, careful change is the order of the day- and I'm fine with that, I guess. it's hard waiting sometimes, and there are intangibles to be sure, but we have to remain positive.

    Love to hear about your conversation with the Minister's aide...
    Cheers,
    Hope you're enjoying the summer break!
    Sean

    ReplyDelete
  5. Two words: Authentic Testing. Providing students with formative, real-life tasks that ask them complete projects and do things that are real and authentic. There are lots of precedents out there of people doing this. The folks at Edutopia talk a great deal about this kind of assessment.The folks at the Buck Institute have a great deal of information on Project-Based Learning. This is the kind of assessment that provides real knowledge of what students can do and what they have learned. The problem with this kind of assessment is: 1) Educators are going to have to be treated as professionals who can diagnose and accurately report whether their students get it or not, 2) It is expensive, much more expensive than bubble-sheet testing, but if our politicians are serious about testing, then show me the money. and 3) The kind of accountability this type of testing would provide is individualistic and tailored to the student. Not much room for numbers and number comparison. Politicians are hung-up on numbers. They want to boast that they raised this score or that score with their reforms. This kind of testing would not allow them to do that. No educator is against "accountability." What educators do want is a form of accountability that is fair to students and educators alike. Every existing test we currently have are very limited in their uses. The reason educators can't get past the testing issue is because it has been "done to us and our students" for the past nine years by an administration so ignorant as to think tests could tell you anything about how whole schools perform. The current administration has only shifted that testing emphasis from the schools down to the teacher where it will even make "the test" the center of what we do. If you want to know why there are so many tweets and a lot of discussion about testing, it is because those educators who have spent the past nine years in classrooms and schools have seen the damage the bubble-sheet testing culture can do both students and teachers.

    ReplyDelete
  6. Thanks for your reply J. Robinson. I appreciate your commitment to the issue of testing...

    I'm going to play devil's advocate in the interest of extending this conversation- would like to hear more from you...

    Every existing test we currently have are very limited in their uses..." This is a lofty statement you make. I have administered many different types of tests and other forms of assessments, none of which I would call "limited." I would go as far as saying designed for a purpose, but limited carries an abruptly negative connotation. In my 14 years working with very-high needs kids in the special ed and couselling world, these "designed for a purpose" tests were invaluable to identify strengths, weaknesses, LD and DSM issues, developmental/ cognitive profiles etc. We have to be careful not to throw the baby out with the bathwater...

    ..."Authentic Testing. Providing students with formative, real-life tasks that ask them complete projects and do things that are real and authentic."
    -I too strive to provide "authentic" assessments for my students, and I am perpetually taking steps to improve how I do this, but I struggle with the terminology- "real-life, real and authentic..." these are also very BIG words- difficult to define in a context. Is my "real-world" the same as yours? Is the real world in your country the same as the real world in mine?

    We make so many over-arching statements like "we have to prepare the child for the real world by providing real-life tasks so they can become the active and well-adjusted citizens we want to become the leaders of the 21st Century..." can you say moving target?

    I'm also perplexed by how seldom science is included in the testing debate among the group-think that's surrounding the issue. It seems to me that much of the debate is subjective and/or political, and not so much based on evidence that "formative, real-life" assessments of whatever sort are actually sound and beneficial to learning.

    OK, please don't misinterpret my statements as opposition to what you have said, and I do understand the political poop storm the US seems forever embroiled in (and not just over education issues;o) I get SBL (use it in my classes and defaulted to this methodology in the spec. ed. environment), and agree that accountability can take many (perhaps infinite) forms, but I cant agree that all traditional forms of testing are hogwash.

    @GWoodJCG said it this past week, and it made a heck of a lotta sense to me- "Both teaching to the test and hating testing are wrong - embrace the data"
    Can we agree that what's needed are informed decisions by all invested parties regarding how best assessment (authentic testing) can and should be done? You may be interested in my Association's initiatve surrounding this- http://www.reallearningfirst.ca/index.php, and other edreform issues in Alberta, Canada... and also my gov't's perspective at http://www.inspiringeducation.alberta.ca/

    Very much appreciate your feedback!
    Sean

    ReplyDelete
  7. Standards are the red herring for education reform. They brought high-stakes testing. They are intertwined with every major educational reform effort since their conception under Pres. Bush St. Learning theorists and practitioners are needed in education reform.

    Here is the heart of the problem of the U.S. public schools. It was Jefferson's purpose for schools that continue today's reforms. http://whathappenedtomygradebook.blogspot.com/2011/09/rubbish-piles-of-blueberries-and.html
    Solutions are detailed in The Audacity of Learning Theory Post found in October on my blog.

    ReplyDelete

Shelfari: Book reviews on your book blog

Labels

learning (49) teaching (45) education reform (29) authentic learning (24) students (23) effective teaching (18) school (18) EduKare (15) educational leadership (13) resiliency (13) creative teaching (11) education (11) educational change (11) perspective (11) 21st Century Learning (10) Glendale School (10) change (10) collaboration (10) school climate (10) school culture (10) support (10) creativity (9) assessment (8) caring (8) culture (8) leadership (8) teachers (8) hope (7) inquiry-based learning (7) learning circles (7) learning stories (7) professional development (7) student success (7) technology (7) technology integration (7) #edchat (6) at-risk kids (6) collaborative teaching (6) empathy (6) pre-service teachers (6) purpose (6) responsive teaching (6) #EduKare (5) Alberta Education (5) Sean Grainger (5) Twitter (5) at-risk (5) engaging (5) integrative thinking (5) mentor teachers (5) public schools (5) teach (5) teacher training (5) Bell Curve (4) beliefs (4) belonging (4) bullying (4) children (4) diversity (4) empathy reboot (4) high-stakes testing (4) learn (4) possibility (4) relationships (4) resilience (4) school leadership (4) student (4) LCU (3) action research (3) child development (3) choice (3) classroom (3) communication (3) community (3) counseling (3) debate (3) dreams (3) duty to care (3) ed reform (3) educators (3) failure (3) fun (3) growboys (3) inclusion (3) inquiry (3) interculturalism (3) kids (3) life-long learning (3) mindfulness (3) nemetics (3) pedagogy (3) professionalism (3) reflection (3) thinking differently (3) transformational leadership (3) understanding (3) #cpchat (2) #ecosys (2) #redcamp13 (2) Bloom's Taxonomy (2) Control (2) Google (2) Innovative Voices in Education- Engaging Diverse Communities (2) Moore's Law (2) PD (2) alternative teaching (2) audience (2) balance (2) behavior (2) behaviorism (2) best educational practice (2) blogging (2) boys (2) bully (2) bully prevention (2) challenge (2) change agent (2) character (2) circles (2) classroom management (2) commitment (2) competition (2) connecting with kids (2) creative (2) development (2) dialog (2) digital technology (2) disagreement (2) edcamp (2) edkare (2) education change (2) effective classrooms (2) etmooc (2) facts (2) feelings (2) formative assessment (2) future (2) goals (2) groupthink (2) growth (2) hope wheel (2) ideas (2) independent thinking (2) interdependence (2) journey (2) listening (2) mastery (2) mindful (2) morphic resonance (2) multiculturalism (2) new teachers (2) opinions (2) opportunity (2) passion (2) personal learning network (2) phenomenological (2) philosophy (2) project-based learning (2) question (2) resilient (2) resolution (2) responsibility (2) self-esteem (2) self-organized learning environments (2) servant leadership (2) share (2) social-media (2) special education (2) standardized tests (2) struggling schools (2) success (2) sympathy (2) teacher (2) teacher welfare (2) trust (2) unconditional love (2) unconference (2) university (2) values (2) vision (2) voice (2) words (2) #LCU (1) #ccunesco2014 (1) #nemetics (1) #speakchat (1) 40 Developmental Assets (1) ATLE 2010 (1) Africa (1) Black Swan (1) Brokenleg (1) Calgary Science School (1) Circle of Courage (1) ConnectED (1) Curate (1) Daniel Durant (1) Dry Island Buffalo Jump (1) FBA (1) Fouth Way (1) Geoffrey Canada (1) Grow Boys (1) Howard Gardner (1) Impact (1) Instructional leadership (1) John Dewey (1) Kathryn Schultz (1) Lao Tzu (1) MIT (1) Michael Josefowicz (1) Nunavut (1) Occam;s |Razor (1) PBL (1) PLN (1) Phoebe Prince (1) Piaget (1) Red Deer (1) SBL (1) SOLE (1) Search Institute (1) Second Way (1) Shankardass (1) TED (1) Tao Teh Ching (1) Vygotsky (1) Wangler (1) aboriginal (1) accountability (1) achievement (1) action (1) actions (1) adversity (1) anger (1) answer (1) applied behavior (1) applied research (1) apprenticeship (1) aptitude (1) aquaintances (1) at risk (1) athletics (1) authentic (1) autonomy (1) badges (1) being wrong (1) believing (1) benchmark (1) blended learning (1) blog (1) borders (1) brain research (1) budget (1) business (1) cdnedchat (1) chaos (1) character education (1) charity (1) child-development (1) clarity (1) collaborate (1) communciation (1) communicate (1) conference (1) confidence (1) conflict (1) connect (1) consciousness (1) conversation (1) cooperation (1) coordinated children's services (1) critical thinking (1) curiosity (1) curriculum (1) democracy (1) destiny (1) developmental (1) differentiated learning (1) differentiation (1) digital citizen (1) digital immigrant (1) diigo (1) dissonance (1) dyslexia (1) education innovation (1) effort (1) emotions (1) enabling (1) endogenous (1) engaged (1) engagement (1) equity (1) ethics (1) evaluation (1) excellence (1) fail (1) faith (1) fate (1) fear (1) feedback (1) feminine (1) finding voice (1) focus (1) friends (1) gender differences (1) gender identity (1) global education (1) goal setting (1) governing body (1) happy (1) hardware (1) healthy (1) heuristic (1) high school (1) higher education (1) homework (1) honesty (1) hop (1) humility (1) iconoclastic (1) imagery (1) imagination (1) improbable (1) inclusive (1) inclusive education (1) indigenous knowledge (1) innovation (1) inspiration (1) instinctual (1) interdependent (1) internalize (1) internship (1) interpersonal (1) intuitive (1) knowledge (1) lacrosse (1) leading (1) leaps of faith (1) learning circle (1) learning disabilities (1) learning disorders (1) learning from place (1) learning goals (1) learning spaces (1) learning story (1) learning styles (1) learning tools (1) lecture (1) library (1) lifelong-learning (1) limits (1) literacy (1) lobby (1) management (1) masculine (1) math (1) medicine wheel (1) men (1) mentorship (1) micro-blogging (1) mindfullness (1) mission (1) mistakes (1) morals (1) motivation (1) navigate (1) negative reinforcement (1) network (1) networking (1) new year resolution (1) objective (1) open education (1) open-source (1) operant conditioning (1) outcomes (1) overcome (1) pass (1) patience (1) polarity (1) positive (1) positive reinforcement (1) positivity (1) positve dissonance (1) postmodern (1) poverty (1) power point (1) practice (1) pride (1) private logic (1) productivity (1) professional organization (1) progression (1) questioning. Socrates (1) rally (1) rationalization (1) rdcrd (1) rdpsd (1) re-frame (1) re-tool (1) reality (1) receive (1) reclaim (1) redcamp15 (1) relative (1) relevance (1) research (1) rest (1) revolution (1) ritual (1) routine (1) scholar (1) scholarship (1) sciences (1) scrutiny (1) self-determination (1) self-help (1) significance (1) silence (1) simple (1) sincerity (1) skate park (1) skateboard (1) smile (1) socialize (1) society (1) software (1) solution-focused (1) speaking (1) sport (1) standards-based learning (1) stories (1) strangers (1) strengths (1) stress (1) student engagement (1) sustainability (1) synergy (1) taking risk (1) talking (1) tangibility (1) targets (1) teaching. learning (1) textbooks (1) thinking skills (1) thought (1) thoughts (1) trans-species (1) transference (1) tribes (1) unconditioned response (1) unconditioned stimulus (1) universal (1) urban gardening (1) urban schools (1) victim (1) visceral (1) wellness (1) wisdom (1) work (1) work week (1) worksheets (1) writing (1)