Sunday, August 25, 2013

Rethinking Badges - article review

As I think about using badges as a part of my assessment plan I wanted to read some higher education analysis that considered the negative impacts as well as the benefits.

In Rethinking Digital Badges:  Harnessing badges in remaking undergraduate curriculum, Leslie Madsen-Brooks, a digital historian from Boise State, neatly summarizes both.

On a good day, badges provide:
  • an alternative assessment method
  • engagement by comparing learning to a game setting
  • visible evidence of how skills are linked and build on one another
  • an option to recognize learning and knowledge achieved beyond the classroom
  • emphasis on making to learn and building tangible skills
  • a way to put learners in control, through peer teaching, assessment, and recognition
On the dark side, badges:
  • provide external motivation, which has been proven to hamper student progress in intellectually demanding tasks
  • shift focus from learning to gaming
  • may be worthless, depending on the issuer and standard for issuance
Madsen-Brooks writes, "I think what most disappoints me about badges is that too often their implementation is facile; it smacks of the every-kid-gets-a-trophy soccer tournament. Attend a conference plenary session? You get a badge. Get a D- or better on an exam at the end of an online course? You get a badge. Complete one week of a MOOC? You get a badge. I suspect I’m not alone among faculty in seeing badges as little more than a not particularly meaningful gamification of learning."

The author concludes that the real value of badges lies in the potential for restructuring higher education to acknowledge legitimate interdisciplinary work, especially work that goes beyond taking courses. She writes: "That doesn’t mean, however, that the concept of the badge is completely useless. In fact, we might take advantage of the current trendiness of badges to sell university leaders on investing in a true restructuring of the curriculum that benefits both students and faculty."

This article helped me synthesize my own concerns, think about how I want to manage my badge experiment, and what I hope to gain by using badges.

The extrinsic motivation problem concerns me most. Daniel Pink, who collects and analyzes studies of motivation, reports that extrinsic rewards can motivate people to perform mechanical tasks, but that "once the task calls for even rudimentary cognitive skill, a larger reward led to poorer performance."

In presenting and managing the badges, then, I want to focus on badges as objectively-based measurement of progress that help students stay in control of their learning path, as opposed to gold stars showing that the teacher is pleased. I am wondering if the peer-to-peer badge system may be designed with intrinsic motivation in mind, since the system shifts assessment away from teachers to "experts" who include peers.

Another concern is the investment of students' and my own time and energy in the online tasks associated with digital badges. The heaviest investment comes with the set up phase, but there are ongoing management demands as well.

I am still excited to try the badges, though, for some of the reasons that Madsen-Brooks identifies, as well as my own. One of my long-running goals is to offer students multiple paths to reach learning objectives, differentiating instruction. Badges might be a step in that direction. Another long-term goal has been to help students monitor their progress towards learning objectives they understand.

To reach these goals with badges, I'm going to focus on skills badges, as opposed to badges awarded for cumulative achievement or effort. This will take some organization on my part, to structure the smaller pieces into a coherent whole with multiple paths, but I think that's where the badges will be most useful. 

I am also interested to see whether I can articulate skills that could be valued by third parties outside of the college. For example, in teaching tech/career/college, I might encourage and support students in increasing their typing speed. Let's say a student earns a badge from me, a community college faculty member, based on objective proof that she can type at 40 wpm, or that she has mastered another tech skill. She puts the badges in her Mozilla backpack online and makes them public. Would an employer be more likely to invite her for an interview than if she merely listed her skills on a resume? And if she can give me the proof, does it matter whether she learned that skill from me in my course, or whether I am merely her happy, official assessor?









Attempt to earn 3d party book reading badge (book review)

My last name is Warner, but it should be Fiske. At the close of the 19th century my great-grandmother divorced Mr. Fiske. She kept custody of my grandfather but not his brother, who remained with his father. Perhaps ten years later, after my great-grandmother remarried, my grandfather, then a young man in college, agreed to change his last name to Warner to match the name of his stepfather. That is how the Fiskes turned into Warners.

I often wonder what caused the divorce, how it came to be approved by a court at that time, and what impact the divorce had on her, on my grandfather and his brother, and within their larger family and communities.

Loving Frank, by Nancy Horan, gave me fresh appreciation for the family and societal conflict that surrounded divorce around that time.  This is a work of historical fiction, imagining and filling in the details of the story Frank Lloyd Wright's extra-marital relationship with Mamah Borthwick.

The book charts the course of their relationship, a chilling and sad tale. At the start, around 1905, Frank and Mamah are each married with several children each. They meet when Wright builds a house for Mamah and her husband. They fall in love and in 1909, after a few years of sneaking around, they leave Chicago to live in Europe together, leaving their children behind in Chicago. Frank does not divorce his wife at this time, periodically returning to Chicago to see his family, but Mamah divorces. After the divorce her unmarried sister and her husband raise her children and she has some, but little contact with them. After some years in Europe the couple returns to Wisconsin, where Wright's extended family lives, and Wright designs and builds the Taliesin estate for them to live in. In 1914 a cook working at Taliesin sets fire to the residence, murdering Mamah,  her two visiting children, and five others.

In imagining the life that Mamah lived, the author sketches a woman who is intelligent and creative in her own right, but gives up all she has, her work, her community and her family, to love the great architectural genius. This is the central theme of the book, and the author notes the irony of it:

"If you saw one of his houses," Mamah tells her best friend,"you wouldn't laugh when he talks about the hearth as some kind of altar to the family. It's the heart of the house."
"It's the heart of his dilemma," mutters Mamah's friend. "The man's values have flown right out of his abstract windows." (p. 66)

When Mamah tells her husband she wants a divorce he says, "You can take them (on a trip) with you...(b)ut don't think for a minute you could ever get custody of them." (p. 54)

If Mamah Borthwick had had the same access, as a woman, to the opportunities that Frank Lloyd Wright had, would she have given up everything she had to pursue the love affair? Would she have needed the relationship with Wright? Who is accountable for the emotional harm that befell the children who were left behind - their parents, for choosing to start new relationships, or society and the legal system, for forcing them to leave children behind?

I had heard the climactic tale of this book, the story of the murder/arson of Taliesin, long before I picked up the book this summer. It was a pleasure to hear it again from the perspective of Mamah Borthwick. The typical telling in Art History classes describes the horror and agony that Frank Lloyd Wright must have felt as he rushed back on the train from Chicago to Taliesin, hearing more news at each stop about the burning of his architectural masterpiece and the growing body count. I appreciate Nancy Horan's effort to shift the point of view away from the famous man, to the woman who perished.




Saturday, August 24, 2013

Exploring 3d party badges (badges for Reading!)

I'm weighing the benefits of badges I create and award against the benefits of badges that are created and awarded by people outside of LCC, including student peers.

Peer to Peer University (P2PU) has a variety of badges. In Language Arts, many are connected to the National Writing Project's "Youth Voices" site. Students can earn badges through assessment by the badge creator (some times it appears to be an NWP teacher) or by a peer who earned the badge. The student applying for the badge can see samples of work that already earned the badge.

Several P2PU badges might help students reach learning objectives in Fundamental Reading:


Thinking about the Reading Fundamentals course, where students are encouraged to do independent reading in order to improve fluency and develop self-confidence as readers, I am investigating this badge:


Here are the badge tasks:



Looking for more info. on #5 "show demonstrable proof..." I scrolled down and found:


Following the Independent Reading link (a link to another reading badge)
I found this:



To find"four tasks" and what to do about quoting and citing (incomplete description) I clicked on the url and found:



The material on the left side seems easy to enough to apply and use assuming I already know how to use those four reading strategies.

The material on the right is more structured. There are set four tasks with time requirements (2 hours of reading followed by 30 minutes of writing for each). For writing I could use free write or use an online writing guide with a madlibs/close structure. The goal is to create google document links to share in the Youth Voice discussion forum as evidence of my progress. Responding to peer postings in the discussion forum is part of the process as well. This is a 10-hour project with multiple instructions at multiple steps.

To evaluate the peer review option, I posted a functional version of a writing about a book that meets the requirements on the left, above, to see what feedback I get, or whether I have to do the fully structured option on the right, above, to earn the badge.

Here is what it looks like as a badge project on the P2PU site:



I had a little trouble submitting the badge after filling out the fields. I thought I had submitted my project  (I clicked the green submit button) but when I checked my badge dashboard there was nothing there:

 It turned out I needed to upload an image:



I note that the P2PU web sample shows the peer review took place two weeks after submission. I am interested to see what the reviewing time will be, although to be fair, it's August and most teachers are offline. About an hour after submission I did get an auto confirmation by email:


Concerns in mind about this foray into 3d party badging, as I progress:

  • the criteria for this sample P2PU badge was not transparent 
  • understanding how to earn the badge required advanced online hunting
  • there is no information about the badge creator or way to contact them
  • it's not clear if students will be evaluated by a teacher or by a peer (how much peer traffic?)
  • there may be a time lag between submission and award that stretches beyond the 10 week term
  • the structured option takes students to the "Youth Voices" site - would older students feel shame treating middle and high school students as "peers" and lose interest in the online collaboration 


Friday, August 23, 2013

Experience researching and creating badges

I am experimenting with creating badges for a new ABE course that will include technology skills to prepare students for the new online GED exam and help them explore college and career options.

First, I hoped to find existing badges to use. Google searching for badges turned up commentary about badges instead. Through the Mozilla wiki listing of badge issuers I found many examples of badges used in different settings but no tech badges that would be available to my students (could this be true?). There are many badge collections in Peer to Peer University, including an interesting National Writing Project site called Youth Voices that facilitates peer-reviewing and includes a nice set of exemplars to support it (not useful for this particular class).

Next, I tried out DIY badge sites, comparing the functions of Credly, ClassBadges and Edmodo. Credly won me over. The dashboard of ClassBadges is more specifically set up for a teacher to manage courses and students but it's visually unappealing and not as intuitive as Credly. Also the function allowing me to publish a badge to the Mozilla backpack was broken today. Edmodo lost my interest. It seemed aimed at teachers of younger students, and I didn't see a way to publish to Mozilla, although I gave up pretty quickly. On Credly I managed to create a badge, award it to a test user, get the email of the award, register the test user on Credly, accept the badge and publish a Credly badge to Mozilla.

A huge benefit I can see in this process is that it requires me, as teacher, to get very clear and explicit about the learning objectives and give students transparent guidance about how they can monitor and assess their progress.

I am concerned with:

  • the impact of external "rewards" - is a badge a reward or evidence of assessment
  • my time in creating the badges and then awarding them (not automatic online)
  • my time in setting up a badge site if any? Use Moodle with ABE? Use BuddyPress
  • the time and skills that it will take students to set up and manage a badge collection

The student hurdles include:
  • create email address
  • have access to web for email
  • have email management skills
  • create account on Mozilla to get backpack
  • create "persona" account to do Mozilla log in
  • do Credly site acceptance steps at first log in
  • accept each Credly badge by going to the Credly site
  • (option) move each badge from Credly to 3d party site like Mozilla, Facebook, etc.
  • (option) organize badges in collections in the backpack for display