{"id":1287,"date":"2015-07-09T10:06:15","date_gmt":"2015-07-09T15:06:15","guid":{"rendered":"http:\/\/blogs.ams.org\/blogonmathblogs\/?p=1287"},"modified":"2015-07-09T13:10:35","modified_gmt":"2015-07-09T18:10:35","slug":"specifications-grading-redux","status":"publish","type":"post","link":"https:\/\/blogs.ams.org\/blogonmathblogs\/2015\/07\/09\/specifications-grading-redux\/","title":{"rendered":"Specifications Grading Redux"},"content":{"rendered":"<div id=\"attachment_862\" style=\"width: 210px\" class=\"wp-caption alignright\"><a href=\"https:\/\/www.flickr.com\/photos\/ragesoss\/2158796487\/in\/photolist-4hQuMb-4hQuGW-4hLoZ6-4hQvsw\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-862\" class=\"wp-image-862 size-medium\" src=\"https:\/\/i0.wp.com\/blogs.ams.org\/blogonmathblogs\/files\/2014\/12\/2158796487_8133cf75dd_z.jpg?resize=200%2C300\" alt=\"An alternative grading system. Image: Sage Ross, via Flickr, h\/t Robert Talbert.\" width=\"200\" height=\"300\" srcset=\"https:\/\/i0.wp.com\/blogs.ams.org\/blogonmathblogs\/files\/2014\/12\/2158796487_8133cf75dd_z.jpg?resize=200%2C300&amp;ssl=1 200w, https:\/\/i0.wp.com\/blogs.ams.org\/blogonmathblogs\/files\/2014\/12\/2158796487_8133cf75dd_z.jpg?w=427&amp;ssl=1 427w\" sizes=\"auto, (max-width: 200px) 100vw, 200px\" \/><\/a><p id=\"caption-attachment-862\" class=\"wp-caption-text\">An alternative grading system. Image: Sage Ross, via Flickr, h\/t Robert Talbert.<\/p><\/div>\n<p class=\"p1\"><span class=\"s1\">Last December, <a href=\"http:\/\/blogs.ams.org\/blogonmathblogs\/2014\/12\/15\/specifications-grading\/\">I wrote about specifications grading<\/a>, an idea I first saw on Robert Talbert&#8217;s blog <a href=\"http:\/\/chronicle.com\/blognetwork\/castingoutnines\/\">Casting out Nines<\/a>\u00a0(Co9s is ending, so you can find new posts at\u00a0<a href=\"http:\/\/rtalbert.org\/blog\/\">rtalbert.org<\/a>)\u00a0and wanted to try out in my class. Talbert has blogged about his experiences using the system a few times; you can read some of his\u00a0<span class=\"s2\"><a href=\"http:\/\/chronicle.com\/blognetwork\/castingoutnines\/category\/teaching\/specifications-grading\/\">specs grading posts here<\/a>\u00a0and the rest <a href=\"http:\/\/rtalbert.org\/blog\/\">here<\/a><\/span>. You can also listen to a\u00a0<a href=\"http:\/\/teachinginhighered.com\/podcast\/specifications-grading\/\">Teaching in Higher Ed podcast<\/a> of Nilson discussing the system.\u00a0Now that the semester&#8217;s over, I wanted to let you know how it went for me as well.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">First, a word about the book, <i>Specifications Grading<\/i> by Linda Nilson. I decided to read it rather than just base my grading scheme on Talbert&#8217;s and others&#8217; blog posts about it. I hoped that it would give me some nuts and bolts advice for how to make it work in my class. It did, but I almost put the book down after reading this on page six:<\/span><\/p>\n<blockquote>\n<p class=\"p1\"><span class=\"s1\">What the faculty reap for their endless hours of grading are more grading protests and conflicts with students than ever before. Of course, the reasons behind this student behavior lie largely in the values and beliefs of the Millennial generation and their parents, such as their consumer attitude toward higher education, their distaste for academic learning and the life of the mind, their alienation from standard teaching methods, and their sense of entitlement to high grades in light of high tuition costs.<\/span><\/p>\n<\/blockquote>\n<p class=\"p1\"><span class=\"s1\">I am a Millennial, albeit on the old side, and this broad generalization about my generation rubbed me the wrong way. Aside from the fact that it offended me personally, I had serious qualms about taking classroom management advice from someone with such a negative, adversarial view of students and other people my age, especially someone who would say we have a &#8220;distaste for the life of the mind.&#8221; I do see some amount of entitlement and a consumer attitude, but I have had almost no students who were not interested in learning something. I\u2019m also not at all convinced that Millennials have these traits to a larger extent than members of any other generations. I mention all this here because I hope that Nilson and other educators with this viewpoint\u00a0will reconsider the way they think of their students (and some of their colleagues).\u00a0<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">That said, I do think the book has good advice overall, and I like the idea that employing specs grading will make assessment a less adversarial process. I used specifications grading for my <a href=\"http:\/\/blogs.scientificamerican.com\/roots-of-unity\/what-is-the-goal-of-a-math-history-class\/\">math history class<\/a> this past semester, and it was a mixed success.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Some background on my class: this course gives students a writing credit, so the majority of assessment was based on written work. I had 43 students registered on the first day of class, a slight increase over last semester, and my attrition rate was significantly lower; by the end of the course, I had about 40% more papers to grade than I did last semester. Some of the problems I had implementing my grading scheme and with the semester in general were related to the unexpectedly large size of the class. A writing class with 40 students in it is, at least for me, nearly untenable.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Another complication not related to specifications grading was that I had students turn in most of their work on the course website powered by Canvas and used the grading tool there for the first time. I had two problems: Canvas inexplicably lacks a way to save feedback while you\u2019re writing it but before you want to give it to your student, and it logs you out without saving after a certain amount of time. A few times, I was grading during office hours and had a student visit. By the time I was done with the student, the feedback I was working on was gone. The other problem was that some students could not access the feedback on Canvas. This seemed to be a browser issue on their end, not something I could control, but it threw a serious wrench into getting feedback to them in a timely fashion, especially because they\u00a0sometimes didn&#8217;t realize there was supposed to be more feedback.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I used a blended grading scheme, which Nilson calls a synthetic option in the book.\u00a0<\/span><span class=\"s1\">The two major projects (a group project and a research paper) were graded using a fairly traditional\u00a0writing rubric that produced numerical grades. The average of those two grades determined the final grade with additional requirements for each letter grade. These included a certain number of math homework assignments and <a href=\"http:\/\/blogs.ams.org\/blogonmathblogs\/2014\/10\/09\/blogging-in-math-history-class\/\">blog posts<\/a> that were graded complete or incomplete, as well as turning in paper and project proposals and a paper draft on time.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I allowed resubmissions of one of the homework assignments because a number of students had more trouble than expected on it, but the rest of the homework assignments were one-shot deals. Students could revise blog posts until they were passing. I tried to have a rule that the next revision had to be finished within a week of my giving feedback on the last revision, but I had trouble enforcing that deadline (see below).<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I used Nilson&#8217;s suggestion of tokens\/free passes to turn in assignments late in the hopes that it would cut down on students begging for extensions. I gave each student a total of three for the semester, and there was no bonus for unused tokens. For most assignments, a pass was a one-class extension, and for blog posts, it was a one-week extension. In general, I think the passes helped, but they didn\u2019t eliminate extension discussions altogether. I don&#8217;t know if I just didn&#8217;t give students enough free passes or if they should have been able to earn more or if I just need to be less of a pushover.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Because I required assignments to be turned in by a certain date for students to get a certain grade in the course, some assignments became high-stakes. If a\u00a0blog post wasn\u2019t on time, a student couldn\u2019t get an A; if the rough draft of the final paper wasn\u2019t on time, they couldn\u2019t get a B. I am not used to classes like this where a student can\u2019t do more work to make up for a bad week\u00a0later, and for that reason I sometimes had trouble enforcing deadlines. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I had trouble giving homework assignments an incomplete grade when they weren&#8217;t quite up to the level I wanted\u00a0but reflected a significant amount of effort. Perhaps next time I could borrow Talbert&#8217;s idea of <a href=\"http:\/\/rtalbert.org\/blog\/2015\/Specs-grading-and-rigor\/\">Mastery-Progressing-Novice<\/a> and allow progressing students to resubmit the work. In my case, I\u00a0would probably use different labels. Something like Passing-Effort-No effort would better reflect\u00a0the fact that I want students who try the homework in good faith to get a chance to learn from their mistakes.<\/span><\/p>\n<p class=\"p1\">In reflecting on the deadline and homework complete\/incomplete problems I had, I wonder if part of what made them difficult for me is that in traditionally graded\u00a0courses, you don&#8217;t immediately see the consequences of your actions in your final grade. In reality, people who didn&#8217;t turn in the first blog post in last semester&#8217;s class were unlikely to get an A, but they didn&#8217;t immediately know this. Likewise, people who consistently turned in late assignments or homework that was not high quality would get lower final grades, but the effect didn&#8217;t happen immediately.<\/p>\n<p class=\"p1\"><span class=\"s1\">One of the benefits of specs grading that Nilson mentions is that students can to some extent choose what grade they want. Most of my students were shooting for an A, but some only wanted a B or C and chose the assignments they did accordingly. In the future, I like the idea of having students signal to me what grade they would like in the class so I won\u2019t worry about the students who don\u2019t turn in some early assignments.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">On the other hand, sometimes a student did all the complete\/incomplete work to get a grade that was higher than the grade their paper and project earned; they did all the assignments required to get an A, but their major assignments were B material. Some of these students felt like the rules had been changed on them, and I wish they hadn\u2019t felt that way. One unfortunate aspect of the schedule of the course was that the traditionally graded work came towards the end of the semester, so students were sometimes unsure of where they stood.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I had students turn in rough drafts of their papers about two weeks before the papers were due. I gave a lot of written feedback on the papers, but I did not return them with a rubric that showed what grade they would have gotten if they had been turned in as final versions. I am sure this would have helped my students, and I will try to do that if I teach a course like this again. I also think <a href=\"http:\/\/chronicle.com\/blognetwork\/castingoutnines\/2015\/03\/06\/observations-and-changes-for-specs-grading-8-weeks-in\/\"><span class=\"s2\">Talbert is right on the money<\/span><\/a> when he says that giving students more examples of passing and non-passing work would be helpful.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Another overarching problem was that I don\u2019t think students really bought into the specs grading idea. If I use it again, I might spend some time in class or in assigned reading explicitly talking about how the system works and the advantages it has over traditional points grading. I had a syllabus quiz for my students at the beginning of the semester to make sure they understood how the grading scheme worked, but\u00a0I think I could have made assessment feel more like a partnership if I had let them know exactly why I thought specs grading would be better for both them and me.<\/span><\/p>\n<p class=\"p1\">I was curious about how specs grading would affect the final grades in my class. I think they were a bit higher than last semester. Most of this I attribute to students (and myself) having a clearer idea of what work needed to be turned in at what time in order to get the grade they wanted, so there were fewer students who thought they could scramble at the end to make things up. For example, they couldn&#8217;t get an A or B without turning in a rough draft of the final paper on time. I required a rough draft last semester as well, but I deducted points from the assignment if they didn&#8217;t have one. This semester, I got rough drafts from more students, and I think that improved their final papers substantially. I was somewhat torn by the rough draft requirement; it hurt two students who wrote\u00a0good papers but hadn&#8217;t turned in a draft, but I think it helped more students than it hurt.<\/p>\n<p class=\"p1\">If you&#8217;ve used specs grading in a math class, I&#8217;d be curious to know how it went for you.<\/p>\n<div style=\"margin-top: 0px; margin-bottom: 0px;\" class=\"sharethis-inline-share-buttons\" ><\/div>","protected":false},"excerpt":{"rendered":"<p>Last December, I wrote about specifications grading, an idea I first saw on Robert Talbert&#8217;s blog Casting out Nines\u00a0(Co9s is ending, so you can find new posts at\u00a0rtalbert.org)\u00a0and wanted to try out in my class. Talbert has blogged about his &hellip; <a href=\"https:\/\/blogs.ams.org\/blogonmathblogs\/2015\/07\/09\/specifications-grading-redux\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n<div style=\"margin-top: 0px; margin-bottom: 0px;\" class=\"sharethis-inline-share-buttons\" data-url=https:\/\/blogs.ams.org\/blogonmathblogs\/2015\/07\/09\/specifications-grading-redux\/><\/div>\n","protected":false},"author":61,"featured_media":862,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[75,3],"tags":[318,321,322,319],"class_list":["post-1287","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-issues-in-higher-education","category-math-education","tag-grading","tag-linda-nilson","tag-robert-talbert","tag-specifications-grading"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/blogs.ams.org\/blogonmathblogs\/files\/2014\/12\/2158796487_8133cf75dd_z.jpg?fit=427%2C640&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p3tW3N-kL","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts\/1287","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/users\/61"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/comments?post=1287"}],"version-history":[{"count":5,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts\/1287\/revisions"}],"predecessor-version":[{"id":1294,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts\/1287\/revisions\/1294"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/media\/862"}],"wp:attachment":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/media?parent=1287"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/categories?post=1287"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/tags?post=1287"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}