Keeping Track in a Mastery Based Class

After wrestling for years with different systems for keeping track of student progress and interventions for struggling students within an asynchronous course, I finally arrived at a solution that works for me. Learning Management Systems that I have used don't appear to offer helpful internal structures for self paced learning, so I had to develop my own tools. Before diving into the nitty gritty, here's the gist: I set up a suggested pacing calendar that represented the slowest pace allowed in the course. Once the suggested pacing calendar was created, I made a Google tracking Spreadsheet with all of my students in one place, then used the Import Range formula to automatically update progress in personalized spreadsheets shared with students (and parents and/or tutors as needed.) Within these spreadsheets were predetermined check-in times which also served as triggers for contacting parents or advisors.

The course calendar was the slowest pace allowed in the course. Since the course was self-paced within reason, I no longer distinguished between class and homework. I only shared my expectation for what work needed to be completed by the end of each lesson. The standing homework was to complete whatever did not get done during class. I did not check where students were at the end of each class, unless they needed that support; I was only concerned about their progress at the end of each 8 day cycle (my school has an 8-day schedule) but I recognize a weekly or even shorter cycle might be more helpful for other schools, divisions, etc.

Suggested Pacing Calendar

Students were highly encouraged to show me their work after completing each assignment in order to prevent bottlenecks on Day 8 check-ins. Whenever a student satisfactorily completed an assignment, I updated the master copy of the pacing calendar spreadsheet shown below. Note: in the past, I asked students to update their own progress but found that the students who most needed this type of support were also unreliable in updating their own tracking sheet.

Here's some useful information to help read the spreadsheet:

• The left column has names of students in each section and the top row has the name of the assignments.
  
• The cells in green with an "X" indicates a student has completed the assignment, while cells highlighted red with "no" are missing or incomplete assignments. (Note: a slightly different system could have grades rather than the binary "Yes/No" system described above.)
• The black columns represent a check-in time at the end of every 8 day cycle. 
  

Master Spreadsheet

If a student did not have all green cells at the designated check in time, then on a second tab shown below, I colored the cell red to indicate "behind" the suggested pacing within the course. I blind copied students who were behind after each cycle with a warning email.  For students who I knew there were other significant issues, I sent individualized emails and copied their advisors. For students who were behind two cycles in a role, I sent home an Academic Notification to parents. In our school, these interventions are sent for a number of reasons, including failing an exam or missing several assignments. As the year progressed, I lifted these notification rules for some students; Eventually by the 4th quarter, I did not have to do the check-ins for most students.  

Cycle Check-in Tab

After using this system for a few weeks, students wanted me to post or share access to my master spreadsheet because it helped them keep track of their own progress. Since I did not want students to have access to their peer's data, I used the Import Range formula to link my master spreadsheet to individual student spreadsheets. Shown below is an example of one student's spreadsheet. By using the Import Range formula, I was able to copy a particular segment of my master spreadsheet and place it in an individual student's spreadsheet. Whenever I edited the master spreadsheet, the individual student's spreadsheet also updated. 

Individual Sheet

An added benefit of individualized spreadsheets was being able to share it with parents, advisor, learning specialist, and/or tutor. If I wanted certain students to skip an assignment, it was easy to update the spreadsheet with that information as well. If there were optional enrichment assignments or particular assignments for different groups of students, this system also accommodated for that as well.

Looking Back on My Second Year of Asynchronous Learning

Due to specific issues in asynchronous learning last year, I started the year by scaffolding mastery. The scaffolding seemed to help students learn the organization of the course before attempting the challenge of asynchronous learning. This year, students were closer together at the end of the year, than in the previous year. While most students were successful, the students who lacked motivation and follow-through continued to struggle.

The most frequent piece of advice my students left for next year's students have to do with keeping up in an asynchronous class. To help students stay afloat, I will mandate cumulative exams. I hope the exams will act as deadlines without completely taking away independence, which many of my students valued. The added benefits of cumulative exams is preparation for final exams and it provides more data for me to evaluate student progress on learning targets.

I tried differentiating the final exam with three versions based on percent of the content covered: 90%, 97% and 100%. After some protests from students, I let students choose which final to take rather than mandating the version. The overwhelming majority opted for the most difficult exam and averaged a "B+." Unfortunately, the students who opted for the lower exams performed poorly, with only one student earning a respectable "B." Aside from a few marginal passes and the lone "B", the handful of students who opted for the less rigorous finals failed. I wonder if announcing there will be different finals altered the study ritual for struggling students. In addition, all but one of the struggling students worked from behind and used a lot of effort in the final weeks to play catch up, rather than prepare for the final. Another confounder is these students also failed other final exams.

Earlier in the year, I missed the synchronous discussions of past years like Socratic Seminars. Perhaps along the way, I got use to doing without them but I no longer see them as a great loss. If I'm being completely honest with myself, these discussions weren't as transformative and powerful as I know they are in some other courses. At this point, offloading these discussions to online forums in the engagement segment at the beginning of learning cycles, seem to be an appropriate decision.

I do, however, need to refocus on offering some synchronous activities like formative assessments to build a sense of community and maximize opportunities for students to collaborate and help peers. In an asynchronous class, group member choice is limited to the students working on the same step. Including more of these synchronous assessments and learning opportunities, students can collaborate with new group members.

The asynchronous debate is still the biggest source of concern and pride. In the exit surveys, many students cited the independence as their favorite part of the course, while roughly the same number cited it as the most challenging aspect of the course. Right now, I plan to continue running an asynchronous course, not only for reasons cited in previous blog posts but because so many students never have to opportunity to learn how to work independently, set priorities and manage their time. These skills are needed by adults but are infrequently developed in primary and secondary schools. I'll continue to fight the good fight...

Related articles

• Scaffolding Asynchronous Learning

Quarter One Reflections

After a quarter into the school year, I have a solid grasp of the effects of the changes I've made. Here are the chief thoughts I have about quarter one.

Standards Based Grading

The transition to standards based grading has been mostly smooth. This year, I have a much better handle of what my students know and do not know. The SBG Grade book on Haiku is easy to use. The color codes make it easy to see which standards each student or class section is still working on. This has helped me identify which students need targeted intervention.

Standards Based Gradebook on Haiku

At first, it took students some time to understand the concept of "I can" statements and my particular system for showing learning. They seem to have figured out the system. 

The most noticeable difference is the quality of my reports. I've always struggled with writing first quarter reports because I barely feel like I know my students well enough by that time in the school year. This time around, I had plenty to say. Rather than including the general fluff, my reports focused on what my students knew and were able to do and the ideas and skills they still found troubling. Adding this component to my comments about performance on major assignments, my general impressions and suggestions moving forward, the reports are much more informative. 

Haiku LMS

The new learning management system is quite effective. The layout is beautiful and the interface is intuitive. I have consolidated many of my online tasks within Haiku - recording and sharing grades, assigning and collecting student work, repository of resources and interactive components like polls, practice quizzes and discussions. In the past, many of these roles would have been offloaded to separate resources. I'd like to move my actual quizzes to Haiku but it does not support randomized questions from a test bank, so I still need Moodle for that purpose. 

Haiku can be a bit buggy though. There is a limit to how many objects can be embedded on one page. Some students complained of notoriously long loading times. A student suggested that I make more usage of subpages. Now each step of the learning cycle is housed on its own page. This has significantly increased loading speeds.

Subpages on Haiku

Asynchronous learning

As mentioned in a previous blog post,  asynchronous learning continues to allow students to submit their best work and internalize a growth mindset. Most students are keeping to a reasonable rate, even though there are students who I believe can work faster. I've made some changes this year, which hopefully will help students adjust to the responsibility of setting their own pace. The most important change, at the request of a student, was allowing students to create their own weekly plans.

A student's week plan

Creating the plans take a lot of time so I've been trying to encourage students to send their plans to me during the weekend - with varying degrees of success. At the very least, students are using less class time to create their plans and becoming better at working while waiting for my indication that their plans are satisfactory. For students who show difficulty with this task, I've started to collaborate with them to create pacing calendars for a few weeks, rather than letting them work alone on their weekly plans. 

Mastery projects

A handful of students have elected to complete the mastery projects. In most cases, these projects have been good enough to help other students learn the content. My library of student made teaching materials is growing and some students have already taken advantage of this library to prep for a quiz. I recently added a leader-board to acknowledge students who have completed mastery projects- in hopes of motivating a few more projects.

Mastery Project Leader-board

Quiz retakes 

This year, I have a better handle on whether students are ready to take quizzes or retake quizzes. The hot seats have been a nice addition. The only problem I've seen with the hot seats is when students opt to take the quiz a few days after completing the hot seat discussion. 

After the first batch of quizzes, I've added a few layers of permissions for quiz retakes. In addition to submitting quiz corrections and explainations of the mistakes, students have to do one more thing for permission for a retake. Making the students go through a few obstacles seems to help students take each attempt more seriously. 

Labs 

The switch to inquiry based labs has proved to be most effective with asynchronous learning. Last year, I tried a combination of inquiry and full class labs. I struggled with students who got to the labs first and figuring out whether they should use last year's data. It became confusing for students to know whether they were using this year's or last year's data sets. This also prevented me from adjusting procedures. 

For the full class synchronous labs, students working at a slower pace had to rush through content or temporarily skip steps in order to be "ready" for labs. Now that students design most of their own labs, there is no confusion about what data to use and no need to worry about skipping or rushing through steps - students do labs when they are ready.

So far, I've managed to keep up with the demand for lab materials. I place small lab kits around the edge of the counter space on labeled lunch trays. Since different students perform different labs, I only need to make a small amount of materials available for one particular lab. The trick is to have several labs prepared simultaneously and to anticipate when students will be ready for future labs. Below you can see how I organize lab materials.

DNA extraction lab materials

UV bacteria lab materials

Protein Synthesis model exploration materials

Upcoming changes

In the upcoming quarters, I'd like to incorporate some synchronous projects to help me experiment and think through PBL and 20Time in future years. I also want to offer optional content and let students who work ahead design their own parts of the course. 

Introducing Mastery Learning Cycles to the World: a post FlipCon14 presentation reflection

I had the privilege to present at FlipCon14 about Mastery Learning Cycles (MLC.) I originally discussed MLC in a blog post last year, where I described it as a "mashup" of Mastery learning and Explore-Flip-Apply (EFA) models. In my mind, this hybrid solves the problem of allowing students to learn at their own pace and still promoting thoughtful inquiry through structured learning cycles, rather than a checklist of activities to plow through. The packed classroom and dozens of virtual attendees who watched the live presentation online probably affirm other teachers have interest in mastery and/or EFA (session notes.)

The Flipped Learning Network "flipped" the conference, which meant I had to assign pre-work. Since most veteran flipped teachers are familiar with mastery learning, I assigned a blog post about EFA written by Ramsey Musallam (@ramusallam) and asked teachers to create a learning cycle. The plan was to spend some time during the presentation to front-load this model and the rest of the session having teachers share their cycles. Even though lack of homework completion prevented execution of this plan, I was able to offer a resource for those who wanted to extend their learning after the session. 

The feedback in person and on twitter were positive - perhaps even more so than I expected. I think I did a nice job engaging the audience at the beginning with a karate belt tying activity that demonstrated the power of flipped learning and mastery learning. 

Tweeted by +TheAlgebros 

I also had some opportunities for teachers to talk to each other with discussion prompts. My slides were clear, text-light but image-heavy and did a good job outlining the strengths and limitations of the mastery and EFA models. It may have taken too much time to get through EFA and mastery but the front loading helped outline the strengths of MLC. Perhaps the strongest part of the presentation was sharing my particular learning cycles with student work. I spoke in detail about the simple inheritance MLC by demonstrating how each activity offered a rich learning experience for students. I also talked briefly about the evolution learning cycle just to demonstrate some variation, like labs at the beginning during the Explore phase and differentiation during the Apply phase. 

If I do the presentation again, I'll hope to have some examples of MLC in different disciplines and utilize more opportunities for interaction like polls and more frequent turn & talk prompts. I'll make sure to repeat comments and questions from the live audience for the virtual attendees. I also need to remember to share the link to the feedback form. 

Now that the presentation is over, I have the summer to revise some of my MLCs and look forward to other teachers adopting and sharing their MLCs. 

Related articles

• Mastery Learning Cycles: a Mash Up of Mastery Learning & Explore-Flip-Apply

A Review of "Mastery Learning in the Science Classroom"

Kelly Morgan's book on mastery science classes only spans 68 pages but is full of insight and practical advice. The book outlines her motivation and journey to mastery learning, while also dedicating a chapter to the research, some of which, has long since been forgotten.

Perhaps the most interesting point made in book is the revelation that research supported Mastery Learning decades ago. Mastery learning classes were unsustainable at the time and researchers stopped performing studies because of this lack of feasibility. There's an odd yet powerful observation Kelly makes: researchers stopped investigating mastery, not because it didn't work, but because it did work - there was just no way to pull it off!

Fast forward a few decades, the changes in technology do allow for mastery learning. It's no surprise that the pendulum shifts back to mastery.


I also appreciated some of the practical recommendations. Some of the particular suggestions are a bit dated since technology continued to advance even since the publication of the book a few years ago. Nevertheless, the idea of using an LMS, online varied quizzes and offloading direct instruction to an on-demand platform are still crucial to the success of mastery learning classes.

I highly recommend this book for flipped mastery practitioners or those who wish to explore the possibility. It is a great read!

The Urgent Need for Standards Based Grading

I love moving to an asynchronous flipped course. However, it is clear to me that the next major paradigm shift must be toward Standards Based Grading. 

The asynchronous nature of the course works well for so many reasons,which I have mentioned in the past. My major struggle is the model seems to encourage, or at least allow, students to submit late, and typically useless, assignments at the end of the quarter. Most of these assignments are irrelevant at quarter's end because students already completed their summative assessments. Students submit these late assignments solely to increase their average. While the flipped model decreases the opportunity for the typical "students playing school," clearly some of that is still happening in my course! I could ban submission of assignments after the subsequent steps but that would treat the symptom, rather than the cause.

The culprit seems to be grades, or at least the traditional assessment based grading system. I incorporate assignment completion percentage into the quarter averages to encourage students to do their work. But this seems wrong to me. If we have to assign a grade, shouldn't it be based exclusively on what students have learned, rather than behavior, participation and assignment completion and timeliness rates? Don't get me wrong, I understand why these aspects are included in grades; teachers want to encourage certain behaviors while discouraging others. The easiest method is including specific behaviors in the grading system. Unfortunately, the result is inflated grades for compliant students and deflated grades for noncompliant students. Rather than grades reflecting learning, grades merely correlate or relate to learning in the traditional system. This is an odd paradigm when you really think about it! 

Standards based grading can be the solution. Students are graded exclusively on how well they demonstrate mastery of learning objectives or standards. Students can choose which learning activities (readings, videos, labs) to complete. They can redo assignments to learn or practice objectives before opting for a graded objective check or mastery quiz. If students want or need to retake the summative assessment, they can revisit some or all of the learning activities -  but I won't include the completion percentage rate into the grade. I haven't figured out the logistics but I am sure that my current grading system needs a makeover.  

A Pleasant Surprise Courtesy of Asynchronous Learning

I have a student who has struggled in my course this year. I'll refer to him as Donald. Donald hasn't quite internalized the demands of the course; specifically, he falls behind and doesn't use homework time to catch up. Donald definitely has struggled with the personal responsibility needed to be successful in my course.

This may have changed! I was pleasantly surprised during this spring break - a much appreciated #eduwin. Donald spent some of his spring break working on the next unit. So far, Donald has taken notes on two videos and completed an entire POGIL. Had this been a different student, I would be worried about spending vacation time doing school work but this is a good move for him. Donald will start the next unit a week ahead of his peers. Not only will this give him a cushion and provide great momentum at the beginning of the final quarter, but I suspect this will also be a psychological boost. I think he'll feel great about being ahead when all year he has been behind. 

Even though I expected some of the exceptional students to work ahead of peers, I didn't foresee this possibility. I use this mastery model to allow students to work at their normal pace but I never intended for a struggling student to use vacation time to move ahead. If Donald has a successful final quarter, I'm quite sure it will be because he took the initiative and took advantage of the opportunity afforded by the asynchronous flipped class model.