Tag Archives: quality matters

Gamification and Student-to-content Interactivity

Learner engagement is considered to be an effective predictor of student success. We can increase learner engagement by focusing on interactivity in course design.

Dice CC-BY-NC-SA by Daniela Hartmann on Flickr

CC-BY-NC-SA by Daniela Hartmann on Flickr

The Community College Research Center (CCRC) at Teachers College, Columbia University published a paper on the topic: Predicting Online Student Outcomes from a Measure of Course Quality (Jaggars & Xu.) The purpose of the study was to gather empirical evidence regarding the link between online course quality and student outcomes.

The study looked at four main areas:

  • Course design: organization and navigation
  • Learning objectives and assessment
  • Interpersonal interactions (student-to-instructor & student-to-student)
  • Effective use of technology

Much of what was learned through the research reaffirms what we have shared here before – that there exists a positive correlation between student-to-instructor interactivity and student success.

What the study did not reveal was a correlation between student success and online course design, or for that matter, between student success and the alignment of learning objectives and assessment. That isn’t to say these aren’t essential considerations when designing the online course – they are. But rather, that the study did not provide evidence that these factors are directly related to student achievement.

Another interesting finding was that although student-to-instructor interactions showed a positive correlation to student outcomes, this was not necessarily the case with student-to-student interactions. In fact, students indicated their experience with online discussion and group projects was, to paraphrase, pretty much a time sink.

Initially, the findings appeared to support a relationship between the effective use of technology and course grades, but after controlling for student characteristics the relationship became less apparent. Most quality assurance rubrics and accepted practices in online delivery suggest that educational technologies need to be current or state-of-the-art. However, this study suggests when designing rubrics for online course design…

“…quality ratings for technology may wish to focus on not just the use of “current” technologies but how these technologies are used to support user interaction, confidence, motivation, and learning.”

It occurs to me that interaction, confidence, motivation and learning can all be supported by the introduction of games or gamification in learning design.

The use of games in education has gained momentum in recent years. Games can be very motivating (perhaps even addicting). In a game we interact with the medium, often are given problems to solve or challenges to overcome, make choices, and as we progress in skill we become more confident.

Tools like Respondus StudyMate and Quia can be used to turn objective type quizzes into word games: (matching, hangman, crossword, fill in the blank). This is especially helpful when learning new terminology. After integrating games into her Medical Terminology course a couple of years ago an instructor reported significant improvement in student test scores as students began to spend hours reviewing the content as they played games and tried to improve their scores.

The learning is not necessarily the learner’s primary goal when playing a game, but rather accomplishing a task, mastering a certain level, gaining points or credits, and ultimately to win. Of course learning happens as an outcome in the process. Games are by definition, competitive – we may compete against the computer, chance, ourselves, or others (bringing us back to the earlier discussion about student-to-student interactions).

According to Karl Kapp, “Gamification is using game-based mechanics, aesthetics, and game thinking to engage people, motivate action, promote learning, and solve problems.”

“Through the careful application of game elements—such as the freedom to fail, interest curve, storytelling, and feedback—in learning programs, ordinary content can be made more engaging without the development of a full-fledged learning game.” – Karl Kapp

By looking for ways to implement game elements into our courses we may be able to repond to the several questions brought up in the study, including student to student interactions, and effective use of technology (student to content interactions).

For more information about gamification, check out Karl’s article Getting Started with Gamification on ASTD.org.

What students love about online learning…

Students say they love their online courses when their instructor is accessible and responsive, when their instructor is hard to reach or unresponsive – not so much.

CC-BY-NC-SA by John Harvey on Flickr

CC-BY-NC-SA by John Harvey on Flickr

We recently surveyed our online students regarding distance learning support services. The last question in the survey asked for “any other comments” they wished to offer. About two-thirds of the responses were very positive with students telling us how much they appreciated the online options. Here’s the gist…

“Although the instructor had organized the course well on Blackboard, I could never get a prompt response…”

“My instructor was awesome and was always there if you had any questions.”

“…every course I have taken has been great and the professors have all been attentive and responsive”.

“I really enjoyed my online course with [my] professor… he was responsive to my individual questions and he always replied in a timely compassionate manner.”

“I enjoyed my online courses. The professors were always available for help, though at times I had to wait a day or so for them to email me back.”

“I enjoy my online classes. My psychology class this semester has been great. My economics teacher on the other hand, I feel is very distant and not very helpful when I try and reach out to him.”

Note the theme here – “I loved the online course – my instructor was responsive”.

It would appear that instructor responsiveness and availability is key to student satisfaction in the online learning experience. Some thoughts on how to accomplish this in your online courses…

Students need to know the instructor’s preferred communication style.

Which tools or methods will you employ – email, instant messaging, texts, voice calls, Twitter, Skype, or a combination thereof? Posting this information in the syllabus and course introductory pages can help to manage expectations. Students will know that although you are not available twenty-four-seven, you can still be reached and will be getting back with them in a reasonable amount of time. Tell the students you will respond in a timely manner so they know when to expect a response, and be specific. If your intention is to answer inquiries within 24 hours, state this on the course homepage along with your contact information. I knew a teacher, new to online, who told her students that she would be checking her emails on Thursday evenings. Yeah… as you might imagine, that was not very well received.

Online instructors should not feel the need to respond to every text as it is received, but they do need to establish some sort of routine. If you check your email first thing in the morning or before you go to bed at night, students will begin to expect your responses around these times. If the schedule changes – you’re on vacation, or working on a project that takes you away from your normal rhythm – send out a message or announcement that they might not hear back from you until the next day.

Virtual office hours are useful even when students don’t take advantage of them. They know that Tuesdays and Thursdays they can log into the chat or find you on Skype between 2:30 and 4:00 in the afternoon. I know more than a few faculty who regularly schedule virtual conferences with their students using Google Hangouts or Skype, just to add a more personal connection as they review their students’ writing assignments.

Have the students introduce themselves to the rest of the class at the beginning of the semester. This can be very helpful in creating a sense of community in the virtual classroom environment. You can model this by posting your own introduction to a discussion forum as the first assignment. Using the Blackboard video feature or simply sharing a short video from your phone can help students to see you as a real person so they can put a face along with the name of their professor.

For more ideas about improving communication and interaction, check out the Communications & Interactions Plan found at University of Utah’s Center for Teaching & Learning Excellence: https://utah.instructure.com/courses/148446/pages/communication-and-interaction-plan-strategies\

What can we do to help students be more successful in online courses?

We surveyed our online students this spring and received a strong response to the open-ended question, “What could [the college] do to help you be more successful in online course(s)?

CC-BY-NC-SA by Ed Yourdon on Flickr

CC-BY-NC-SA by Ed Yourdon on Flickr

I tried to categorize the students’ responses around themes – here are the top ten…

  1. Reliable Technology – specifically the learning management system (LMS). Students expect the technology to be reliable and to work as designed when they need it. They do not expect to be logged out, or timed out, or to find the system off-line due to a power outage, etc.
  2. Video – students want their courses to include short videos:  lectures, explanations, examples, demonstrations… “like Khan Academy”.
  3. More Online Courses – students are enrolling in online courses because it meets their schedules and they need more online offerings if they are to complete their programs
  4. Reminders – they want to get alerts, reminders, notifications about what is due and when it is due.
  5. Consistency – students would like for their online courses to have the same look and feel. The layout of the courses, tabs, menus should be the same from one course space to the next.
  6. Instructor Availability – students want to be able to contact their instructor when they have a question or need help and expect to get a response in a timely manner.
  7. Timely Feedback – students are looking for their instructors to keep them apprised of their progress. They would like to get their grades early and often.
  8. Faculty Involvement – students appreciate faculty taking an active role in teaching the course – not so much a third-party website or publisher’s course pack.
  9. Online Testing – they want to be able to take more tests online as opposed to coming to the testing center. They point out that they enrolled in the online class so that they would not need to travel to campus.
  10. Calendar – students would like to know what is coming up ahead of time and for all their courses. A composite calendar of events for all of their courses is their suggested solution.

It is interesting to me that through this survey, students had an opportunity to recommend new and innovative technological solutions, yet they focused much more so on issues of design and delivery – on improving existing processes.

The good news is, we can do a lot of this this stuff!

Can digital badges increase capacity for online learning?

According to the ITC Distance Education Survey 2013, the number one challenge administrators face regarding distance learning faculty is ”engaging faculty in development of online pedagogy”. – Instructional Technology Council (ITC)

Too much coffee, Luigi Anzivino, CC-BY-NC-SA

The problem is one of Capacity! Too much coffee, Luigi Anzivino, CC-BY-NC-SA

Like many colleges, online and blended enrollments continue to grow even as overall enrollments decline. The demand for more flexible learning options outpaces our capacity for online delivery, in part because we lack enough faculty with the training and experience in teaching online.

This past year we began offering the Teaching Online Workshop Series – a series of twelve hands-on, competency-based, professional development workshops designed to prepare instructors for teaching online.

The Teaching Online Workshop Series consists of four units:

  • Extending your Course with Blackboard Learn
  • Teaching with Blackboard Learn
  • Designing the Online Course
  • Teaching & Learning Online

The first unit of three workshops is designed to introduce the LMS and provides basic use as far as navigation, file and folder management, setting up a grade book and using common communication tools. The second unit (workshops 4 – 6) focuses on implementing assignments, quizzes, and online discussion. The third unit (workshops 7 – 9) introduces the Quality Matters standards in areas of learner engagement, measurable outcomes, and assessment. Finally, the fourth unit of three workshops focuses on design, especially in regards to accessibility, usability, and student support resources.

The hands-on, competency-based model is a natural fit for digital badges.

…digital badges [are defined] as “credentials that represent skills, interests, and achievements earned by an individual through specific projects, programs, courses, or other activities.” – Alliance for Excellent Education

according to a new report from the Alliance for Excellent Education and the Mozilla Foundation.

The report, “Expanding Education and Workforce Opportunities Through Digital Badges,” examines how digital badges can be used to improve student learning and outcomes. It explains what digital badges are and how they work, provides examples of digital badges that have already been implemented, and speculates on the future of the system.

According to the report, digital badges are “credentials that represent skills, interests, and achievements earned by an individual through specific projects, programs, courses, and other activities.” They provide a digital hyperlink to information about the badge’s associated skills and the projects or tasks the badge holder has completed to earn it.
Read more at http://thejournal.com/articles/2013/08/29/report-digital-badges-help-learners-demonstrate-accomplishments-need-documentation-for-credibility.aspx#vmPxWhPzwJZ4ALYM.99

We considered three digital badge systems: Mozilla Backpack, Open Passport, and Credly. While all three require that awardees open an account with their system in order to accept their badges, Credly provides a preview of the badge at the time it is awarded. For this reason – and that they host the badges on their own server – we decided to go with Credly. We also liked the ease for sharing the awardee’s successes on social media including Mozilla Backpack, for which there is a building block in the next version of Blackboard.

We put together an organizational account for Lakeland Learning Technologies. The pro account permitted us to have a “verified account” – adding a certain level of authenticity. Awardees can share their badges on Facebook, Twitter, LinkedIn, and Mozilla Backpack. We will be looking at integrating the badges with Blackboard in the next service pack upgrade.

Lakeland Learning Technologies on Credly

Lakeland Learning Technologies on Credly

Earlier this week we began offering the full Teaching Online Worskshop series in a HyFlex format to all full and part-time Lakeland faculty. In an effort to increase capacity we intend to recruit future workshop facilitators from those who have successfully attained a certificate of completion for the entire workshop series.


…when Online Learning fails

A recent article in the Instructional Technology Council newsletter shared some of the challenges and frustrations from a student’s perspective when online learning fails.

An high school student tells of her experience enrolling in two online courses during her senior year. While seeking greater flexibility in her summer study schedule, she instead finds the whole experience somewhat frustrating.

CC-BY by Wolfgang Greller of Flickr

CC-BY by Wolfgang Greller of Flickr

Eight important considerations about online learning to consider from the student perspective…

1) Students need to understand the online course requires at least as much time as the face-to-face alternative. Many online courses require logging into a course site and completing assignments and discussion postings on a regular basis – as much as several times per week.

2) Familiarity with required technology is essential. New-to-online or to a given learning management system (e.g. Blackboard, Moodle, Canvas) will require some orientation. Students and instructors both need to be comfortable with the technology in order that they might focus on the learning.

3) Simply migrating course content and quizzes to the learning management system does not an online course make. In order for deeper learning to be effected students need to actively engage with the content and with one another.

4) Assessments must align with both the content and the learning activities. It can be frustrating when questions on an assessment are not related to the material. Try awarding an extra point to the student who finds an error in either the content or the assessment – and then of course, correct the error as soon as possible.

5) The level of faculty-to-student interaction is arguably the most important factor impacting student retention and academic achievement. Frequent and timely feedback, instructor availability via email / chat / texting, and some type of faculty presence, permit students to better connect with the course through their instructor.

6) Student-to-student interaction creates for the learner, a sense of community – not only for the course at-hand, but to the institution as a whole, and can positively impact both retention and persistence.

7) Support services including online tutoring, technical assistance, self-help tutorials, etc. become all the more critical when the learner is disconnected from the classroom by both time and place.

8) Lastly, Ms. Shriver points out that she prefers “learning in the traditional classroom setting”. Keep in mind that flexibility is the primary reason students enroll in online courses.  Despite the obstacles she fully expects to take more online courses in the future.

Those of us who are responsible for delivering online learning need to be cognizant of the challenges students face and look at what we can do to ensure the learning experience is of the highest quality possible.

Finding a Balance: Teaching with Technology

CC-BY-NC-SA by Foxtongue on Flickr

CC-BY-NC-SA by Foxtongue

I firmly believe instructors should not have to become technologists in order to teach online. We have instructional designers and educational technologists for that very reason.

That being said, educators do need to possess a fair understanding of the technologies they choose for instruction before they can evaluate the effectiveness of the technologies and the return on their investment (transaction costs). These costs may include investments in time and resources on the part of both students and faculty.

Some thoughts on where we might find a balance between these transaction costs and a reasonable return on our investment…

1) Familiarize yourself with the help resources –

Knowing who to call and when to call them can save both you and your students valuable time and relieve potential frustration. Is it a design issue, or a delivery issue? Is it a systems issue or a lack of familiarity with the application? By posting these resources clearly in the course menu, you and your students can focus more on learning and less on technology.

2) Become comfortable with the tools –

If you are planning to use an assignments dropbox, what types of file formats does it accept? If you can only accept a specific format be sure to specify this requirement in your syllabus and again under the assignment instructions. Provide a number for the help desk in case students run into trouble; or better yet, link to a video tutorial on how to resolve the most frequent issues. If you link to a publisher’s website from within your Blackboard course, provide a direct link to their support services.

3) Orient your students to the technologies you have selected for your course –

If you use a wiki, or plan to use Twitter, Polleverywhere, or other web-based tools, provide a tutorial within your online course. If its a blended or enhanced course, schedule class time in the computer lab and help get everyone on-board. By giving them a low-stakes assignment or assessment before the real thing, your students are less likely to have to deal with the anxiety and frustration that may accompany unexpected results when its time  for the real deal.

4) Become well acquainted with your Instructional Designers / Technologists –

These people are the experts on the tools. It’s their job to know what works and what doesn’t and how to find the work-arounds. If they haven’t run into your challenges before, they are likely to know a guy who knows a guy. So give them a call, schedule an appointment or stop in during open lab hours. These are the people who can help you sort out the myriad choices when it comes to teaching and learning with technology – and just possibly help to bring a little more balance into your life and teaching with technology.

The dreaded Group Project

It would appear that no one likes group projects – not the student – not the instructor. Oftentimes with group projects, one or more students will have an excuse why they cannot pitch in and help out,  while others want to control the entire project (they need an A and nothing less) and still others become frustrated or overwhelmed just trying to get the thing done on time.

Group Effort CC-BY-NC-SA by Lester Pyblic Library on Flickr

Group Effort CC-BY-NC-SA by Lester Pyblic Library on Flickr

In communities, people learn in order to belong. In a collective, people belong in order to learn. Communities derive their strength from creating a sense of belonging, while collectives derive theirs from participation.

– A New Culture of Learning,
Douglas Thomas and John Seely Brown

In Doug Thomas and John Seely Brown’s book, A New Culture of Learning, they describe the age-old problem of working in groups. They suggest that part of the problem lies in the fact that groups fail to engage the student in the personal.

In group projects we ask students to contribute to solving a problem, answering a question, creating content or media, etc. We then attempt to evaluate their group work based on their individual contribution. The book describes this as the community approach. Whereas in the collective approach, contributors attempt to find their own meaning, recognizing that this may be better accomplished collectively rather than individually.

Consider the student talent show… or any student activity for that matter, that brings together students with various individual and group talents to put on an event. Students with leadership and organizational skills, individual and group musical, dance, comedic talents, etc. all manage to get on stage at a specified date and time and everything works. However, should we try to control the whole thing, we find that students may be  less than willing to participate and some people are hurt and angry – personality conflicts, etc. threaten to stop the show.

The collective approach is intrinsically motivated, resulting oftentimes in less order – more chaos – yet potentially more personal investment, more energy, and more creativity. That being said, there are some things we can do to help students become engaged and stay focused.

Be specific in your expectations for the assignment and provide examples of past student work – or if this is the first time, spend some class time talking about what you are looking for and provide a rubric with detailed indicators – or when possible, have the student review others work and come up with their own indicators for a rubric.

Students may need help making connections with their team-mates. We can encourage open discussion about their own experience with the topic / assignment and where they think they can personally make a contribution. One person may have writing skills, another design skills, someone may have technical skills or access to equipment or technology that can benefit the final product. On the other hand, encouraging people to follow their interests has the potential to be more engaging than assigning a role based only on past experience or existing skills.

Smaller teams are often better as people have less opportunity to get lost or hide in the background. Everyone is accountable. By using social networks or discussion boards no one is left out, or at least everyone has an opportunity to chime in. This can also allow for the entire class to see what other teams are doing and encourage people to share ideas and resources.

As with introducing any technology to the class – spend a few minutes learning how it works.  Don’t assume your students are more tech savvy than yourself. Oftentimes students are reluctant to say they don’t know how to use a technology, thinking maybe they’re the only one. Spending a little time investing in a tech orientation yields better returns later on.

By providing opportunities for students to engage in a project on their own terms – bringing their personal interests and talents to the table, we may find they are more engaged and therefore better positioned to gain something from the experience.