OMR Service Report: Administering objective tests in assessment and feedback models using optical mark reader software

The Elevate Team have been running an Optical Mark Reading Service (OMR) since 2011-12. The aim of the service is to provide an opportunity for course teams to use Objective Testing (low and high stake) in their assessment and feedback models at UCS. This service complements the use of the Quiz (Test) Engine in LearnUCS.

The usage can be divided by the following broad activities.

Admission for Radiography

• As part of the admissions process the Radiography Team run a Literacy Test (20 questions) and Numeracy Test (24 questions). During 2012-13 the Elevate Team administered 20 tests.

Examinations and assessed work

• IMDEC103 - January 2013 exam & resit
• IMDPSY111 - January 2013 exam & resit
• GCC00016 - February 2013 exam
• IHRDIR115 - June 2013 exam

For more information see, https://docs.google.com/document/d/1n4Lj-fuyFlhckGdE-RTAk5as-CyaTDOqYsuNHgPL5Os/edit?usp=sharing

In discussion with ... Leigh Parratt on the Explain Everything App

The video (3 mins) is part of our In Discussion with Series. Which aims to share practice in how lecturers have been using appropriate technologies to enhance their teaching, assessment and the student learning experience.

This discussion is with Leigh Parratt around how she has been using the Explain Everything app to record some feedback videos. Leigh outlines how it has been used on her face to face course. Some of the key message I took from this include;

• positive student feedback on the use of the app to create problem solution videos


• it was really easy to use


• her future plans are to continue to use it and integrate the videos into her lecturers

The following is an example of the feedback she created.

For more information on how you might use Clickers in your teaching and learning, please email the Elevate Team (elevate@ucs.ac.uk)

A tablet in the hands of a lecturer: reflections on the use of tablets at UCS 2012/13

The Elevate Team have reviewed the use of Tablets (mainly iPads) at UCS over the last academic year. The report is available from:

• https://docs.google.com/document/d/1DfMkYx-V9_wX1PSaKoXfbFvrdKpt_5h2LPoSe3uzqII/edit?usp=sharing

Or alternatively, it is in the Elevate Team's Report area; http://wolseyweb.ucs.ac.uk/blogs/elevate/?page_id=70

I was very impressed by the way lecturers have quickly found activities which add value to themselves and the student learning experience, outside the applications we (Elevate) support course teams and individuals on. For instance, the following quote illustrates the degree to which some lecturers have embedded their use of Tablets,

“photography specific apps have allowed me to illustrate techniques (demonstrations of shutter and aperture to BA Hons Graphic Design students via the camera simulator app). We have viewed student negatives on the ilovefilm app, and used the viewfinder pro app to make lens choices with students” Response A in Evaluation Survey, 2013

 

Mahara in Numbers - June

Back again reporting on the figures in Mahara. Over the past couple of months there has been a gradual levelling out from a peak in activity in November 2012. The total number of unique users has increased slightly, however it will take a longer period of time to extrapolate any solid data from this as this has only just started being monitored, this and a few extra statistics such as space used for data.

We have had a total of 628 unique users access Mahara, and between the months of February and end of June we have had between 82 - 164 users access Mahara every month.

This levelling off from the last peak between SEP-NOV 2012 is higher than that of the first peak in the same period the following year. We will get a better picture of sustained usage after this years 2013 September induction as we are raising Mahara's profile and its effective use in the student induction programme.

e-Learning Technology Landscape for 2013/14

The following link is to our e-Learning Technology Landscape for 2013/14. The main change since the previous year is we've better defined the support levels.

• https://docs.google.com/drawings/d/1YFjRGpvFvFhj45BXyp0CAQLefMZAz2AZTawrMm0795k/edit?usp=sharing

If you have any questions about the Landscape, or would like to us to talk it through with you and your colleagues, please contact the Elevate Team (elevate@ucs.ac.uk)

If you'd like to see these e-learning tools within the wider context of pilots, retired services etc., see

• https://docs.google.com/drawings/d/1C1BivWeWtJZ47QcQSREkM6xON0o53yM80rGbtEuLI4Q/edit?usp=sharing

 

LearnUCS Summer Upgrade - Common Tasks

With the LearnUCS Summer Upgrade fast approaching, we have compiled a list of common tasks and new features for lecturers and accompanied that with a video guide of how to complete the task in the new LearnUCS release.  We will be adding to this list over the next few weeks.  If you are a UCS lecturer and you would like access to the test environment to have a play with the new version, please email elevate@ucs.ac.uk

New Features

Navigation:  This release of LearnUCS uses a new Dashboard style navigation system.  All notification are made to the dashboard, allowing you to reply to blog post and discussion posts without having to go to each separate module/course areas.   The new Retention Centre also sends notifications to the dashboard as do many tools.

http://ondemand.blackboard.com/r91/movies/bb91_myblackboard_global_nav.htm

Inline Grading Tool: Probably the biggest new feature is the Inline Grading tool.  This tool allows lecturers to view and annotate a student's online submission directly in the browser via the Gradecentre.  This means there is no need to download the document to mark it off line, which in turns removes the need to upload feedback to individual students.  Below is a link to the a video showing the new Inline Grading tool in action.

http://www.screencast.com/t/SAZJVLrY4Z7

Retention Center: The old Performance Dashboard has been replaced with a new Retention Centre that allows quick and easy access to learner analytics.  This gives the lecturer a dashboard to view set rules, notifying them of warnings including, students not logging in, missed assessment deadlines and more.

http://ondemand.blackboard.com/r91/movies/bb91_evaluation_retention_center.htm

Content Editor: The Content Editor is a replacement for the old text box editor, this has now been completely reworked and now allows for changes to colours and fonts and more.  This now is a proper WYSIWYG (what you see is what you get) editor.

http://ondemand.blackboard.com/r91/movies/bb91_tools_using_content_editor.htm

Profiles: Blackboard Profiles are a new tool allowing all users to create a profile of themselves, that also has a one way connection to Twitter and Facebook.  This one way connection allows you to pull in your avatar - photograph and profile text to LearnUCS.  Profiles are used to allow users to identify each other, so you can roll your mouse over someones name on a discussion board in your course/module, to see more information about that person, if they have chosen to use their profile.

http://ondemand.blackboard.com/r91/movies/bb91_myblackboard_profiles.htm

Common Tasks

Discussion Boards: The discussion board tool has been completely rewritten, giving a much better experience for users.  You now get to see all messages in a thread without having to click to see each one.

http://ondemand.blackboard.com/r91/movies/bb91_discussion_board_interacting.htm

Calendars: This tool has also been completely rewritten, all calendars can now been seen from the dashboard in a single view.  This view allows changes to be made to the calendars without having to go to each separate area.  You can also link the LearnUCS calendar to other external calendars, if you are a Google Calendar user, you can display the LearnUCS calendars in Google.

http://ondemand.blackboard.com/r91/movies/bb91_course_tools_calendar.htm

Course Files: Using Course files allows you to upload structured zip files into LearnUCS which can then be unzipped in the same structure.  You can also use drag and drop if you setup the WebDAV feature.

http://ondemand.blackboard.com/r91/movies/bb91_course_files_tour.htm

Adding Files from Course Files:  If you use Course Files to add materials to LearnUCS, you will need to know how to add those to your module to allow students to access them, this video shows how to do that.

http://ondemand.blackboard.com/r91/movies/bb91_course_files_attach_course_file_to_content_item.htm

 

A taste of things to come: Reflections on the use of Tablets at UCS 2012/13

As part of the continued investigation into the potential use of tablets as a learning technology for staff at UCS, we'll soon be publishing our annual report on "A tablet in the hands of a lecturer: Reflections on the use of Tablets at UCS 2012/13". Some snippets are ....

Background

The aims of the initiatives around teaching staff using tablets is to facilitate the exploration of tablet technologies to enhance teaching, learning and assessment. In particular, to help inform people at UCS about the potential of this technology to meet the broad strategic aims within UCS’s Teaching and Learning Strategy, including;

• To develop assessment practices which are developmental, transparent, relevant and fair and which provide high quality, timely feedback


• To offer a wide range of modes of delivery and utilise current technologies to provide more flexible opportunities for study


• To provide learning and teaching informed by high quality research and scholarly activity

In 2012/13 the Elevate Team

• administered eight tablet devices which were loaned (long and short term loans to staff at UCS (Ipswich and Lowestoft)


• supplied iTunes vouchers for staff to buy specific apps, including Explain Everything, Goodnotes and iAnnotate


• loaned peripherals to staff (stylus, projector connectors and external microphones)


• provide bespoke support to course teams and individuals who are using tablet devices as a learning technology


• included specific iPad apps within our supported Learning Technology Landscape, including; UCS Connect, Goodnotes, GoTo Meeting, Explain Everything, Voice Record HD and MobileLearn.

This report draws together the findings of a recent staff survey, and reflective posts through the last 12 months (See Appendix 2 for links to blog posts around these pilots)

Particular uses included;

• annotation and return of student submitted assignments


• provision of generic multimedia based feedback around questions and problem sets


• recording (audio) of focus groups and class discussions for reflection


• recording (video) student presentations for staff and students to talk through and provide formative feedback


• use by individuals of discipline specific apps


• use on dissertation and project meetings as a record and list of actions to be shared via email directly after the meeting

Methodology

The data was collected via an online survey available during May and June 2013 (see Appendix 1 for the survey questions). The survey was promoted to those who had borrowed a Tablet device from the Elevate Team, and to all staff via a posting on the Elevate Team blog (http://wolseyweb.ucs.ac.uk/blogs/elevate/?p=101792) on the 21st May. The posting was automatically forwarded to the Elevate Team area on MyUCS.

In total there were 14 responses. Given the response rate it must be acknowledged this is not a statistically significant survey and the findings should take this into account.

Recommendations

The aims for 2013/14 are about encouraging use, creative thinking around technology enhanced learning and facilitating a community of practice through disseminating staff experiences. Based on the survey and a number of other conversations, the recommendations for 2013/14 are listed below.

• re-align the focus from the provision of a specific tablet device, towards accommodating staff who bring their own device. Therefore, shifting the resource to the provision of vouchers and loan of peripherals (stylus, external microphones and projector connectors)


• Test the current generation of Apple, Microsoft and Andriod devices against a list of common tasks. Complete by September 2013


• Write a collaborative project proposal with a Division at UCS Ipswich to provide a tablet to all teaching staff in the Division with coordinate a number of pilot studies and staff development events. Complete proposal by October 2013, and seek funding.


• be more proactive in raising staff awareness of effective use of tablets as a learning technology through facilitating a community of practice. Including, hosting an event on Mobile Learning (A tablet in the hand of a lecturer) at UCS. Complete by April 2014.