Completion Report

Project Summary:

The project has now delivered the replacement for 'Clickers', with Top Hat now in place and in use.


Scope (Quality)


  • Implement the system - kept in scope
  • Configure the system for UoE use - kept in scope
  • Configure the system for integration with Single Sign-On - kept in scope
  • Configure the system for integration with Learn - kept in scope but will not be using this option for now
  • Ensure it installs on lecture theatre PCs - kept in scope


  • Prepare support materials - kept in scope
  • Prepare staff with training - kept in scope
  • Load Testing with Top Hat - kept in scope
  • Capacity Testing of UoE WiFI - kept in scope
  • User Acceptance Testing - kept in scope
  • Confirm Support arrangements within IS and between IS and Top Hat, to match the agreement set out in the SLA - kept in scope  
  • Communications to staff and students - directly and via College representatives - kept in scope
  • Decomissioning of old Clickers System - kept in scope



  • To prepare staff and students for the new personal response system
  • Ensure that the system is ready for use for staff and students by August 2015
  • Payment schedule milestones are met by the Supplier (Payment schedule is confirmed in the T&C's as defined by project TEL011)  


  • A Tested System - this includes all the issues that Top Hat have agreed to fix/develop - Delivered
  • A System that integrates with Single Sign-On so that students do not have to have a separate login (Shibboleth will be the mechanism : documentation to be presented to the Architecture Group) - Delivered
  • A System that integrates with Learn so that student details can be loaded from Learn in batch (LTI web interfaces will be the mechanism : documentation to be presented to the Architecture Group) - Delivered partially. The solution that was provided by Top Hat proved to be to clunky and for now, workarounds are in place.
  • A System that installs easily on lecture PC's - Delivered
  • A System that provides mobile interface for most mobiles and has web-based alternative for minority devices - Delivered
  • Training and Support Materials - Delivered
  • A Communcation Plan detailing who will be told what, by who, when and how - and how the project will receive feedback - Delivered  

Also necessary for launch, but not within the project scope - a policy document from Colleges on mobile device usage - not provided - readiness to upgrade WiFi where is becomes necessary in locations that show issues when PRS is in use - seven priority spaces have been identified as needing upgrades, and these are done/under way - the SLA for TopHat support of UoE is defined by the legal agreement set out by procurement project TEL011 - deliverd as part of procurement



  • An up to date PRS that allows students to use their own devices - this will be verified by feedback but already there has been good feedback
  • Better means of delivering feedback on sessions to students
  • New pedagogies enabled for staff - through new question types and out of class activities
  • Removal of proprietary hardware allows the expansion of the use of PRS beyond the limited pool of courses that use them now
  • Web enabled responses allows diverse communities, that may be physically remote from one another, to interact together
  • SSOallows staff and students to login with EASE credentials to minimise effort, enforce consistency and transparency, and facilitate identification  within Top Hat sessions ands reports



Success Criteria


  • Staff and students aware that there is a new system and prepared for its use by start of the academic year - Achieved
  • System configured for Edinburgh use, and installing without issues on lecture theatre computers, and mobile devices for staff and students - Achiveved
  • Uptake of the service - Achieved



Analysis of Resource Usage:

Staff Usage Estimate: 30 days

Staff Usage Actual: 22 days

Staff Usage Variance: -27%

Other Resource Estimate: 0 days

Other Resource Actual: 0 days

Other Resource Variance: 0%

Explanation for variance:

The technical effort expected for the Sibboleth integration and then Single Sign_on was around 8 days less than estimated as the work involved was done mostly by Top Hat , ITI and LTW for these pieces.


Also, the team was split into Implementation (technical) and Delivery (rollout and comms with Colleges), and Wesley led on the Delivery team so reduced PM effort here.

Key Learning Points:


(Mark Wetton)

The negotiation with TopHat was difficult as some of the items they had responded as having proved to be less clear cut once Wesley had started testing. I think the supplier commitments to resolve these issues brought us back on track.

- There are a couple of items that I&³1;ve been speaking to Wesley about re things that are of more strategic importance but are not yet provided:

                1. A standards based question import/export (QTI) capability. I&³1;m surprised this wasn&³1;t mandatory in the bid (this has been clarified subsequently by Wesley)

                2. An ability to allow one user to have multiple roles within the system Perhaps the above could be on a standard requirements spec check list?

- The show and tell and web page developments have been fairly painless thanks to Wesley who has done a great job

Outstanding issues:

No outstanding issues.

LTW are checking that all spaces identified as needing wi-fi upgraded are being handled.

Project Info

Next Generation Personal Response System Implementation
ISG - Technology Enhanced Learning (TEL)
Project Manager
Maurice Franceschi
Project Sponsor
Mark Wetton
Current Stage
Start Date
Planning Date
Delivery Date
Close Date
Programme Priority
Overall Priority