Overview

Background

Questionmark Perception (QMP) is a fully featured online assessment system which has been in use at the University since around 2001.  Questionmark Perception is the main centrally supported eAssessment system and it is used to underpin around 90,000 student assessments every year, including summative exams.

The current version (v5.7) of the system was delivered in 2015. This project will upgrade to v6.

 

Scope

The scope of this project is to ensure the current version of QMP is kept up to date with the current supported versions available from Questionmark.

  • Changes from the previous version mean:

    • The version of v6 for the upgrade has some significant improvements to the question banking software which will allow us to offer more devolved management capabilities. Additionally the question authoring tools are fully online, removing the requirement for a Windows-only client installation – a major barrier to take up in some Schools.
    • Previous versions have required UoE to produce new environments and also update QMP on the environments with support from Questionmark. For this version Questionmark will carry out the upgrade on our new infrastructure through remote connection. This should significantly reduce the downtime experienced n previous upgrades (Last upgrade resulted in 5 days downtime).
    • User help is more important for this upgrade as there are significant changes to the product.
    • As authoring is done on the web in v6 so updating the Authoring Manager installer is no longer required
  • New features contained within v6 are fully explored and if applicable tested within the user community.
  • All non-standard integration are checked for compatibility with v6 (GLO, formative login scripts).
  • To explore any potential infrastructure issues and set additional load tests where appropriate.
  • Ensure custom scripts can be served from the QMP infrastructure.
  • A comprehensive view of available templates to deliver a reduced ‘core’ set of updated templates.
  • EASE authentication: LDAP connection has been completed and rolled out to Exams and labs. This project only requires to test the EASE integration with QMP.

 

Not in Scope

  • Updating the Authoring Manager installer as authoring is done on the web in v6
  • Moving QMP to Questionmark’s own hosted service. UoE has a perpetual license for current setup.
  • It should be noted that GLO is near end-of-life and a replacement will need to be considered in the near future – it is not part of this upgrade (for information: currently there is no suitable question type in the system to migrate to. An html5 question type is in development by Questionmark to replace the flash question type that GLO uses, but there is no date for that release. GLO exercises are being withdrawn from use, the largest use (French) has already stopped. More work is required with languages re way forward for this question type)

 

Objectives & Deliverables

The deliverables are prioritised using the MoSCoW prioritisation method:

M=Must Have; S=Should Have; C=Could Have; W=Want

  • (M= has to be satisfied for the final solution to be acceptable in terms of delivery dates, compliance, viability etc.
  • S= high-priority requirement that should be included if possible -workarounds may be available
  • C= a nice-to-have requirement
  • W= want but will not be part of this project)

Objectives and Deliverables

Priority

MoSCoW

Owner

O1 To approve statement of work by 9 March 18

 

 

D1. Questionmark to provide statement of works to be approved by all parties

M

Questionmark

O2 To deliver improved user experience to all users through improved functionality

M

 

D1. Creation of new infrastructure: TEST and LIVE environments

M

DevTech

D2. Upgrade of QMP to v6, deployed to TEST and LIVE environments

M

Questionmark – support from DevTech

D3. Migration of data and settings to v6

      (a test migration will take place before the full migration)

M

Questionmark – support from DevTech

D4. Load testing completed

M

DevTech/LTW

D5. Updated documentation

  • BRD
  • TAD (includes Ops document)
  • EQIA
  • User documentation updated
  • Privacy Statement created

 

M

 

  • LTW
  • DevTech
  • LTW
  • LTW
  • LTW

 

D6. A communication plan for all QMP users to educate them on the upgrade features / timings.

  • More important in this upgrade as there are significant changes

M

LTW

D7. Decommissioning of old servers

M

DevTech

O3 To increase the ability to widen user base to new programmes through improved functionality, and greater scalability

M

 

D1. Custom GLO templates work on v6

M

DevTech & LTW

D2. Formative login scripts work on v6

LTW

D3. Review branded templates (which offer functionality for different assessment settings)

S

LTW

D4. Review custom banners

S

LTW

 

Benefits

Benefit

Recipient(s)

How Measured

Owner

Business as usual maintained

 

QMP Users

Service availability

LTW

Potential for greater take up due to web-based authoring tools

 

Academic Schools

Service usage

 

LTW

Excellence in Teaching and Learning: this upgrade will enable QMP users to benefit from enhancements in v6. It will include enhancements to QMP which are beneficial for assessment. This will lead to a quality service for the students who use it.

 

QMP Users

Service usage

 

Survey around Xmas 2018 to get user feedback

LTW

Reduced cost of support

Helpline

Number of calls per month to Helpline surveyed -  will need benchmark

LTW

 

Success Criteria

  • Current functionality (including bespoke) remains in place.
  • Templates are fully compatible with new functionality.
  • New enhancements are made available to users.
  • There are no issues with maintaining current data quality.
  • There are no negative changes to current data quality.
  • User help and guidance documents are updated.

 

 

Project Milestones

Milestone

Due Date

Comments

Planning

16 Feb-18

 

Statement of works agreed and approved

09-Mar-18

 

VM Environments set up TEST & LIVE

23-Mar-18

 

Upgrade to v6 in TEST

20-Apr-18

Upgrading of QMP by Questionmark

Test migration

1-May-18

 

Full migration of data and settings into v6

11-May-18

Migration by Questionmark with support from DevTech

TEST signoff

16-May-18

 

UAT  finished

18-Jun-18

LTW to complete - Includes testing the integrations

Acceptance signoff

28-Jun-18

This will include time for rework

Training completed

28-Jun-18

 

Deploy to Live*

 

 

11-Jul-18

If the delivery date has to change will only be by a week. Will be confirmed first week in March.

LTW can't get feedback on Moodle go LIVE yet as there is a minor Moodle update on 1st March and they don’t want users confused with lots of upgrade related comms. Moodle user survey will take place after the minor update scheduled for 1st March to determine the best date.  

Decommissioning of old servers

27-Jul-18

 

Deployment review

30-Jul-18

 

Close

31-Jul-18

 

*There is a hard delivery milestone date due to the system having to be ready for the start of the academic session 2018/19

Project Info

Project
QMP Upgrade
Code
TEL052
Programme
ISG - Technology Enhanced Learning (TEL)
Management Office
ISG PMO
Project Manager
Colin Watt
Project Sponsor
Karen Howie
Current Stage
Close
Status
Closed
Project Classification
Run
Start Date
08-Jan-2018
Planning Date
15-Nov-2018
Delivery Date
11-Jul-2019
Close Date
21-Feb-2020
Overall Priority
Higher
Category
Compliance