Overview

Background

This project will deliver the new online assessment application, Practique, for use by the Medical School.

In a 2016 National Student Survey, the School established that improving both the assessment and feedback was the number one priority. The student experience is greatly enhanced when feedback can be provided at the question or topic level. Currently this is difficult without compromising the question bank. Hence, a new online assessment application is required to introduce a faster and much improved student experience. The procurement phase was managed by MVM107.

Following the UoE procurement process with an open tender, FRY-IT and their product Practique were the winning bid. It will be delivered as an offsite/cloud based offering.

This project has been initiated in parallel with MVM107 completing the contract negotiations and MVM119 (delivering data content).

Dependency risks:-

MVM107 - risk 1

MVM119 - risk 4

Scope

This project will deploy Practique to support assessment and feedback for MBChB following the successful procurement in MVM107. In parallel, MVM119 will oversee the import of exam content (question and feedback) from OSCA and OSCA+ as well as the generation of new content.

The activities in this project will include:

  • deployment of the selected application, Practique from FRY-IT - cloud based hosted on Amazon Web Servers
  • provision of training for MBChB users and IS support staff
  • configuration and setup of UoE platforms that will support running the exams
  • create two new environments; dev/test and production
  • support a training session for key MBChB staff on June 27
  • develop a pilot to enable MBChB students to assess Practique prior to exams - students from years 2,4,5 and6 will have either a review, demo or a formative style exam to ensure that the first time they use the application is not in a marked exam - a review and feedback loop will occur in order to capture potential configuration, process or app changes
  • review the potential of developing an api to APT or provide support for the current process to import csv files into APT/Euclid
  • confirm status of exam scores
  • Operating Level Agreement (OLA) - with teams such as LTW to provide support for Practique - the Service Level Agreement (SLA should already be confirmed as part of the contract in MVM107
  • decommission off OSCA and OSCA+
  • schedule a disaster recovery test and a business continuity test
  • review key performance indicators

The following activities will need to be covered across both MVM118 and MVM119, TBC whether they will be aligned to either one specifically:

  • Communications to all stakeholders - approach planned to have joint communications
  • Exam support - both projects delivering components, approach to consider it a shared outcome
  • Support MBChB change - not the technical elements surrounding the introduction of a new exam application, but the structural, process and people based change that will emerge
  • Set up a user group - they will work with FRY-IT to shape future releases, MBChB requirements and review all change

RFC C1705-140 raised.

Out of scope:-

  • No interfaces have been identified as required for student data or Euclid in this project - the project will support the current manual process, but is continuing to engage with Student Systems - it is possible that a change might be introduced - risk raised
  • There is currently no known requirement to involve any IS teams other than Project Services - LTW and IS MVM teams currently support OSCA and OSCA+ including system access and exams - they are engaged and part of the Project Team - the project has contacted Ana Heyn and Pater Jackson (both part of the procurement team on MVM107) to review

 

The production deployment check list has been included. Note; we do not currently have a detailed implementation plan as the contract remains outstanding - see risk MVM107 above. We do have a training plan and are in discussions with FRY-IT and MBChB to agree the scope. It is assumed that these areas will be completed after the project brief has been approved. Any changes will be captured and documented.

Objectives and Deliverables

 

No.

Description

Priority     

Owner     
O1  The projects objective is to deploy a new application providing assessment and feedback functionality for the MBChB.    

D1

To create two UoE MBChB environments which will fully support all MBChB exams from 2017-18 onwards

  M

Project

D2

To construct a user group which will be in place working with the supplier once the project ends

  S

Project
D3 To support the MBChB through a level of significant change; including process, systems, roles etc   M Project
D4 Deliver as-is approach for MBChB to export data into APT (Reporting hub)   M

Project

D5 Create appropriate OLA's - likely MVM and LTW   M Project
D6 Ensure OSCA and OSCA+ are decommissioned   M Project/LTW 
D7 Execute tests for FRY-IT disaster recovery and UoE business continuity   S Project

 

Benefits

Improving assessment and feedback of the students is considered the number one priority for the Medical School. This will be achieved by the deployment, data migration/creation and level of support for Practique provided by these projects. It is a strategic target to improve student satisfaction and it is believed that this tool will greatly enhance the student experience.

It is anticipated that there will be a further benefit from decommissioning OSCA and OSCA+. Currently we have no confirmation of existing costs attributed to them, but have requested the information.

 

Success Criteria

Supporting the execution of a series of exams during 2017-18 with quality data and improved best practise.

Project Milestones

(as of Tuesday May 30, 2017)

Target Datesort descending Previous Date Title Stage Complete
05-May-2017 No date available IS WIS approval for initiation and ASTA submission Initiate Yes
02-Jun-2017 No date available End of Planning - Project brief approval Plan Yes
09-Jun-2017 26-May-2017 Dependency MVM107 contract with FRY-IT signed Plan No
30-Jun-2017 No date available Environments ready to support Mock Exam content ready to run milestone for MVM119 Execute No
31-Jul-2017 No date available Generic TBC - api into Euclid, single sign on and exam room preparation activity complete and tested Execute No
31-Aug-2017 No date available Training complete to support September/October 2017 Exam Execute No
29-Sep-2017 No date available Disaster Recovery and Business Continuity Testing complete Execute No
21-Dec-2017 No date available Recommendation report created Execute No
31-Jan-2018 No date available Close report created Execute No

 

Project Info

Project
Deployment of FRY-IT Practique for MBChB
Code
MVM118
Programme
MVM Learning and Teaching (MVMLAT)
Management Office
ISG PMO
Project Manager
Paul De'Ath
Project Sponsor
Sheila Fraser
Current Stage
Close
Status
Closed
Start Date
01-May-2017
Planning Date
n/a
Delivery Date
n/a
Close Date
15-Jun-2018
Programme Priority
1
Overall Priority
Normal
Category
Discretionary