Closure Report

Project Summary

This project  was opened in Aug 2020 as a multi year project. The initial scope was to address:

  • Adaptation and Renewal (ART) work to support students' administrative tasks at start of term
  • prioritised compliance requirements and
  • prioritised discretionary enhancements raised in the product backlog. 

The enhancements should also include the changes being raised by the Tribal software or the technical debts. 

The priority is based on benefits to be realised, though there will be a balance between

  • the product backlog enhancements delivering high benefit  and being discretionary work, and
  • the requirements that need to be implemented at certain time of the life cycle (start of term, exam boards...) and for compliance statutory returns purpose (like Hesa change). The compliance work will have to be prioritised over the discretionary enhancements.

 

This project had 4 objectives when opened in Aug 2020

Objectives

Deliverables 

Achieved?

  • O1.Address the backlog of issues and improvements prioritised in the product backlog by Student Systems Operations . The priorities may change throughout the year as agreed with Student Systems Operations, and Schools' user group in line with key deadlines (should)
  • O2. Support the emerging ART stream of work (must)
  • O3. Provide annual maintenance and support services during peak periods of the life cycle (must)
  • O4- Address compliance requirements (must)
  • D1-Regular releases of improvements to EUCLID functionality (should)
  • D2-Standard Operating Procedures (SOP) with each release (should)
  • D3-Communication to users, with updated user guidance (should)
  • D4-relates to requirements to capture data for HESA statutory returns (enhancement to Annual Registration process)  and Widening Participation contextual checker existing process (must)
  • D1- Yes- 30 releases in the 1st year (see outcomes below)
  • D2- Yes
  • D3-Yes as part of releases
  • D4- Yes

 

Additional scope was added as follows over 2021/22/23:

1.Jan 2021- New scope emerging to support services (https://secure.projects.ed.ac.uk/unpublished/project/sac084/issues/3)

Ref

Objectives

Deliverables & Benefits

Achieved?

O1

As a result of Brexit, address  immigration changes. There are required changes for EU/EEA Students to be able to request a Confirmation of Acceptance to Study (CAS).

 

  • D1-communication updates
  • D2-self service enhancement 
  • D3-update visa types
  • D4-enhance flag for immigration compliance status
  • D5-update application for CAS
  • D6-email notification to EU applicants

Benefit achieved:  we are able to remain compliant with the Home Office regulations for EU/EEA students post Brexit.

  • D1-Yes
  • D2-Yes
  • D3-Yes
  • D4-Yes
  • D5-Yes
  • D6-Yes

O2

Address EU fees change and impact to Irish nationals

  • D1-Rewrite the algorithm calculating the fees changes for Irish and EU applicants
  • D2-Update BI reporting  to meet requirements for  post-Brexit Irish applicants/students, and for other post-Brexit EU applicants/students,
  • D3-Update communication sent to students/applicants, web guidance   

Benefit achieved: EU student experience enhanced: EU fees can be processed as BAU, and the rewritten algorithm can be scaled up with future changes

  • D1-Yes
  • D2-Yes
  • D3-Yes
O3 Demand from schools on Assessment and Progression Tool (APT)  for year average correction and fair assessment changes for students ahead of the summer Boards of Examiners
  • D1-Awarding Credits on Aggregate 
  • D2-Credits on aggregate usage 
  • D3-Average mark showing incorrect 
  • D4-Overall mark not refreshed when recalc done 

Benefit achieved: the issue with the award mark was causing confusion and additional work for Schools during programme boards. The new feature for awarding credit on aggregate significantly reduced the time to perform that action. 

  • D1-Yes
  • D2-Yes
  • D3-Yes
  • D4-Yes
O4

Address SRA/Widening Participation WP bug

 

D1-Enhance current functionality ahead of start of term for new intake 

Benefit achieved: the WP contextual admissions checker is working as expected with new enhancements in place for start of term

D1- Yes

 

O5 Engage with more schools to help with their course enrolment process change as per efficiency demonstrated during last year start of term 

D1-Enhance support for the Bulk Optional Course Enrolment Service, incl guidance and webpages for users

Benefit achieved on Oct 21: We received requests for a total of 1,173 courses, 8,521 students, and 24,718 enrolments between the end of July and the end of October 2021, with 17 Schools using the service during this period. We processed a total of 24,506 enrolments; the remaining records either had already been processed by someone in the School, or we couldn’t process because there was no space on outside courses. We are expecting more requests in November/December for semester 2 enrolments. We are working on an evaluation which will include suggested ways to improve the service in 2022 and would welcome feedback from colleagues on the service.

D1-Yes

 

2. Jan 22- https://secure.projects.ed.ac.uk/unpublished/project/sac084/issues/5

 

Ref

Objectives

Deliverables & Benefits

Achieved?

O1

APT performance issues ahead of next Board of Examiners: improve assessment and progression performance:

  • D1-  rewrite some of the EUCLID database queries for efficiency ,
  • D2- add analytics to monitor performance,
  • D3- review  the infrastructure when students' semester 1 results are published:  set up a read only database for student queries 

Benefit achieved: 

  • Year-on-year net improvement in undergraduate marks publishing – with 91% of marks published by the deadline.
  • The average time to publish course results in the week leading up to the deadline has also improved since 2021.
  • Moreover, average page load times for students viewing course and assessment results were lower in 2022 – even with a greater number of page views than 2021.
  • There were also improvements in the performance of bulk processes, used by staff to perform tasks like calculating and publishing course results, and average user timing across all processes.
  • Since the enhancements were made no issues or outages have been reported by staff or students.

Link to the news on https://secure.projects.ed.ac.uk/project/sac084/journal/2

  • D1-Yes
  • D2-Yes
  • D3-Yes

O2

Security issue: update Single-Sign-On (SSO) links to follow the Tribal’s best practices recommendation, as a result of a security  breach: some of SSO links from 12 institutions have appeared in the searching results using Bings or Google.

 

Follow the Tribal’s best practices recommendation including:

  • D1-Ensure all SSO links have an expiry date
  • D2-Review the length of expire period to keep it as small as possible (depending on the business needs)
  • D3-Develop a process to regular change the security key for the SSO link encryption and start doing this regular
  • D4-Apply the software update as soon as it is published

Benefit achieved: risk of security breach reduced

  • D1-Yes-Standard expiry period applied.
  • D2-no. The expiry date will be reviewed later to agree a suitable expiry period for each SSO link generation as per the business needs
  • D3-no, the process to regularly change the security key is still outstanding and in pipeline work for SSP
  • D4-Yes
O3 Legacy work-SRL syntax is being de-supported by the new SITS version and requires to be upgraded
  • D1-Impact analysis and organise batch work across all EUCLID services
  • D2-prioritise and start updating codes being desupported, incl archiving/deleting legacy codes

Benefit achieved: prioritised services have the SITS legacy codes updated, removing the risk of errors for users. It ensures the current syntax remains supported by Tribal .

  • D1-Yes
  • D2-Yes
O4 Legacy work- solve performance issue with annual batches

D1- address performance issues for annual batches to manage applicants transfer and continuing students roll over

Benefit- reduced impact to Operations and improved student and applicant experience thanks to faster turnaround 

D1- Yes

 

3. Aug 22 The decision has been made to keep this project running for another year to  support the  EUCLID service,  deliver enhancements and continuous improvements prioritised https://secure.projects.ed.ac.uk/unpublished/project/sac084/issues/6 . Focus on:

Ref

Objectives

Deliverables & Benefits

Achieved?

O1

EUCLID support during Assessment and Progression Tools (APT) peak period Board of Examiners

  • D1-Increase the memory on the database server  
  • D2-Move the database servers to a new virtual management infrastructure (by IT Infrastructure)
  • D3-Enhance the database performance by database turning and introducing more indexes 
  • D4-Improve the Assessment and Progression Tool (APT) EUCLID processes along with the student self-services process

Benefits achieved: more than 37,000 course results released to students with no outages, link to news https://secure.projects.ed.ac.uk/project/sac084/journal/4

 

  • D1-Yes
  • D2-Yes- achieved via a separate project 
  • D3-Yes
  • D4-Yes

O2

Enhance Extensions and Special Circumstances ESC service

  • D1-Ability for the ESC team to create and edit cases on behalf of students 

  • D2-Add "Notes" functions for schools and the ESC team 

  • D3-Ability to bulk remove old cases, ensuring the University meets GDPR requirements 

  • D4-Deliver training to help University Schools align with ESC systems 

Benefits achieved: Improvements to students' coursework Extensions and Special Circumstances system LINK news 

  • D1-Yes
  • D2-Yes
  • D3-Yes
  • D4-Yes
O3 Support Disability Service

D1- Enhance student Hub and Student Self Service 

Benefits achieved: improved staff and student experience

D1- Yes
O4 Continue legacy work as a result SRL report syntax de-supported by new SITS version

D1-Rewrite remaining SRL syntax 

Benefit achieved: further services have the SITS legacy codes updated, removing the risk of errors for users

D1-Yes
O5 Meet this year 's SRA Admissions requirements for Widening Participation Contextual Admissions

D1- Deliver this year changes for the Widening Participation Contextual Admissions, ahead of start of term

Benefit achieved: the WP contextual admissions checker is working as expected with new enhancements in place for start of term

D1-Yes
O6 Managed end of life of non supported systems applications (ColdFusion)
  • D1-upgrade PATH selection process, so that schools can see the list of course selection made by students
  • D2-Rewrite Prospectus fees feed showing tuition fees (delivered by CAM and IS Apps Dev Services)

D2 Benefit: new streamline process delivered with improved user  interface to upload fees directly from Euclid, removing manual points of failure

  • D1-Yes
  • D2-Yes
O7 Complete the Assessment & Progression Tool (APT) documentation for Operations

D1- standard operation procedure (SOP) for APT are written and delivered to student systems Operations

Benefit:  BA was able to work with Operations on APT issues to share knowledge. Operations can support APT as business as usual

partial delivery due to conflict
O8 Enhance graduation ceremony code range to meet new demand following graduations catch up post Covid

D1-Graduation Ceremony codes are enhanced, including impacted reports

Benefit: Increased number of graduation ceremonies can be run in Euclid, no impact to users

D1- Yes
O9 Address end of life for Make Transition Personal (MTP) student survey

D1-Support moving from EVASYS to a SharePoint solution for this student survey

Benefit: this allows the end of the annual maintenance on EVASYS, reduced licence cost , and the improved interface allows users to request update and new questions to be added to MTP

D1- Yes

 

4. 2023: Focus on Special Circumstances  ESC, start of term, Google analytics upgrade

Ref

Objectives

Deliverables & Benefits

Achieved?

O1

Extension and Special Circumstances (ESC) service: address Extra Time Adjustments (ETA)- 

Enable students with disabilities to be able make full use of their ETA on all relevant assessments

  • D1-Enable the correct ETAs to be ‘scaffolded’ on top of coursework extensions where the allowed extension is < 7 days
  • D2-Understand and enable correct treatment of ETAs where the length of the ETA must be limited due to type of assessment (e.g. for multiple choice question (MCQ) tests)
  • D3-Remove the need for students to have to apply for their ETAs to be assigned to all relevant assessments
  • D4-Enable students to have visibility of their revised submission date deadlines (i.e. with their ETA applied) as soon as they are enrolled on the course/the deadlines are added to assessment/their ETA is granted
  • D5-Remove the SharePoint ETA workarounds currently in place for BMI, PPLS schools and for assessments that don’t allow coursework extensions

Benefit achieved: Link to news https://secure.projects.ed.ac.uk/project/sac084/journal/5

  • D1-Yes
  • D2-Yes
  • D3-no, not required after review/agreement with Disability Service
  • D4-Yes
  • D5-Yes

O2

ESC Reporting - dashboard development (operational and strategic)

 

  • D1-Work with EPCC to determine options for data extraction
  • D2-then one-off analysis and on-going reporting 
  • D3- identify business and strategic requirements. Develop data dashboards

Benefit- With the data extracts received from the 2 different databases, an ESC Strategic Reporting Dashboard was created to then enable Heads of Colleges and Services to review the trends in applications for extensions and special circumstances. The reporting is flexible enough to allow review on a school, programme and study level basis. This is the first ESC Reporting Dashboard that has been made available to users. This dashboard also allows tracking the usage of ESC services, which enable changes in the ESC Policy. This will ensure that extensions and special circumstances are used as an appropriate support mechanism. 

  • D1-Yes
  • D2-Yes
  • D3-Yes
O3 Start of term readiness

Annual maintenance  for the 2 services:

  • D1-On line registration: meet new data requirements from HESA
  • D2-Widening Participation Contextual Checker : apply changes requested by SRA

Benefit: the 2 services used by students and applicants are enhanced as per new requirements from HESA and DRA ahead of start of term

  • D1-Yes
  • D2-Yes
O4 Address Google analytics end of life across Euclid, PATH, DRPS, Course Timetable Browser, SRA WP applications 
  • D1-Upgrade Google Analytics
  • D2- Remove old analytics code

Benefit: Legacy code addressed

  • D1-Yes
  • D2-Yes
O5 Investigate rollback for large deployments D1-deliver new rollback process. It saves DevTech time. D1-Yes

Analysis of Resource Usage:

IS Apps resources (includes SSP Dev , Dev Tech, Production, PM) budget vs actual spend total 1708 days (with DevTech 40d, IS Production: 71d, Project Services 113d):

  • 20/21: budget 480d, actual spend 447d
  • 21/22: budget 315 d, actual spend 477d
  • 22/23: budget 537d, actual spend 616 d
  • 23/24: budget 100d , actual 168d at Nov 23

SSP BA and Tester resource actual spend total 1675 days:

  • 20/21: 586d
  • 21/22: 457d
  • 22/23: 492d
  • 23/24: 140d at  Nov 23

Other Resource (time not recorded)

  • Additional effort spent by student systems operations (business lead, senior user) from student records,  and from student analytics insights and modeling (SAIM) teams 
  • Going forward a full time staff from Student Records Operations will be assigned to CSI/Euclid support

Outcome

Year

number of live releases  

2020/21

  30

 
2021/22   40  
2022/23   59  
2023   18  

Releases details are on https://www.jira.is.ed.ac.uk/projects/SAC084?selectedItem=com.atlassian.jira.jira-projects-plugin:release-page&status=released

 

Key Learning Points

What went well:

  1. Having a project for Continuous Improvements that are able to progress unexpected pieces of work is a valuable resource and will continue under CSI project SAC098. This has very positive impact on student/staff experience and receives very positive feedback.  This is evidenced by the number of releases done with very few post live issues reported.
  2. It is also very important to have such continuous service improvements project, which allows the SSP to deal with technical debt and improve the EUCLID service and the security: a project to address some of the remaining legacy work is planned for 2024.
  3. Having improvements  delivered in a flexible and agile way has proved very useful as a compliment to the work on the larger projects, particular when there are gaps between the large projects due to project planning changes, external factors like strikes, Covid, Brexit.
  4. Having a single 'support/Continuous Improvement' project' worked well for Operations to see what is being progressed across SSP all at once/under one roof (one Jira active sprint, one JIRA release board, and daily stand ups, regular retrospective & planning)
  5. Even for small improvement work, the well-documented requirements/business processes are still very important to ensure everyone has the same expectations on the developed solution. 
  6. Collaborative work - pairing BA and Developers is key as support/peer review, to manage single points of failures, as well as working with student systems Operations for implementation and transition to BAU, and the reporting team for BI changes. Daily stand ups /Miro boards help such collaboration, with regular retrospectives and planning sessions.

 

Improvements:

  1. Some of the enhancements were managed as separate sub-projects with their own brief: like online registration annual maintenance, and ESC enhancements. They benefited from the ways of working of the Enhancement project - More sub- projects could have been created  to provide more visibility to stakeholders/project team team as well as facilitating improved handover to IS Production.
  2. Benefit measurements: it takes time to baseline benefits and review the benefit realisation. This was done successfully for some of the enhancements but not all. This is being addressed in the new CSI project (SAC098) where the priorities are based on the benefits being delivered, with the creation of a benefit register with realisation review schedules.
  3. Worth noting this project supported Live issues reported by Operations, and the actual effort covers fixes for live issues- Going forward a separate programme code for SSP Euclid Support will be exclusively used to track the Live support effort, as a well as separate jira Board. Enhancements will be exclusively managed by the new CSI Continuous Service Improvement project (SAC098), and technical legacy work by a separate project in planning SAC102.
  4. Noted that at times it would be beneficial to have a dedicated Production & DevTech staff to work closely with the project team on live issues and technical requirements. May benefit to spread knowledge.
  5. Going forward the new CSI Continuous Service Improvement project (SAC098) will log benefits (baseline, and schedule time for realised benefits). Project progress and achievements will be reported more frequently (quarterly) .
  6. Going forward, live issues will still be reported to SSP, proposal is to manage & prioritise them via its own jira and a weekly stand up involving Operations & IS production.

 

Outstanding Issues

  1. SSO link-The expiry period will be reviewed later to agree a suitable expiry period for each SSO link generation and whether there is real benefit to do it- If so add to pipeline for SSP legacy work (SAC102)
  2. SSO link- the process to regularly change the security key is still outstanding and in the pipeline work for SSP- in the pipeline for SSP legacy work (SAC102)
  3. SRL Syntax: last batches being built and tested as part of the next SITS upgrade regression testing (SAC099), for deployment after the SITS upgrade (Mar/Apr 24)
  4. APT Standard Operating Procedures : all SOP written and handed over but the APT calculation for progression (Operations) & reporting ones (for SAIM)- Managed at programme level 
  5. Current SRE JIRA backlog to be reviewed and issues assigned to either new CSI project SAC098 or Live issues (new Jira board)- Programme Manager action

 

Project Info

Project
Student Record Enhancement
Code
SAC084
Programme
Student Systems Partnership SSP
Management Office
ISG PMO
Project Manager
Franck Bergeret
Project Sponsor
Lizzie Beattie
Current Stage
Close
Status
Closed
Project Classification
Run
Start Date
17-Aug-2020
Planning Date
14-Aug-2020
Delivery Date
31-Aug-2023
Close Date
15-Dec-2023
Programme Priority
3
Overall Priority
Normal
Category
Discretionary