Closure Report
Project Summary
This project was opened in Aug 2020 as a multi year project. The initial scope was to address:
- Adaptation and Renewal (ART) work to support students' administrative tasks at start of term
- prioritised compliance requirements and
- prioritised discretionary enhancements raised in the product backlog.
The enhancements should also include the changes being raised by the Tribal software or the technical debts.
The priority is based on benefits to be realised, though there will be a balance between
- the product backlog enhancements delivering high benefit and being discretionary work, and
- the requirements that need to be implemented at certain time of the life cycle (start of term, exam boards...) and for compliance statutory returns purpose (like Hesa change). The compliance work will have to be prioritised over the discretionary enhancements.
This project had 4 objectives when opened in Aug 2020
Objectives |
Deliverables |
Achieved? |
|
|
|
Additional scope was added as follows over 2021/22/23:
1.Jan 2021- New scope emerging to support services (https://secure.projects.ed.ac.uk/unpublished/project/sac084/issues/3)
Ref |
Objectives |
Deliverables & Benefits |
Achieved? |
O1 |
As a result of Brexit, address immigration changes. There are required changes for EU/EEA Students to be able to request a Confirmation of Acceptance to Study (CAS).
|
Benefit achieved: we are able to remain compliant with the Home Office regulations for EU/EEA students post Brexit. |
|
O2 |
Address EU fees change and impact to Irish nationals |
Benefit achieved: EU student experience enhanced: EU fees can be processed as BAU, and the rewritten algorithm can be scaled up with future changes |
|
O3 | Demand from schools on Assessment and Progression Tool (APT) for year average correction and fair assessment changes for students ahead of the summer Boards of Examiners |
Benefit achieved: the issue with the award mark was causing confusion and additional work for Schools during programme boards. The new feature for awarding credit on aggregate significantly reduced the time to perform that action. |
|
O4 |
Address SRA/Widening Participation WP bug
|
D1-Enhance current functionality ahead of start of term for new intake Benefit achieved: the WP contextual admissions checker is working as expected with new enhancements in place for start of term |
D1- Yes
|
O5 | Engage with more schools to help with their course enrolment process change as per efficiency demonstrated during last year start of term |
D1-Enhance support for the Bulk Optional Course Enrolment Service, incl guidance and webpages for users Benefit achieved on Oct 21: We received requests for a total of 1,173 courses, 8,521 students, and 24,718 enrolments between the end of July and the end of October 2021, with 17 Schools using the service during this period. We processed a total of 24,506 enrolments; the remaining records either had already been processed by someone in the School, or we couldn’t process because there was no space on outside courses. We are expecting more requests in November/December for semester 2 enrolments. We are working on an evaluation which will include suggested ways to improve the service in 2022 and would welcome feedback from colleagues on the service. |
D1-Yes |
2. Jan 22- https://secure.projects.ed.ac.uk/unpublished/project/sac084/issues/5
Ref |
Objectives |
Deliverables & Benefits |
Achieved? |
O1 |
APT performance issues ahead of next Board of Examiners: improve assessment and progression performance: |
Benefit achieved:
Link to the news on https://secure.projects.ed.ac.uk/project/sac084/journal/2 |
|
O2 |
Security issue: update Single-Sign-On (SSO) links to follow the Tribal’s best practices recommendation, as a result of a security breach: some of SSO links from 12 institutions have appeared in the searching results using Bings or Google.
|
Follow the Tribal’s best practices recommendation including:
Benefit achieved: risk of security breach reduced |
|
O3 | Legacy work-SRL syntax is being de-supported by the new SITS version and requires to be upgraded |
Benefit achieved: prioritised services have the SITS legacy codes updated, removing the risk of errors for users. It ensures the current syntax remains supported by Tribal . |
|
O4 | Legacy work- solve performance issue with annual batches |
D1- address performance issues for annual batches to manage applicants transfer and continuing students roll over Benefit- reduced impact to Operations and improved student and applicant experience thanks to faster turnaround |
D1- Yes |
3. Aug 22 The decision has been made to keep this project running for another year to support the EUCLID service, deliver enhancements and continuous improvements prioritised https://secure.projects.ed.ac.uk/unpublished/project/sac084/issues/6 . Focus on:
Ref |
Objectives |
Deliverables & Benefits |
Achieved? |
O1 |
EUCLID support during Assessment and Progression Tools (APT) peak period Board of Examiners |
Benefits achieved: more than 37,000 course results released to students with no outages, link to news https://secure.projects.ed.ac.uk/project/sac084/journal/4
|
|
O2 |
Enhance Extensions and Special Circumstances ESC service |
Benefits achieved: Improvements to students' coursework Extensions and Special Circumstances system LINK news |
|
O3 | Support Disability Service |
D1- Enhance student Hub and Student Self Service Benefits achieved: improved staff and student experience |
D1- Yes |
O4 | Continue legacy work as a result SRL report syntax de-supported by new SITS version |
D1-Rewrite remaining SRL syntax Benefit achieved: further services have the SITS legacy codes updated, removing the risk of errors for users |
D1-Yes |
O5 | Meet this year 's SRA Admissions requirements for Widening Participation Contextual Admissions |
D1- Deliver this year changes for the Widening Participation Contextual Admissions, ahead of start of term Benefit achieved: the WP contextual admissions checker is working as expected with new enhancements in place for start of term |
D1-Yes |
O6 | Managed end of life of non supported systems applications (ColdFusion) |
D2 Benefit: new streamline process delivered with improved user interface to upload fees directly from Euclid, removing manual points of failure |
|
O7 | Complete the Assessment & Progression Tool (APT) documentation for Operations |
D1- standard operation procedure (SOP) for APT are written and delivered to student systems Operations Benefit: BA was able to work with Operations on APT issues to share knowledge. Operations can support APT as business as usual |
partial delivery due to conflict |
O8 | Enhance graduation ceremony code range to meet new demand following graduations catch up post Covid |
D1-Graduation Ceremony codes are enhanced, including impacted reports Benefit: Increased number of graduation ceremonies can be run in Euclid, no impact to users |
D1- Yes |
O9 | Address end of life for Make Transition Personal (MTP) student survey |
D1-Support moving from EVASYS to a SharePoint solution for this student survey Benefit: this allows the end of the annual maintenance on EVASYS, reduced licence cost , and the improved interface allows users to request update and new questions to be added to MTP |
D1- Yes |
4. 2023: Focus on Special Circumstances ESC, start of term, Google analytics upgrade
Ref |
Objectives |
Deliverables & Benefits |
Achieved? |
O1 |
Extension and Special Circumstances (ESC) service: address Extra Time Adjustments (ETA)- Enable students with disabilities to be able make full use of their ETA on all relevant assessments |
Benefit achieved: Link to news https://secure.projects.ed.ac.uk/project/sac084/journal/5 |
|
O2 |
ESC Reporting - dashboard development (operational and strategic)
|
Benefit- With the data extracts received from the 2 different databases, an ESC Strategic Reporting Dashboard was created to then enable Heads of Colleges and Services to review the trends in applications for extensions and special circumstances. The reporting is flexible enough to allow review on a school, programme and study level basis. This is the first ESC Reporting Dashboard that has been made available to users. This dashboard also allows tracking the usage of ESC services, which enable changes in the ESC Policy. This will ensure that extensions and special circumstances are used as an appropriate support mechanism. |
|
O3 | Start of term readiness |
Annual maintenance for the 2 services:
Benefit: the 2 services used by students and applicants are enhanced as per new requirements from HESA and DRA ahead of start of term |
|
O4 | Address Google analytics end of life across Euclid, PATH, DRPS, Course Timetable Browser, SRA WP applications |
Benefit: Legacy code addressed |
|
O5 | Investigate rollback for large deployments | D1-deliver new rollback process. It saves DevTech time. | D1-Yes |
Analysis of Resource Usage:
IS Apps resources (includes SSP Dev , Dev Tech, Production, PM) budget vs actual spend total 1708 days (with DevTech 40d, IS Production: 71d, Project Services 113d):
- 20/21: budget 480d, actual spend 447d
- 21/22: budget 315 d, actual spend 477d
- 22/23: budget 537d, actual spend 616 d
- 23/24: budget 100d , actual 168d at Nov 23
SSP BA and Tester resource actual spend total 1675 days:
- 20/21: 586d
- 21/22: 457d
- 22/23: 492d
- 23/24: 140d at Nov 23
Other Resource (time not recorded)
- Additional effort spent by student systems operations (business lead, senior user) from student records, and from student analytics insights and modeling (SAIM) teams
- Going forward a full time staff from Student Records Operations will be assigned to CSI/Euclid support
Outcome
Year |
number of live releases | |
2020/21 |
30 |
|
2021/22 | 40 | |
2022/23 | 59 | |
2023 | 18 |
Releases details are on https://www.jira.is.ed.ac.uk/projects/SAC084?selectedItem=com.atlassian.jira.jira-projects-plugin:release-page&status=released
Key Learning Points
What went well:
- Having a project for Continuous Improvements that are able to progress unexpected pieces of work is a valuable resource and will continue under CSI project SAC098. This has very positive impact on student/staff experience and receives very positive feedback. This is evidenced by the number of releases done with very few post live issues reported.
- It is also very important to have such continuous service improvements project, which allows the SSP to deal with technical debt and improve the EUCLID service and the security: a project to address some of the remaining legacy work is planned for 2024.
- Having improvements delivered in a flexible and agile way has proved very useful as a compliment to the work on the larger projects, particular when there are gaps between the large projects due to project planning changes, external factors like strikes, Covid, Brexit.
- Having a single 'support/Continuous Improvement' project' worked well for Operations to see what is being progressed across SSP all at once/under one roof (one Jira active sprint, one JIRA release board, and daily stand ups, regular retrospective & planning)
- Even for small improvement work, the well-documented requirements/business processes are still very important to ensure everyone has the same expectations on the developed solution.
- Collaborative work - pairing BA and Developers is key as support/peer review, to manage single points of failures, as well as working with student systems Operations for implementation and transition to BAU, and the reporting team for BI changes. Daily stand ups /Miro boards help such collaboration, with regular retrospectives and planning sessions.
Improvements:
- Some of the enhancements were managed as separate sub-projects with their own brief: like online registration annual maintenance, and ESC enhancements. They benefited from the ways of working of the Enhancement project - More sub- projects could have been created to provide more visibility to stakeholders/project team team as well as facilitating improved handover to IS Production.
- Benefit measurements: it takes time to baseline benefits and review the benefit realisation. This was done successfully for some of the enhancements but not all. This is being addressed in the new CSI project (SAC098) where the priorities are based on the benefits being delivered, with the creation of a benefit register with realisation review schedules.
- Worth noting this project supported Live issues reported by Operations, and the actual effort covers fixes for live issues- Going forward a separate programme code for SSP Euclid Support will be exclusively used to track the Live support effort, as a well as separate jira Board. Enhancements will be exclusively managed by the new CSI Continuous Service Improvement project (SAC098), and technical legacy work by a separate project in planning SAC102.
- Noted that at times it would be beneficial to have a dedicated Production & DevTech staff to work closely with the project team on live issues and technical requirements. May benefit to spread knowledge.
- Going forward the new CSI Continuous Service Improvement project (SAC098) will log benefits (baseline, and schedule time for realised benefits). Project progress and achievements will be reported more frequently (quarterly) .
- Going forward, live issues will still be reported to SSP, proposal is to manage & prioritise them via its own jira and a weekly stand up involving Operations & IS production.
Outstanding Issues
- SSO link-The expiry period will be reviewed later to agree a suitable expiry period for each SSO link generation and whether there is real benefit to do it- If so add to pipeline for SSP legacy work (SAC102)
- SSO link- the process to regularly change the security key is still outstanding and in the pipeline work for SSP- in the pipeline for SSP legacy work (SAC102)
- SRL Syntax: last batches being built and tested as part of the next SITS upgrade regression testing (SAC099), for deployment after the SITS upgrade (Mar/Apr 24)
- APT Standard Operating Procedures : all SOP written and handed over but the APT calculation for progression (Operations) & reporting ones (for SAIM)- Managed at programme level
- Current SRE JIRA backlog to be reviewed and issues assigned to either new CSI project SAC098 or Live issues (new Jira board)- Programme Manager action