Closure Report

Project Summary

The aim of the project was to provide a “virtual visit” solution that will support the University to enable prospective undergraduate and postgraduate Students to imagine themselves being at the University of Edinburgh, by providing a space and place representation of the University and its environs, showcasing rich media content, which covers all aspects of Student life, including Edinburgh as a city. 

The solution should reassure users that the university is an exciting, friendly, inspiring and safe place to study and live. 

Such a solution is especially important at this time, when access to on-campus visits is restricted and the project has been rated as “Highest Priority” within the  Adaption and Renewal Team (ART) work programme.  

A previous, business-led project acquired and delivered a solution based around software supplied by Revolution Viewing - www.revolutionviewing.com, but this was never released externally due to issues of compliance with accessibility standards.

This project will include work undertaken within the earlier project and deliver an upgraded solution (Version 2) that can be released externally and that can conform to ISG compliance and procurement requirements.  

This was a very time critical project, that had an aggressive timeline to deliver to support the first Student Open Day (originally identified as 31-Oct-2020).   

The solution has been delivered by Revolution Viewing as a hosted solution (SaaS or Software-as-a-Service), with a limited amount of integration with other University applications, managed by Student Recruitment and Admissions (SRA). 

Revolution Viewing had already been engaged to provide the necessary Project Resource and a separate, brief, requirements gathering, plan, design and costing exercise had already taken place.  Therefore, one of the key aims of this project was to normalise it as much as possible, ensure ISG and Procurement involvement where needed, and help ensure delivery to the satisfaction of all interested parties. 

 

Objectives and Deliverables

Ref - O = Objective; D = Deliverable 

Priority – M = Must Have; S = Should Have; C = Could Have; W = Won't Have

  • M = has to be satisfied for the final solution to be acceptable in terms of delivery dates, compliance, viability etc.
  • S = high-priority requirement that should be included if possible -workarounds may be available
  • C = a nice-to-have requirement
  • W = will not be part of this project
Ref. Objectives / Deliverables Priority Achieved?
O1 Enable the University to showcase both itself and its prime position within the city of Edinburgh as an attractive proposition to Students *     
D1 Be visually striking, showing off a more approachable and less corporate side to the University M Yes
D2 Give users a sense of “space and place”, introducing the university’s campuses and highlighting their location across the city (and beyond!) M Yes
D3 Capitalise on the fact that the university is in Edinburgh M Yes
D4 Visually represent the high quality reputation of the University M Yes
D5 Provide more context as to which content is relevant to a particular User, based on their chosen subject (for UG and PG) with the option to get a high-level non-subject specific overview if preferred S Yes
D6 More closely reflect the experience of being on campus offering the ability to chat to Students and take a guided tour around relevant facilities S Yes - Also as an enhanced offering through the iFrame link to Unibuddy
D7 Swap the existing Version 1 Google Map for a more engaging illustrated map M Yes
D8 Offer the flexibility to house, and signpost to, content that is not tied to a physical location (i.e. Covid info etc) S Yes - Provision enhanced through ability to create customised guided tour, or use of the Call to Action (CTA) button.
D9 Seamless integration with other channels by allowing the user to start their Virtual Visit journey from sub-pages, for example, subject intro pages M Yes
D10 Introduce article, gallery and video hotspots to provide more context when exploring 360s, for example, how a space has been made covid secure etc M Yes - Please note that in consultation with the Deputy Secretary Student Experience and the Head of Marketing, a decision was taken not to adapt content to show the Covid-adapted campus. Instead, a global CTA button was used to point to Covid information and an associated content disclaimer. https://www.ed.ac.uk/student-recruitment/about/disclaimers/virtual-visit?utm_source=revolution-viewing&utm_medium=referral&utm_campaign=virtual-tour&utm_content=tier-1-cta There may be value in reviewing this closer to the pre-arrival period, and the CMS gives us the ability to do so if required.
D11 Be a solution aimed at highlighting the best of what the University has to offer and enticing visitors to find out more - this is not a replication of the existing website, rather an enhancement  M Yes
O2 Comply with University Standards, including Accessibility, Content and Security    
D12 Ensure compliance with relevant University policies for example including cookie, footer, banner etc M Yes
D13 Meet IS and CISO standards M

IS Standards were confirmed / agreed by IS Stakeholders involved on the Project.

CISO were not able to give sign off due to the fact that Revolution Viewing were unable to provide feedback to all of the questions that were presented to them by CISO, specifically that Revolution Viewing were unable to source Pen Testing results from a third party (Kinista) that they use for their CMS.   CISO therefore have stated that it is a decision for the Business as to whether to launch.

Therefore the Business have taken the decision to launch, supported by the Senior Supplier, Programme and Project Managers and with the concern raised by InfoSec noted, recommending that the service to look for ways to manage or reduce this risk. For reference the Project did complete / pass a DPIA. 

Risk #4 Achieving Information Security Sign Off managed / tracked this.

D14 Be fully accessible with WCAG 2.1 to AA standard M Yes
D15 Agree / implement a Service Wrapper M Ongoing - Enquiry Management / SRA are the first line of Support for Prospective Students.  Virtual Visit is a SaaS, completely standalone site, that is second line supported by third party Suppliers Revolution Viewing.  IS have also been consulted / informed about Virtual Visits and a Wiki entry has been agreed.  Documentation sets have been created.   The documentation produced / recorded is included into the  new Online and Digital Events Service and SharePoint site, this will continue to be evolved by the Business Analysis with works continuing as part of the Programme.  SRA directly own / manage the relationship with Revolution Viewing.

*Note:  This is of even more importance due to Covid imposed travel and attendance restrictions and can enable potential Students to get a feel for the University, its facilities and its position at the centre of the vibrant City of Edinburgh.

 

Scope

No. Description

Project stayed within scope?

(Yes/No); Reason if not.

  The solution will allow Users to:  
1 Personalise their experience based on their subject or other area of interest (different lists for UG and PG) Yes
2 Be taken on a subject specific guided / thematic  tours covering up to 8 spaces or explore a filtered view of the relevant campus(es) as per the existing map view (but using new base mapping) Yes
3 Watch Youtube, Vimeo or Kaltura videos accessed directly or from 360-degree views / images of University locations (hereafter referred to as 360s) through content spots on a map of the city Yes
4 View image galleries accessed directly or from 360s through content spots Yes
5 Read text articles accessed from 360s through content spots Yes
6 Read high level information about each subject area from a dedicated subject intro page Yes
7 Speak to Students (and Staff?) directly using Unibuddy (DTI055) Yes
  The solution will allow the University to:  
8 Add, edit and delete videos, image galleries and articles through a CMS Yes
9 Edit 360 titles, start positions and content spot positions through a CMS Yes
10 Create subject specific/thematic  guided tours Yes
11 Add, edit and delete map pin categories (Student life, accommodation, academic, city etc) into which content can be added Yes
12 Add, edit and delete subject information Yes
13 Assign content to each subject/category Yes
14 Modify the calls to action Yes
15 Monitor performance using Google Analytics Yes
16 Migrate existing content from the phase 1 solution to the new CMS Yes
17 Bulk upload of content to CMS Yes
  Technically, the solution will be:  
18 Fully responsive, gracefully scaling on devices as small as 320px wide and as large as 1920px wide Yes
19 Embeddable in other web pages using an iframe Yes
20 Deep linked down to the level of 360 content spots Yes
21 Compliant with WCAG 2.1 to AA standard unless otherwise agreed and stated in the accessibility statement.  In situations where compliance relies on the University of Edinburgh to do something, for example, populating alt tags on non-decorative images, the Supplier will ensure the solution has the capability to meet compliance but Revolution Viewing are not responsible for actually ensuring compliance is met for all content. Yes
22 Built in accordance with our standard browser policy Yes
23 Built using HTML, CSS and Javascript. The CMS will be powered by Wordpress Yes
24 Hosted, supported and maintained by Revolution Viewing Yes

 

Out of scope

The following were discussed between SRA and Revolution Viewing but agreed to push to future works / phases:

  • Integration with a live events system - given the University is in the process of procuring an events platform and the tight delivery required for the initial launch of this product, it was agreed that we would park an integration until a future phase but this is a key long term goal. Therefore, the solution should be designed with this future ambition in mind

  • Creating a “Student voice” on the platform is something that Edinburgh would like to develop in the future, perhaps with each subject having an associated student ambassador etc.

 

Benefits

No. Benefit Achieved?
1

Provide and enable both potential new and current first year Students with an enhanced User experience, with rich video, media and content, that will allow them to take a virtual tour of the University without needing, or potentially being able to physically attend

Yes
2

Provide Students with reassurance that Edinburgh is a vibrant, safe, world class University to conduct their studies

Yes
3 Enable SRA to showcase the University to potential Students by placing them within context within the city of Edinburgh Yes
4 Support Student recruitment activities, such as virtual open days Yes

 

Success Criteria

No. Success Criteria Achieved?
1 Provide an application that will support SRA in their delivery of high quality Open Day replacement activity during cycle 2020/21 Yes
2 Provide a longer term student recruitment tool, with effectiveness assessed by Google Analytics (reach) and user surveys (satisfaction) Yes
3

Fulfill stated purpose to excite, reassure and prepare, assessed via sentiment-based survey questions

Yes

 

Analysis of Resource Usage:

Staff Usage Estimate: 50 days

Staff Usage Actual: 39 days

 

Outcome

The Project was delivered and launched successfully meeting its objectives. 

The entire Project Team with the support from key individuals, such as the Disability Information and Data Protection Officers, put in a tremendous amount of effort to achieve success and while also preparing for and during the start of the new academic year.  The Project Sponsor has provided the following feedback: "I am really proud of the output, as I think the Virtual Visit is a really welcome addition to our recruitment toolkit and to the University’s web estate. It’s nicely designed, accessible, dynamic and provides a locus for rich media content, some of which pre-existed but was under-exploited elsewhere on the website. It’s also a channel for student voice that I think could be further developed going forward. The integration with Unibuddy is an important step towards the vision for a suite of recruitment tools that work in concert to provide high quality digital experiences, not just as a crucial element of Covid mitigation but as part of a longer term strategy to increase our audience reach and improve our accessibility through hybrid delivery. I’d love to see further investment in future to integrate with live events".

 

Key Learning Points

Ref: Description
1

Time and effort would have been saved if the project had been adopted by ISG sooner. 

Also once adopted by ISG the amount of IS effort to turn project around was underestimated.  Consequently the project didn't get the focus it needed in the early days, this was called out early by both the PM and BA and was rectified once resource was available to be allocated, however this did lead to an inordinate amount of work / coordination to get everything lined up that could have otherwise been allayed. 

The Project Sponsor / Team agree wholeheartedly that the project would have been easier if it had been under IS oversight from the start. 

2

It would have been better had the project been either totally inside ISG or totally outside, bringing it in after it had started was the most difficult option. 

SRA had tried to drive this previously and ultimately failed to get it over the line.   

The Project Sponsor, Clare Mackay, reflected the following points / learnings from this:

  • The IS support, when it came in the form of dedicated project support was outstanding. Very grateful to Chris Lawford, for getting us started and I think he was absolutely right to call out early on that the workload wasn’t compatible with the Large Events project. Can't thank Richard Bailey enough for taking the reins and for doing such an excellent job of the project management. Emma McNab has been fantastic in providing support across the three projects I’ve been involved in, and it’s also important to acknowledge SEP’s input in the form of Michele Holubek.  While circumstances meant that Michele was unable to give all of the support she wanted to, her contribution was extremely valuable.
  • Without dedicated support, it is very difficult for business units to navigate the many requirements that form part of our internal processes, and in some cases our legal obligations – including but not limited to procurement, legal, information security, data protection, accessibility, EdGel, UX, service management etc. One of the difficulties is that it is hard to understand what is mandatory and what is discretionary, and accordingly who has ownership of decisions and who is simply advising.
  • The complexity outlined above is a double-edge sword. On the one hand, I feel confident in the standard set in relation to compliance in particular. On the other, at times the rigor felt slightly disproportionate to the size of the project. This slowed us down and, without the support we ultimately secured, may have proved a barrier to completion.
  • Based on this it is recommended that IS consider a toolkit approach, where mandatories and good practice considerations are clearly laid out in the form of a checklist with supplementary guidance and key contacts would assist in future. 

It is recognised that SRA working both with Communication and Marketing (CAM), as well as IS, through a Programme Manager to help identify and assist with Business Requirements could benefit going forward to ensure a holistic strategy. 

3

Linked to the points in section 2 above and the 'one size fits all approach of Governance', the Project Sponsor has suggested that it would be beneficial / that we need to have an eye to our reputation as a client. 

Revolution Viewing expressed frustration retro fitting some of the ISG Governance with us on numerous occasions.  It is noted that this was compounded by the fact that as IS were not initially involved, it had not been specified / agreed with the supplier at the outset of the project when the original agreements were made.  While some of the issues were supplier side, and indicative that some of their services had not reached full maturity, it is recognised that the supplier works with multiple universities, and it was expressed that UoE are considered among their most demanding clients.  The Project did however manage to maintain a productive relationship with Revolution Viewing through deploying Sponsor and PM roles selectively to manage that relationship.

4

Engagement from all Project Team Members once the Project received the required focus was exceptional, to reiterate the entire Project Team with the support from key individuals, such as the Disability Information and Data Protection Officers, put in a tremendous amount of effort to achieve success and while also preparing for and during the start of the new academic year. 

Feedback on the Project Team of note included:

  • The Sponsor was a pleasure to work with and has been extremely supportive and professional throughout the project. 
  • Both Project Managers played a key role in the success of the project, picking it up quickly and managed the challenges extremely professionally.
  • The SEP Business Analyst was so enthusiastic and supportive of the project too which just made the whole project enjoyable to be part of. 
  • There was a really good team spirit throughout this project across the core team which is especially good to see during these challenging times when many of us have never met each other before.
  • The SRA team worked incredibly hard.
  • The Postgraduate and Undergraduate Recruitment Managers, supported by the Communications Officer, achieved a monumental amount with the content piece and putting together the supporting information / pages and their effort to achieve the results against aggressive time frames is noted.
  • Despite the fact that the Disability Information and Data Protection Officers were clearly very busy, it is noted that they went out of their way to provide support and guidance in relation to EqIA and DPIA (both achieved).
5

It was agreed that from both a Stakeholder and Project Team perspective for future SRA Projects that post requirements gathering, SRA would look at streamlining their representation, as it is not as efficient to have so many people involved. 

It was felt that there was at times a 'design by committee approach', in particular with items such as the illustrative map at the sites core.  Whilst there are advantages to getting a lot of view points, things are slowed down by lots of opinions, especially differing ones.  Earlier / more effective management to drive quick decision making would have helped  mitigate this.  

6

The early identification of certain key dependencies for the Project, such as the illustrative map and the work required to create, amend and publish the content, would have relieved impact / stress on resource during the project and reduced the overall risk to delivery. 

Project Team references include:

Illustrative Map:

  • This took too long and put timescales at jeopardy, although it looks great, had the project identified it as a key dependency earlier measures / controls could have been put in place to get it completed sooner.  These controls could have included:

    • A formal agreement / contract with clear dates, even potential penalities for non-completion, with the illustrator.
    • Ensuring that Stakeholder / Project Team feedback is provided against any key dependency in a concise and clear manner, again setting hard deadlines for feedback to the illustrator.
    • The Stakeholder / Project Team should understood consequences to providing further, or changed requirements to the illustrator and these require management.
    • It is noted that much of the requirements works took place while high numbers of the Project Team / Stakeholders were on annual leave and this should have been planned / factored in (as with all key dependencies), this could have been mitigated by the use of delegation of responsibility.

It should also be noted that the illustrator did an amazing job on the final maps produced, the end result is fantastic and it is great to be able to say it was produced by one of our Illustration graduates.

Content Creation:

  • Schools’ capacity to engage was another risk, given the size of the content task. In the end this was successfully mitigated by taking a validation versus creation approach, where SRA added content to the site and asked Schools for feedback on the content in place, rather than to create outright.  This also had an advantage in creating a consistent 'tone' / approach to content across the site.
7 Getting the right support at the right time, this at points was challenging given the number of different teams advice / guidance / support was needed from.  This was of course in part to the impact of Covid 19 on resource and availability but did take up quite a bit of PM time to get things done.
8

There were concerns that the project had leapfrogged planning phases in terms of identifying goals and success criteria, and framing the solution within the wider user journey.

In principle, the Project Team agrees on the importance of these foundations.  It is recognised that the very early work in SRA was undermined by too many points of view and the absence of a shared vision. However, by the time the project had evolved to where it was when IS picked it up, the vision had crystalised and felt confident in its aims (as set out in the Content Guidance). 

Therefore, without an adequate upfront time frame in this particular circumstance, it could have been an unnecessary delay, against time frames to support the virtual open days, to do too much work around goals and journey mapping. However, SRA would very much welcome the opportunity for future work with Web Content, Communications and Marketing to determine how they can optimally develop the Virtual Visit as it relates to the wider website.  This is being reflected / addressed in the definition of the ongoing BAU Content Creation / Amendment Process (see item 1 in 'Outstanding Issues' below).

9

Feedback from the Disability Information Officer (Viki Galt) was that some time could have been saved if accessibility had been considered from the start (before they prepared their first version).  Viki did concede that she understood that these are crazy times and things had to happen fast.  Viki also reflected that "It has been a good learning experience for me that some companies really are prepared to go the extra mile to make their products accessible as requested rather than just saying “it can’t be done”".

10

The Desktop Services needed to add virtualvisits.ed.ac.uk to the DirectAccess exclusion list so it is accessible on managed Windows desktop machines without the VPN.

It would be advisable that any Project that is adding a .ed.ac.uk URL for an externally hosted service should check / look to make sure that it is added to the exclusion list.

For information:

It is only University-managed Windows 10 laptops that have DirectAcess enabled (please see https://www.ed.ac.uk/information-services/computing/desktop-personal/supported/windows-10/what-is-directaccess-and-how-do-we-use-it for info on what DA does on Uni laptops). Essentially, it acts like a small, automatically-connected VPN service that allows particular Uni services to connect without requiring any further authentication, but it can block other services it doesn't know about if they are not whitelisted.

The exclusions are added by the Desktop Services team, so, if you have set up a URL / app in future and find that some colleagues on Uni Windows laptops can't access it, it would be a case of contact the IS Helpline for the attention of Desktop Services to look at having it added.

 

Outstanding Issues

Ref: Description
1

Business As Usual (BAU) Content Creation / Amendment Process. 

The Project Sponsor has looked to retain the SEP Business Analyst who is working with SRA / CAM in order to help deliver a BAU content creation / edit / amend process.  This will be critical in designing a sustainable approach for maximising the impact of this tool in the context of staffing pressures among core teams and distributed content contributors.  It would be a shame if a lack of resource (human and financial) were to impede future development of the Virtual Visit as a key recruitment tool and element of our recruitment-facing web estate.

It is noted that the BAU process is not part of the Projects objectives but was recognised that assistance was required.

 

 

Project Info

Project
Virtual Visits
Code
DTI056
Programme
Digital Transformation - Online and Digital Events Programme (DTIODE)
Management Office
ISG PMO
Project Manager
Richard Bailey
Project Sponsor
Clare Mackay
Current Stage
Close
Status
Closed
Project Classification
Transform
Start Date
09-Jul-2020
Planning Date
18-Sep-2020
Delivery Date
26-Oct-2020
Close Date
04-Dec-2020
Overall Priority
Highest
Category
Discretionary

Documentation

Close