Closure Report

ENT023 – Windows Server 2016 Upgrades

Approvals

Name Role Position Date
Graeme Wood Project Sponsor Head, ITI Enterprise Services (ENT)  
Murray Dippie Senior Supplier Windows Team Leader, ITI ENT 21/02/2020
Bob O’Malley Senior User Service Delivery Manager, USD Operational Services 25/02/2020
Graham Newton Senior User Desktop Services Team Leader, ITI  
Heather Larnach Senior User IS Technology Manager, ISG 25/02/2020
Maurice Franceschi Programme Manager Portfolio Manager, ISG 21/02/2020

Distribution

Name Position
Tony Weir Director, Information Technology Infrastructure
Stefan Kämpf Team Leader, ISG Production Management
Janet Roberts Director, EDINA
David Graham Head, ITI Communication Infrastructure Services
Alasdair Paterson Programme Manager, Core Systems
Alastair Fenemore Chief Information Security Officer
Mark Downey Project Manager, ISG (INF155)

Project Summary

The purpose of this project was to prioritise and migrate the existing Windows Server 2003 and 2008 server estate to Windows Server 2016 prior to the end-of–support date of 14/01/2020 for Windows Server 2008.

Clearly, the upgrading, migration and/or decommissioning of servers was dependent on the application and, to some extent, the layered software products e.g. database, installed on the server being available to run on Windows Server 2016. Several options were possible viz. –

  • Upgrade a server to Windows Server 2016 if the application was available to run on Windows Server 2016
  • Migrate the application to a new server with Windows Server 2016 installed if the application is available for Windows Server 2016 and decommission the existing server
  • Build a new server if a replacement application running on Windows Server 2016 was available
  • Decommission a server if the application was no longer needed

The project scope covered all teams in the University still running Windows Server 2003 or Windows Server 2008 servers. However, support from the ITI ENT Windows team was provided at differing levels dependent on the management profile for each server. Three levels of support were put in place –

  • Group 1 – Direct support in upgrading, migrating and decommissioning servers

    • ITI Enterprise Services
    • USD Operational Services
    • ITI Desktop Services
    • ITI Communications Infrastructure Services
  • Group 2 – Monitoring and support in upgrading, migrating and decommissioning servers identified via the INF137, and subsequently INF155, end-of-life projects
    • ISG Technology Management
    • ISG Applications Directorate
  • Group 3 – Notification and monitoring of risk with support in upgrading, migrating and decommissioning servers, where possible, via Unidesk calls
    • EDINA
    • Digital Library Systems
    • Learning Spaces Technology (LTSTS)
    • Edinburgh University Students’ Association (EUSA)
    • College of Arts, Humanities and Social Sciences (CAHSS)
    • College of Science and Engineering (CSE)
    • College of Medicine and Veterinary Medicine (CMVM)

Objectives/Deliverables

The key objective of the project was to upgrade any existing Windows Server 2003 and Windows Server 2008 servers to Windows Server 2016, and subsequently to Windows Server 2019, which was released during the project. With the bulk of the servers running on VMware (and some Hyper-V) virtual machines (VMs), if a virtual server was to be decommissioned it meant that its resources e.g. CPU, memory, storage, IP address – would be returned to the host pool for reuse.  Any physical server no longer required after a migration was to be earmarked for secure disposal, or recycled, as required.

In addition, an extensive inventory of all Windows servers was maintained throughout the project to help identify and track the remediation of Windows Server 2003 and Windows Server 2008 servers.

Objective Deliverable(s) Priority Achieved

Upgrade or migration all Windows Server 2003 and Windows Server 2008 servers in Group 1 (ENT, CIS, DST, USD), decommission servers as required

  • All Windows Server 2003 servers upgraded, migrated to Windows Server 2016/2019
  • All Windows Server 2008 servers upgraded or migrated to Windows Server 2016/2019
  • Physical servers earmarked for disposal or reuse, as required
  • Virtual server resources reclaimed, as required
1

96%

(127 of 132 servers)
Monitor and support the upgrade or migration of Windows Server 2003 and Windows Server 2008 servers in Group 2 (ISG Tech, ISG Apps), reclaim server resources as required
  • All Windows Server 2003 servers upgraded, migrated to Windows Server 2016/2019
  • All Windows Server 2008 servers upgraded or migrated to Windows Server 2016/2019
  • Virtual server resources reclaimed, as required
1

80%

(121 of 152 servers)
Monitor and support, where possible, the upgrade or migration of Windows Server 2003 and Windows Server 2008 servers in Group 3 (EDINA, Library, EUSA, CAHSS, CSE, CMVM), reclaim server resources, where possible
  • All Windows Server 2008 servers upgraded or migrated to Windows Server 2016
Virtual server resources reclaimed, as required
1

96%

(71 of 74 servers)
Keep the Windows Server 2003/2008 inventory up to date and ultimately identify Windows Server 2008 servers still operating past the Microsoft end-of-support date (14/01/2020) to identify applications at risk Windows Server 2008 inventory managed and updated to identify the servers at risk 2 Yes

At the start of the project, 358 Windows Server 2003 and Windows Server 2008 servers where identified for remediation. By the end of the project, 319 servers (89%) had been upgraded, migrated and/or decommissioned. 3 Windows Server 2003 servers and 36 Windows Server 2008 servers remain to be remediated. These servers will be tracked and remediated as a BAU exercise.

The table below shows the overall server counts by area with the completed server totals and those still to do.

Team Completed To Do Total
CAHSS 48   48
CIS 3 5[1] 8
CMVM 7   7
CSE 7 1 8
DST 19   19
EDINA 3 2 5
ENT 68   68
EUSA 2   2
IS Apps 121 31 152
LIB 3   3
LST 1   1
USD 37   37
Total 319 39 358

[1] Includes 3 WS2003 servers

ITI and ISO management are in the process of purchasing 1-year’s Microsoft extended security update (ESU) cover for University servers still running the Windows Server 2008 operating system.

The charts below show the number of Windows Server 2008 servers still to be remediated by (a) team and (b) application. Appendix 1 lists the Windows Server 2003 and Windows Server 2008 servers still to be remediated.

 

 

 

Project Quality

Project Plan

The original success criteria statement in the project brief was –

“In simple terms, success will be confirmed when there are none of the agreed to be migrated Windows Servers not upgraded to 2016 and running live in an unsupported state by the end of 2020.”

However, the end date for the project was pulled into February 2020, in line with the Microsoft end-of-support date (14/01/2020) for Windows Server 2008.

The project was initiated in January 2017, but planning was not completed until January 2018. During this period, three project managers were responsible, in turn, for the project. The original schedule, baselined in February 2018, forecast a project end date of January 2019 for Group 1 (ENT, CIS, USD, and DST) systems.

However, this work was subject to delays for various reasons including –

  • delays to the Windows 10 migration programme impacted the decommissioning of Windows 7 user profile servers
  • migration of live print servers could only be done during student break periods
  • staff availability in the DST team and delays to the Apps Ed roll out impacted migration and decommissioning of DST supported servers
  • upgrades dependent on application development projects stretched the overall timeline

The table below shows the original planned workstream exit dates against the actual dates achieved. Appendix 2 shows the final project timeline.

Workstream Planned Actual Notes
Complete planning 26/01/2018  26/01/2018   
Decommission Windows Server 2008 Citrix/SCCM servers (DST) 19/06/2018  17/02/2020 Apps Ed dependency
Migrate Windows Server 2008 SCCM servers (DST) 07/08/2018 28/02/2019 Staff availability
Upgrade Windows Server 2008 licence servers (DST) 20/08/2018  19/07/2019 Staff availability
Migrate and decommission Windows Server 2008 print servers (USD) 28/09/2018  30/11/2018 PDS cluster migration delayed to July 2019
Migrate Window 7 profile servers running on Windows Server 2008 (USD) 16/01/2019 17/09/2019 Delays on Windows 10 programme
Migrate, upgrade and decommission Windows Server 2008 system support servers (ENT) 16/01/2019 14/01/2020 Managed as BAU
Migrate, upgrade and decommission Windows Server 2003/Windows Server 2008 system support servers (CIS) 16/01/2020 14/01/2020 Managed as BAU, servers still to be remediated
Monitor and support IS Application team’s Windows Server 2003/Windows Server 2008 upgrades and decommissioning 14/01/2020 14/01/2020 80% complete
Monitor and support Colleges’ and other application teams’ Windows Server 2003/Windows Server 2008 upgrades and decommissioning 14/01/2020 14/01/2020 96% complete
Close project 28/01/2020 28/02/2020  

Project Resourcing

Project resourcing was assigned on the basis that limited time was available for staff assigned to the project. Only Group 1 resources where planned and estimated effort tracked. A maximum of 510 days was estimated for Group 1 (ENT, CIS, USD, and DST) staff and project management to work on the project, when the original forecast was estimated in January 2017. This was reduced to 475 days when project resources were re-planned in January 2018.

A key risk for the project was that planned dates would not be met due to the volume of operational work and work on other projects for these team members. Despite the significant delays to the project and the unavailability of staff at key points, the actual time spent by staff on the project was under the January 2018 forecast. Overall, it is estimated that 406 days was spent on the project. This around 15% below the second forecast. The table below shows estimated resource requirements in January 2018 versus the estimates of actual days spent on the project.

Tasks Team Member(s) Planned Actual Notes
Upgrade, migrate and decommission Windows Server 2008 licence, Citrix, SCCM, etc.  servers (DST)

Graham Newton

Craig Lawlor

Vlad Zirojevic

Mark Wiseman

Murray Dippie

John McFarlane

30.0 35.0  
Migrate and decommission Windows Server 2008 print servers and Window 7 profile servers (USD)

Bob O’Malley

Sajid Ashraf

Mark Skinner

Gareth Phillips

Murray Dippie

John McFarlane

70.0 93.0 Issues with PDS cluster build, test and migration
Migrate, upgrade and decommission Windows Server 2008 system support servers (ENT)

Murray Dippie

John McFarlane

David Morse

Neil Cooper

Fiona Lawson

120.0 85.0  
Migrate, upgrade and decommission Windows Server 2003/Windows Server 2008 system support servers (CIS)

David Graham*

Alan Sloan*

Murray Dippie

John McFarlane

15.0 10.0 * Not included in forecast or actuals
Monitor and support IS Application team’s Windows Server 2003/Windows Server 2008 upgrades and decommissioning

David Watters*

Mark Downey*

Heather Larnach*

Murray Dippie

John McFarlane

Lawrence Stevenson

110.0 90.0 * Not included in forecast or actuals
Monitor and support Colleges’ and other application teams’ Windows Server 2003/Windows Server 2008 upgrades and decommissioning

Murray Dippie

John McFarlane

Lawrence Stevenson

65.0 41.0  
Project Management Lawrence Stevenson 50.0 52.0  
Total   475.0 406.0  

Project Budget

The project was purely resource based and did not require funding. New Windows Server 2016/2019 licences were allocated from the ENT operational budget. New VMs were configured on the existing ENT VMware hosting environments with resources from decommissioned VMs returned to the hosting resource pool. No investment was made for new physical servers or storage within the project scope.

At the end of the project, with 30+ servers still at risk, 1-year’s extended security upgrade (ESU) support was purchased from Microsoft at a cost of approximately £11,300 (including VAT) to cover these servers.

Outstanding Issues

Not all Windows Server 2003/2008 upgrades were completed during the project. The remaining servers will be monitored and upgraded, migrated and/or decommissioned under BAU by the ENT team.

Lessons Learned

The key observations from the project are summarised in the table below –

Observation Description Impact Recommendations
Limited resourcing Project planned with risk that resources might not be available as scheduled Unavailability of resources, particularly in DST meant, that work had to be rescheduled and the  project took longer than planned (-) Ensure aggregate resource planning is  effective and commitment to resource availability is agreed
Key external project dependencies The project was dependent on other projects, such DTP012 (Windows 10 Migration) and DTP001 (Apps Ed), for Windows Server upgrades and decommissioning Delays to these projects had a detrimental effect on scheduled work (-) Ensure planned dates for external projects which are dependencies are realistic and monitored
End-of-support date well in the future In the early stages of the project, upgrades to applications and servers were not seen as urgently required Many server upgrades were delayed near to the end of support date, with a number still in operation past this date (-) Improve communication and alerts, so that upgrades are planned well in advance of the end-of-support date
Effectively managed inventory A detailed inventory of impacted servers was created, and maintained throughout the project The inventory enabled servers at risk to be tracked and overall statistics maintained on progress (+) Similar projects should create and maintain a quality inventory
High Windows Server 2003/2008 remediation rate Nearly 90% of all servers at risk were remediated by the end of the project Significant improvement was made in the process of identifying and remediating impacted servers (+) Continue to use focussed communication methods and inventory management to continue the process for Windows 2012 upgrades

 

Appendix 1 – Windows Server 2003/2008 Servers still to be remediated

 

 

Appendix 2 – Final Project Timeline

 

AttachmentSize
Image icon ws2008_apps_at_risk.gif41.7 KB
Image icon ws2008_servers_at_risk.gif20.78 KB
Image icon list.gif258.83 KB
Image icon plan.gif53.93 KB

Project Info

Project
Windows Server 2016
Code
ENT023
Programme
ITI - Enterprise Services (ENT)
Management Office
ISG PMO
Project Manager
Lawrence Stevenson
Project Sponsor
Graeme Wood
Current Stage
Close
Status
Closed
Project Classification
Run
Start Date
18-Jan-2017
Planning Date
26-Jan-2018
Delivery Date
24-Feb-2020
Close Date
28-Feb-2020
Overall Priority
Normal
Category
Discretionary

Documentation

Close