{"id":9352,"date":"2021-04-26T14:07:54","date_gmt":"2021-04-26T21:07:54","guid":{"rendered":"http:\/\/calleam.com\/WTPF\/?p=9352"},"modified":"2025-12-31T10:58:56","modified_gmt":"2025-12-31T18:58:56","slug":"panorama","status":"publish","type":"post","link":"https:\/\/calleam.com\/WTPF\/?p=9352","title":{"rendered":"Panorama"},"content":{"rendered":"

The following entry is a record in the \u201cCatalogue of Catastrophe<\/a>\u201d \u2013\u00a0a list of failed or troubled projects from around the world.<\/p>\n

\n

Organization: <\/strong>
\nProject type : Integrated Public Health Information System<\/strong>
\nProject name :<\/strong>\u00a0Panorama
\nDate :<\/strong>\u00a0Apr 2020
\nCost :<\/strong>\u00a0$115M<\/p>\n

Synopsis :<\/strong><\/p>\n

Audit reports can be a gold mine of information that reveal\u00a0insights into the status of a project. One such report that caught my eye this week covers an IT system developed in Canada to help identify, manage and track a pandemic (a timely topic given the situation in which the world now finds itself).<\/p>\n

The project in question was initiated by the Canadian government as a follow up to experiences gained from the 2003 SARS (Severe Acute Respiratory Syndrome) outbreak. Although that outbreak was relatively limited in scale, it prompted health officials to\u00a0consider how they would handle a bigger outbreak such as the 1918 Spanish Flu pandemic\u00a0that killed tens of millions of people worldwide.<\/p>\n

\"\"<\/a>
Panorama project timeline – Click to access full audit report<\/figcaption><\/figure>\n

The resulting project was titled \u2018Panorama\u2019 and stemmed from a federal government mandate that sought to create a \u201cseamless public health system that will allow public health professionals to coordinate activities in a carefully planned infrastructure.\u201d\u00a0<\/em>Co-sponsored by the provincial Government in British Columbia (BC) and the federally funded non-profit ‘Canada Health Infoway’ (whose mandate is to help province\u00a0adopt digital health solutions), the plan was to build a system that could be used on a national basis.<\/p>\n

In principle the vision was solid, but in execution the project was plagued with problems. The original 2006 plan called for a number\u00a0of available COTS systems\u00a0(Commercial Off-The-Shelf) to be integrated and adapted. Integrating the requirements of different provinces within the inherent constraints of a\u00a0COTS based approach however proved much more difficult than thought.\u00a0By 2008 the problems were clearly manifest and\u00a0the\u00a0strategy was dropped. Following a reset the project pivoted to a solution based on custom software development.<\/p>\n

At the time the audit report was written 7 years later (2015) the system\u00a0was partially operational, but de-scoped requirements, quality problems and issues launching the product resulted in a system that fell short of its original aims.\u00a0According to the report, key requirements that had been dropped from scope resulted in a system that “cannot be used to manage inter-provincial outbreaks, the main reason for which the system\u00a0was built.”<\/em><\/p>\n

Diving into details the report\u00a0provides an inside view of a project that clearly went off the rails. Some of the comments in report are almost\u00a0laughable (if this wasn’t a system in which the public’s health and wellbeing are at risk). Apparently the system suffered from ‘usability’ issues. To illustrate, the report notes that in places the button labeled ‘save’ didn’t mean ‘save’ instead it meant ‘cancel’. Elsewhere buttons labeled ‘submit’ and ‘cancel’ could mean ‘save’! When launching a complex new system designers need to gain the confidence of the user community and such rudimentary mistakes must have immediately framed unfavourable attitudes towards the new system.<\/p>\n

Elsewhere the report is a little frightening. It appears the system itself\u00a0experienced a ‘pandemic level outbreak’ of bugs and glitches. According to the report, more than 11,000 defects were identified after the system started its rollout. Again to quote the report: “In the end, the accepted system did not meet user needs, and contained thousands of defects. Significant remediation was required along with the identification of more than 320 workarounds to make the system usable.”<\/em><\/p>\n

To conclude the report provides a set of insights into what went wrong (quoted for the report):<\/p>\n

    \n
  1. The initial COTS approach was unrealistic and the project’s complexity was underestimated<\/li>\n
  2. The project lacked a sufficiently experienced or robust leadership team to manage the effort<\/li>\n
  3. Decisions were made without full, unbiased project information and options were not effectively considered or evaluated<\/li>\n
  4. Stakeholders\u00a0had competing priorities that were not effectively reconciled<\/li>\n
  5. Acceptance testing was inadequate and the system was accepted from the vendor prematurely (i.e. before the full scale of the defects was understood).<\/li>\n<\/ol>\n

    Reading between the lines I then also see\u00a0a poorly structured contract with the supplier. The report does note that the vendor was able to transfer risk to the public and was not held accountable for the stratospheric level of quality flaws, but that in turn points to ineffective contract negotiation and \/ or contract administration.<\/p>\n

    For those aspiring to manage large-scale, complex projects the report is recommended reading. A system\u00a0of the type originally envisaged by Panorama is of a level of complexity that is\u00a0not immediately apparent to the untrained eye. It’s not just about writing code and designing database schemas. In fact, the\u00a0software\u00a0side of the project was\u00a0in the grand scheme of things the easy part of the project. As always, the human side is where the challenge lies. In the human side a\u00a0project like this is about unifying work processes, it’s about synchronizing terminology and it’s about gaining consensus across divergent stakeholders. Add to that the challenge of working with technology vendors who can hide behind a contract and the stage is set for problems to fester. All too often those types of challenges go unseen as organization focuses on the physical hardware and software.<\/p>\n

    So of course here we are in 2020 and Panorama’s time in history has arrived. In talking to some in the Canadian health care sector it appears parts of the system are in use, but key components that should have been at the forefront of the battle against Covid-19 are not.<\/p>\n

    Contributing factors as reported in the press:
    \n<\/strong>Lack of stakeholder engagement. Insufficient experience in the project\u2019s leadership structure. Poor strategic choices in the early stage of the project. Poor procurement management practices. Lack of design standards. Quality control issues.<\/p>\n

    Reference links:<\/strong><\/p>\n

      \n
    1. BC Auditor’s report – 2015<\/a><\/li>\n
    2. Health Ministry computer system 420% over budget, five years late<\/a><\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"

      The following entry is a record in the \u201cCatalogue of Catastrophe\u201d \u2013\u00a0a list of failed or troubled projects from around the world. Organization: Project type : Integrated Public Health Information System Project name :\u00a0Panorama Date :\u00a0Apr 2020 Cost :\u00a0$115M Synopsis : Audit reports can be a gold mine of information that reveal\u00a0insights into the status […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[77],"tags":[138,134,97,100,130,129,62,93,147],"class_list":["post-9352","post","type-post","status-publish","format-standard","hentry","category-why-projects-fail","tag-causes-of-failure","tag-decision-making","tag-examples-of-failed-it-project","tag-examples-of-failed-projects","tag-government","tag-failed-project","tag-quality-management","tag-why-do-projects-fail","tag-why-projects-fail"],"_links":{"self":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts\/9352","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9352"}],"version-history":[{"count":32,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts\/9352\/revisions"}],"predecessor-version":[{"id":9774,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts\/9352\/revisions\/9774"}],"wp:attachment":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9352"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9352"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9352"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}