{"id":9720,"date":"2026-01-01T12:52:47","date_gmt":"2026-01-01T20:52:47","guid":{"rendered":"https:\/\/calleam.com\/WTPF\/?p=9720"},"modified":"2026-01-21T15:52:09","modified_gmt":"2026-01-21T23:52:09","slug":"charlie-the-cra-chatbot","status":"publish","type":"post","link":"https:\/\/calleam.com\/WTPF\/?p=9720","title":{"rendered":"Charlie the CRA ChatBot"},"content":{"rendered":"\n<p>The following entry is a record in the \u201cCatalogue of Catastrophe\u201d \u2013 a list of failed and troubled projects from around the world.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<!--more-->\n\n\n\n<p><strong class=\"\">Organization: Canada Revenue Agency (CRA)<\/strong><br><strong class=\"\">Project type:<\/strong>&nbsp;Digital service \/ AI chatbot<br><strong>Project Name: <\/strong>Charlie the Chatbot<br><strong class=\"\">Date:<\/strong>&nbsp;2020\u20132025<br><strong class=\"\">Cost:<\/strong>&nbsp;$18 million+<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Synopsis<\/h3>\n\n\n\n<p>Charlie the Chatbot was originally launched by the Canada Revenue Agency (CRA) in 2020. It&#8217;s goal was to help Canadians navigate the country\u2019s complex tax system and reduce demand on the already overburdened call centers. Promoted as a modern, digital solution, Charlie was intended to answer general tax questions, improve service access, and alleviate pressure on human staff.  <\/p>\n\n\n\n<p>In 2020 Charlie was ahead of the curve. Although chatbot tools had existed for a number of years, the more mature Artificial Intelligence (AI) generative tools (such as ChatGPT) only became readily available starting in 2022. In response to those advances Charlie was upgraded in 2024 to a generative AI system so that it could respond to more complex questions.<\/p>\n\n\n\n<p>A 2025 audit by Canada&#8217;s Auditor General examined the ability of the CRA to manage tax questions from the public. The report indicated that tests on Charlie gave incorrect answers&nbsp;<strong class=\"\">66% of the time<\/strong>. At the same time wait times to speak to a real agent averaged a little over&nbsp;<strong class=\"\">30 minutes<\/strong> (far exceeding the agency\u2019s service standard). The report indicates that pre-release testing for the more advanced version (2024) was attaining 90% accuracy, but at the time of the audit those figures were unverified in real world operations.<\/p>\n\n\n\n<p>Over its first 5 years of life building and operating Charlie has cost taxpayers $18 million. <\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Contributing factors as reported in the press<\/h3>\n\n\n\n<p>Use of immature technology in an inherently complex environment. Lack of effective quality control or operational governance. Failure to curate source data effectively before utilizing that data to power the chatbot.<\/p>\n\n\n\n<p>Reference Links<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.msn.com\/en-ca\/technology\/general\/the-cra-spent-18m-on-charlie-a-new-tax-information-chatbot-that-is-wrong-most-of-the-time\/ar-AA1Sd7Rg\" target=\"_blank\" rel=\"noreferrer noopener\">The CRA spent $18M on Charlie, a new tax information chatbot that is wrong most of the time \u2013 National Post<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.oag-bvg.gc.ca\/internet\/docs\/parl_oag_202510_01_e.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Auditor General of Canada &#8211; 2025 Contact centers report<\/a><\/li>\n<\/ul>\n\n\n\n<p>Margot Jantz<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The following entry is a record in the \u201cCatalogue of Catastrophe\u201d \u2013 a list of failed and troubled projects from around the world.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,3,77],"tags":[97,100,62,93,147],"class_list":["post-9720","post","type-post","status-publish","format-standard","hentry","category-government","category-failed-project","category-why-projects-fail","tag-examples-of-failed-it-project","tag-examples-of-failed-projects","tag-quality-management","tag-why-do-projects-fail","tag-why-projects-fail"],"_links":{"self":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts\/9720","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9720"}],"version-history":[{"count":26,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts\/9720\/revisions"}],"predecessor-version":[{"id":9957,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=\/wp\/v2\/posts\/9720\/revisions\/9957"}],"wp:attachment":[{"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9720"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9720"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/calleam.com\/WTPF\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9720"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}