Unchecked output
Deloitte and the footnotes nobody checked
Deloitte · Professional services · Australia
A A$440,000 review for Australia’s welfare department arrived with invented citations and a fabricated court quote, produced partly with GPT-4o. Deloitte refunded the final instalment. Weeks later a C$1.6 million Canadian health report surfaced with the same flaw.
What the academic found
Up to 20 errors in the first version, including a book attributed to a real law professor that does not exist and an invented quote from a federal court judgment.
The department’s verdict
“The substance of the independent review is retained, and there are no changes to the recommendations.”
The record
- Deloitte agreed to partially refund the A$440,000 (about US$290,000) it was paid for a 237-page review for the Department of Employment and Workplace Relations, after a Sydney University researcher flagged up to 20 errors including fabricated references and a made-up court quote; the revised version disclosed use of Azure OpenAI. (AP, Oct 2025)
- The Finance Department told Senate estimates that Deloitte had refunded A$97,587 — less than a quarter of the contract — and that officials learned of the errors through media reporting. (Australian Greens, Oct 2025)
- A C$1.6 million (C$1,598,485) Deloitte health-workforce plan for Newfoundland and Labrador was found to contain at least four false citations; Deloitte acknowledged the errors but said it stands by its findings. (Canadian HR Reporter, Nov 2025)
A review of automation, partly automated
The irony was hard to miss. Australia’s Department of Employment and Workplace Relations hired Deloitte to review the IT system that automatically penalises welfare recipients who miss their mutual obligations — a sensitive subject in a country still living with the legacy of the Robodebt scandal. The 237-page report, first published in July 2025, was meant to bring careful, independent scrutiny to automated decision-making in government, and the contract was worth about A$440,000 (AP, Oct 2025). Its credibility rested, as such reviews always do, on the quality of its evidence.
Instead it became a case study in unscrutinised automation. Chris Rudge, a researcher at the University of Sydney, found up to 20 errors in the first version: references to academic papers that do not exist, a book wrongly attributed to a real law professor, and an invented quotation from a federal court judgment (AP, Oct 2025). A revised version, quietly posted in late September, removed the false material and added a disclosure that a generative AI tool chain based on Azure OpenAI GPT-4o, hosted in the department’s own environment, had been used in its preparation.
Refunded, not retracted
Deloitte agreed to repay the final instalment of its fee; the department said the substance of the review and its recommendations were unchanged (AP, Oct 2025). Senate estimates later put the refund at A$97,587, less than a quarter of the contract, and Finance officials conceded they had learned of the errors from media reporting rather than from the firm (Australian Greens, Oct 2025). Deloitte said only that the matter had been “resolved directly with the client.” Greens senator Barbara Pocock argued for a full refund; the reputational bill was larger than the financial one.
The timing was awkward. On 6 October — as the refund story broke — Anthropic announced that Claude would be made available to more than 470,000 Deloitte people worldwide, describing it as its largest enterprise deployment, with 15,000 professionals to be certified on the tool (Anthropic, Oct 2025). The firm’s strategic bet on AI was never really in question. What the Canberra episode questioned was something narrower and more fundamental: the controls on what leaves the building under the Deloitte name, and who signs off that every reference in it is real.
Not a one-off
In November, the Newfoundland and Labrador news outlet The Independent reported that a 526-page Deloitte health human resources plan, commissioned by the provincial government for about C$1.6 million to guide a decade of healthcare staffing, contained at least four citations to research that does not exist — some naming real researchers who said they never wrote the papers (Canadian HR Reporter, Nov 2025). Deloitte Canada said AI was “selectively used to support a small number of research citations,” not to write the report, and that it stood by its conclusions. The province’s premier pledged a strict review of AI use (CTV News, Nov 2025).
Two continents, one failure mode. Generative tools are very good at producing plausible-looking references and poor at guaranteeing that those references exist. In most writing that is an irritation. In advisory work for governments, where the citation is effectively the product’s warranty — the evidence that a recommendation rests on something other than the consultant’s say-so — the gap is not cosmetic. It is precisely the thing clients pay a premium to have closed, and it is cheap to close: a junior analyst checking each footnote against its source would have caught every one.
The lesson
When AI drafts client deliverables, verification must be a mandatory, named step: every citation resolved against a real source, every quote matched to its record, and AI use disclosed up front. The cost of checking is trivial next to the cost of a public refund.
How we’re reading this
Both governments say the reports’ findings and recommendations stand; the errors were in sourcing, not necessarily in conclusions. Deloitte did not confirm to AP that the Australian errors were AI-generated, and in Canada said AI was not used to write the report. The A$97,587 figure comes from the Greens’ account of Senate estimates. We are not claiming systemic failure across Deloitte’s work.
Sources
- 01Deloitte to partially refund Australian government for report with apparent AI-generated errors
AP (via Yahoo News) · Oct 7, 2025
- 02Greens slam Deloitte’s unethical behaviour and measly refund over AI report bungle
Australian Greens · Oct 9, 2025
- 03AI errors: Province grapples with Deloitte report marred by false citations
Canadian HR Reporter · Nov 25, 2025
- 04Deloitte will make Claude available to 470,000 people across its global network
Anthropic · Oct 6, 2025
- 05
Compiled from public filings, court records, company statements and reputable press. Figures are attributed to their sources; allegations are labeled as such. Not legal or investment advice.