Adelaide's Duplicate Image Problem: The Key Decisions Now Shaping What Comes Next

South Australia's public sector is sitting on a growing crisis in its digital archives. Duplicate images — redundant photographs, scanned documents, satellite and drone captures stored across multiple platforms — have accumulated across state government departments, local councils and research institutions to a point where storage costs are rising and data integrity is being questioned. The problem is not unique to Adelaide, but the city's rapid expansion into defence contracting, space technology and uranium sector documentation has made it sharper here than almost anywhere else in the country.

The timing matters. Lot Fourteen, the North Terrace innovation precinct that houses the Australian Space Agency's national headquarters alongside defence-tech startups and the SmartSat Cooperative Research Centre, generates substantial volumes of imagery data — from satellite ground-truth captures to facility documentation. At the same time, Olympic Dam near Roxby Downs is mid-way through an environmental and operational documentation push tied to proposed expansion, with BHP required to maintain layered photographic and aerial records for regulatory compliance. Both programs are pulling in the same direction: more images, stored in more places, with less oversight of what already exists.

Why the Backlog Compounds So Fast

Digital storage has been cheap enough for long enough that most organisations simply never bothered culling. A council department photographs a footpath defect in Norwood, uploads it to a field inspection app, emails it to a works supervisor, attaches it to a council management system and backs the whole lot up to a cloud service. By the time the pothole is fixed, four copies of the same image exist across three platforms. Multiply that across the City of Norwood Payneham & St Peters, the City of Adelaide, SA Water, the Department for Infrastructure and Transport and a dozen AUKUS-adjacent defence contractors operating out of the Osborne Naval Shipyard precinct, and the duplication problem becomes structural rather than incidental.

Industry estimates — drawn from comparable public sector audits in New South Wales and Victoria — suggest that between 30 and 45 percent of stored images in large government environments are exact or near-exact duplicates. For organisations paying enterprise cloud storage rates, which commonly run above $25 per terabyte per month for managed services, the financial argument for a deduplication program is straightforward. The governance argument is harder. Deleting a file that turns out to be the only surviving copy of a legally significant record is not a recoverable mistake.

The Decisions That Cannot Be Deferred

Three choices are now pressing on Adelaide's major public institutions. First, who owns the audit? The SA Department for Industry, Science and Resources and the Office of the Chief Information Officer both have jurisdiction over aspects of data governance, but neither has publicly claimed the lead on a whole-of-government image deduplication strategy. Until that is resolved, individual agencies will keep making incompatible local decisions.

Second, what threshold triggers deletion? Automated deduplication tools can identify pixel-identical files with confidence, but near-duplicate detection — where images are similar but not identical — requires human review policies that have not been written yet. For a program like the AUKUS submarine build documentation centred at Osborne, where version control of engineering imagery carries legal weight, getting this wrong has consequences measured in contract liability, not just storage bills.

Third, which records are exempt? State archives legislation already covers some categories, but the intersection with Commonwealth defence secrecy requirements and BHP's environmental licence conditions at Olympic Dam creates a compliance layer that Adelaide's IT managers are not yet fully equipped to navigate alone.

The practical path forward starts with a defined pilot. The City of Adelaide's own digital transformation program, which has been underway since 2023 with a focus on smart city sensor integration, provides a contained environment where a deduplication framework could be tested before scaling to state level. Connecting that pilot's findings to the broader Lot Fourteen data-economy ecosystem — where startups are already working on AI-assisted document classification — would give SA a local commercial dividend from solving a local administrative headache. The window to get ahead of this, before storage contracts renew and archive policies calcify further, is roughly the next two quarters.