Adelaide Confronts the Duplicate Image Problem Faster Than Most Cities Its Size

Adelaide's public digital holdings have a clutter problem. Across agencies including the State Records of South Australia, the Art Gallery of South Australia on North Terrace, and the growing Lot Fourteen innovation precinct, archivists and IT managers are grappling with an estimated explosion of redundant image files — the same photograph, scan or technical diagram stored dozens of times under different filenames, in different folders, across incompatible systems. Duplicate image proliferation has become one of the more unglamorous but consequential data-management crises of the mid-2020s, and how Adelaide handles it will shape the integrity of its public record for decades.

The urgency is real and specific. South Australia's AUKUS-related defence procurement work — coordinated through the Naval Shipbuilding College at Osborne and feeding into digital documentation chains across multiple federal and state contractors — generates thousands of technical images weekly. Defence industry standards require strict version control, meaning a single duplicated schematic sitting undetected in a shared drive is not just a storage cost; it is a compliance risk. Separately, the Lot Fourteen precinct, home to the Australian Space Agency and a cluster of deep-tech startups, has been expanding its shared cloud infrastructure since 2023, and deduplication protocols were reportedly identified as a gap during an internal review of precinct data governance last financial year.

What Adelaide Is Doing Differently

The State Government's Digital Strategy, active since 2024, includes a data-quality pillar that explicitly names deduplication as a priority for agencies holding visual assets. The Department for Industry, Science and Resources has been piloting perceptual hashing tools — software that detects near-identical images even when file names and metadata differ — across two pilot agencies since late 2025. The pilot is expected to report outcomes to the Chief Digital Officer's office before the end of the 2026 calendar year.

Compare that timeline to Lyon, France, where the Métropole de Lyon's digital heritage program acknowledged a duplicate image backlog across its municipal libraries in a 2025 annual report but has not yet publicly committed to an automated solution. Calgary, which manages a comparably sized civic digital archive, is further along — the City of Calgary's Open Data team published a deduplication policy in March 2026 — but that policy covers structured datasets rather than image files specifically. Adelaide's focus on visual assets, driven partly by the Art Gallery's digitisation of its 45,000-piece collection, gives the city a more targeted framework than either comparable city currently has on paper.

The Art Gallery of South Australia began a systematic digitisation push in 2022, aiming to make its permanent collection fully searchable online. That project, running out of its North Terrace building, has already surfaced the scale of the duplication problem: multiple scans of the same artwork created at different resolutions for different purposes — web display, print reproduction, research access — end up stored separately with no automated link between them. Without deduplication, storage costs compound and catalogue searches return redundant results that erode public trust in the database.

The Cost Equation and What Comes Next

Cloud storage is not free. Amazon Web Services S3 standard storage, widely used by Australian government agencies, costs approximately $0.025 per gigabyte per month as of mid-2026. For an archive holding several hundred terabytes of image data — a realistic figure for a mid-sized state government — redundant files at even a 20 percent duplication rate translate to tens of thousands of dollars in avoidable annual expenditure, before accounting for the staff hours spent managing bloated file systems.

The practical path forward for Adelaide's public agencies involves three steps already recommended in the Digital Strategy framework: completing the perceptual hashing pilot and publishing results, establishing a cross-agency deduplication working group that includes Lot Fourteen tenants and defence contractors at Osborne, and adopting a single canonical image repository standard before the AUKUS work accelerates further from 2027 onward. Organisations holding image archives — whether a startup on Frome Road or a gallery on North Terrace — would be well-served to audit their storage environments now, before the backlog grows too large for any automated tool to efficiently process. The window to get ahead of this is narrowing, and Adelaide, for once, appears to have moved earlier than its peers.