Duplicate Images, Real Decisions: What Adelaide's Digital Archive Managers Must Do Next

South Australia's public sector is facing a decision point on duplicate digital image management that has been quietly building for years. Agencies across the state government — from the History Trust of South Australia to the Department for Education — are carrying redundant image libraries that consume server storage, complicate public access requests, and create compliance headaches under the State Records Act 2000. The question now is who pays for the fix, and who decides what gets deleted.

The issue lands at a particularly awkward moment. With SA Labor channelling capital toward big-ticket projects — the AUKUS submarine program anchored at Osborne Naval Shipyard, the Hydrogen Jobs Plan centred on Whyalla, and the Lot Fourteen innovation precinct on North Terrace — discretionary technology budgets for records management have not kept pace with the volume of digital assets state bodies are generating. Duplicate image files are a symptom of that mismatch.

Why the Problem Has Compounded

Cultural and government institutions digitised heavily through the 2010s, often without a unified deduplication protocol. The State Library of South Australia on North Terrace, for example, has been digitising fragile photographic collections for more than a decade. When multiple staff members or contractors process the same collection — a common occurrence during grant-funded digitisation sprints — near-identical image files end up stored separately, sometimes with slightly different file names or metadata tags. The result is storage bloat and retrieval confusion.

Lot Fourteen, which houses the Australian Space Agency headquarters and a growing cluster of data and technology firms, has become a reference point for how South Australia wants to brand itself digitally. That makes the contrast with back-office digital disorder harder to ignore for state IT managers. The precinct opened its first buildings in 2019 and has attracted more than 80 businesses to the site as of mid-2026 — yet the public agencies feeding data into shared government platforms have not standardised image asset management in step with that growth.

The practical stakes are real. Cloud storage costs for large unoptimised image libraries can run into tens of thousands of dollars annually for a mid-sized agency. A 2024 review by the Australian Digital Alliance found that public sector digital collections across Australia collectively held duplication rates between 18 and 35 percent across image asset categories, depending on collection type — figures SA institutions have been benchmarking against internally. Deduplication software licensing, staff retraining, and metadata remediation for a medium-scale government collection typically costs between $80,000 and $200,000, depending on collection size and the degree of manual review required.

The Key Decisions Still to Be Made

Three decisions will define what happens next for Adelaide's public sector institutions. First, the Office of the Chief Information Officer will need to determine whether deduplication is handled agency-by-agency or through a whole-of-government procurement arrangement. A centralised contract would likely reduce per-agency cost but requires cross-agency cooperation that has historically been difficult to coordinate.

Second, institutions like the South Australian Museum on North Terrace and the Art Gallery of South Australia on Kintore Avenue will need to resolve internally whether curatorial staff or IT teams hold authority over image retention decisions. That distinction matters enormously — a curator and a systems administrator will apply different logic when deciding whether two near-identical images of the same object are duplicates or distinct records.

Third, there is the question of public access. The History Trust's collections inform everything from heritage planning decisions in suburbs like Bowden and Port Adelaide to school curriculum resources. If deduplication is handled carelessly and original-quality files are discarded in favour of compressed duplicates, the downstream cost to researchers and educators could outweigh the storage savings.

The most likely near-term outcome is a pilot program, probably launched through one of the North Terrace cultural institutions before the end of 2026, using AI-assisted image comparison tools already being evaluated in other Australian jurisdictions. What that pilot finds — and whether its recommendations are funded — will set the template for every other SA agency facing the same problem.