How Adelaide's Digital Archives Ended Up Full of Duplicate Images — and What's Being Done About It

South Australian government agencies and cultural institutions are sitting on digital archives bloated with duplicate images — some files replicated hundreds of times across separate systems — and a coordinated cleanup effort is now underway after years of fragmented storage practices made the problem effectively unmanageable.

The issue matters now because the state's digital infrastructure is carrying more weight than ever. The Lot Fourteen precinct on North Terrace, home to the Australian Space Agency and dozens of tech startups, has added fresh urgency to questions about how South Australian public bodies manage their digital assets. So has the hydrogen jobs plan rollout, which has generated a wave of promotional and technical imagery distributed across multiple departments. When the same photograph exists in six different folders across three agencies, each with a slightly different filename, the downstream costs — in storage, in staff time, in legal compliance — start to compound.

How We Got Here

The roots of the problem trace back to the early 2000s, when South Australian agencies began digitising physical records without any shared taxonomy or central asset management standard. The State Records of South Australia, based on Gepps Cross Road at Gepps Cross, flagged the absence of a unified digital asset management policy as a systemic risk as early as 2009, but budget cycles and departmental siloes meant consistent reform never landed.

By the mid-2010s, the proliferation of smartphones inside government workplaces meant staff were generating and sharing imagery through email chains, shared drives, and eventually cloud platforms, all operating in parallel rather than in concert. The Art Gallery of South Australia on North Terrace, which manages one of the country's most significant digitised art collections, developed its own cataloguing conventions. History Trust of South Australia, headquartered on Kintore Avenue, built separate workflows again. Neither system spoke to the other in any automated way.

The AUKUS submarine program has added a new layer of complexity. Defence-related imagery generated through Naval Group and later AUKUS communications work — much of it produced for public affairs purposes at Osborne Naval Shipyard — has flowed through both federal Defence channels and state government promotional pipelines simultaneously, creating duplicate sets that carry different metadata and, in some cases, different rights clearances.

The Scale of the Problem and What Comes Next

A 2024 audit by the Department for Industry, Science and Resources, cited in budget documentation released in March 2025, found that duplicated digital assets were contributing to unnecessary cloud storage costs running into the hundreds of thousands of dollars annually across SA Health, the Department for Education, and several arts bodies. The audit did not publish a single consolidated figure, but it identified duplicate image files as among the top three contributors to wasted storage expenditure.

Duplicate image replacement — the systematic process of identifying redundant files, selecting a canonical version, updating all references to point to that version, and deleting the rest — is now part of the SA Government's Digital Strategy work program, which is being administered through the Department for Industry, Science and Innovation. The practical work involves both automated detection tools and manual review, particularly for culturally sensitive or historically significant images held by institutions like the South Australian Museum on North Terrace.

For organisations outside government facing the same issue, the practical advice from digital archivists is consistent: start with a hash-based deduplication scan before touching any files, because filename matching alone misses a significant proportion of true duplicates. Establish a single source-of-truth folder structure before deletion begins. And document rights ownership at the point of ingestion, not retrospectively — a lesson the AUKUS communications experience has reinforced the hard way.

The broader cleanup is expected to take until at least mid-2027 to complete across major SA Government agencies. For Lot Fourteen's resident organisations, many of which are less than five years old and have smaller inherited backlogs, the window for getting asset management right from the start is still open — but it is narrowing fast.