How Adelaide's Digital Archive Problem Grew Into a Crisis: The Story Behind Duplicate Image Replacement

South Australian cultural and government institutions are moving to systematically replace tens of thousands of duplicate digital images embedded across their public-facing platforms, a problem that traces its roots to more than a decade of poorly coordinated digitisation drives that began around 2012. The scale of the remediation work, now being handled across multiple agencies headquartered in and around Adelaide's CBD, reflects how quickly digital infrastructure outpaced the governance frameworks meant to manage it.

The issue matters right now because several flagship projects are converging. Lot Fourteen, the North Terrace innovation precinct that houses the Australian Space Agency and a cluster of defence and data-tech startups, is expanding its digital content operations. Meanwhile, the State Library of South Australia and History Trust of South Australia — both anchored within walking distance of Victoria Square — have been migrating legacy collections to cloud-hosted content management systems. Each migration has surfaced the same underlying problem: hundreds of image files stored in multiple locations, under inconsistent filenames, with conflicting metadata.

How the Duplication Built Up Over Time

The origins are not complicated. Between roughly 2013 and 2020, successive state government departments and cultural bodies digitised physical collections independently, each using different software vendors and different naming conventions. A photograph of the Adelaide Central Market digitised by one agency might sit in three separate repositories under three different file identifiers, none of them linked. When agencies later attempted to build unified public search portals, the duplicate files surfaced as repeated results, broken thumbnails, or conflicting rights metadata.

The Australian Digital Alliance, which tracks intellectual property and access issues across public institutions, has consistently flagged duplicate asset management as one of the costliest inefficiencies in national digitisation programs. Across Australian state institutions, remediation projects have routinely taken 18 to 36 months to complete once formally scoped. South Australia's own Digitisation Policy, last formally updated in 2019 under the Department for Environment and Water, did not include a mandatory deduplication standard — an omission that archivists and records managers at the State Records Office of South Australia have pointed to internally as a gap requiring correction.

Adelaide's growth as a defence and technology hub has sharpened the urgency. The AUKUS submarine program, centred on facilities at Osborne Naval Shipyard in the city's north-western suburbs, has generated significant demand for secure document and image management systems. Private contractors working on defence projects at Osborne have begun requiring that subcontractors meet stricter asset-management standards, including deduplication protocols, before data is exchanged. That commercial pressure is filtering back into the broader Adelaide tech ecosystem, particularly among the companies operating out of Lot Fourteen on North Terrace.

What Remediation Actually Looks Like

In practical terms, duplicate image replacement involves more than simply deleting extra files. Each duplicate must be assessed to determine which version carries the correct rights clearance, the highest resolution, and the most complete descriptive metadata. In collections held by bodies like the Art Gallery of South Australia on North Terrace, a single digitised artwork might have a low-resolution version created for a 2015 web redesign, a mid-resolution version created for a 2018 touring exhibition catalogue, and a high-resolution master created during a 2022 preservation project. Replacing the duplicates means confirming the master, redirecting all existing links, and retiring the redundant files — a process that, for a collection of any size, is labour-intensive.

The State Government allocated funding in the 2025–26 budget toward digital infrastructure modernisation across the cultural portfolio, though the specific line items covering deduplication work are bundled within broader ICT maintenance appropriations rather than listed separately. Technology firms tendering for related contracts through the Department for Industry, Science and Resources have cited per-image processing costs ranging from a few cents for automated hash-matching to several dollars per file where human review is required.

For organisations now beginning this work, archivists recommend starting with a full asset audit before any deletion occurs, and building a single canonical image register linked to persistent identifiers. The State Records Office of South Australia's guidance documents, available through its Leigh Street offices in the CBD, outline a framework for exactly that process. Getting it right the first time, practitioners say, is considerably cheaper than fixing it again five years from now.