Duplicate Images in Adelaide's Digital Archives: The Key Decisions Ahead

Thousands of duplicate digital images are clogging the archives of Adelaide's major cultural institutions, and the organisations responsible for managing them are now facing hard choices about storage costs, collection integrity, and the tools needed to clean up the mess. The problem is not new, but pressure to resolve it has sharpened considerably in 2026 as cloud storage contracts come up for renewal and state government digitisation funding enters its final year.

The issue matters now because South Australia's cultural sector is mid-stream in one of the most ambitious digitisation pushes in the state's history. Programs tied to the state government's broader innovation agenda — including infrastructure that feeds into Lot Fourteen's tech and space precinct on North Terrace — have accelerated the rate at which photographs, maps, and institutional records are being scanned and uploaded. The faster the intake, the faster duplicates accumulate. Without a clear deduplication policy, institutions risk paying to store multiple copies of the same image indefinitely while also making their collections harder for researchers and the public to navigate.

Where the Problem Is Sharpest

The State Library of South Australia, headquartered on North Terrace, and the History Trust of South Australia, which operates sites including the Migration Museum on Kintore Avenue, are among the institutions grappling most visibly with the challenge. Both have expanded their digital holdings substantially over the past three years, and both rely on metadata standards that were not originally designed to flag near-identical image files — scans taken at slightly different exposures, or photographs uploaded twice under different catalogue entries.

Deduplication in this context is not simply a matter of deleting obvious copies. A photograph scanned at 300 dpi and again at 600 dpi may look identical on screen but serves different archival purposes. An image uploaded under two separate donor accessions may carry different provenance records attached to each file. Deciding which version to keep — and which metadata to merge or discard — requires human judgment, not just automated software. That is where the cost and the controversy sit.

The Australian Library and Information Association has previously noted that unmanaged duplication is among the most common sources of inflated storage expenditure in public collections, though specific figures for South Australian institutions are not publicly available. Commercial cloud storage pricing in Australia currently sits broadly in a range that makes long-term accumulation of redundant files a meaningful budget line for mid-sized cultural organisations. For context, the SA Government's most recent cultural infrastructure budget cycle allocated funding through to the end of the 2025-26 financial year, meaning institutions are now negotiating what comes next without certainty about top-up funding.

The Decisions That Cannot Wait

Three questions will define what happens over the next six to twelve months. First, who has authority to approve deletion? In most public archives, destroying any record — even a genuine duplicate — requires sign-off under the State Records Act 1997, and informal deduplication that bypasses that process creates legal exposure. Second, which software tools will be procured? Several Australian vendors are pitching AI-assisted deduplication platforms to cultural institutions, but procurement decisions of this kind typically take six months or more to clear government tender requirements. Third, will the state government extend digitisation funding beyond the current cycle, or will institutions need to absorb deduplication costs from existing operational budgets?

The practical path forward for Adelaide's institutions likely involves three parallel tracks: commissioning a formal duplicate audit under existing resources, beginning early engagement with the State Records office about streamlined approval pathways for confirmed duplicates, and lodging budget submissions ahead of the 2026-27 state budget — with the mid-year budget review expected in late 2026 offering a secondary window. Institutions that wait for perfect clarity before acting risk arriving at the next funding cycle with the problem substantially larger and the political appetite to fix it substantially smaller.

The images in question are, in many cases, irreplaceable records of South Australian life. Getting the deduplication decisions right matters. Getting them made matters more.