Adelaide Leads Australia in Tackling Duplicate Digital Images — But Global Cities Are Still Ahead

Adelaide's major public institutions have been working through a substantial backlog of duplicate digital image files across civic and cultural archives, a problem that has quietly consumed storage budgets and slowed public access to collections at organisations including the State Library of South Australia and History Trust of South Australia. The cleanup effort, accelerating through the first half of 2026, positions Adelaide ahead of most comparable Australian cities — but still trailing purpose-built programs in Amsterdam and Singapore.

The issue matters now because digitisation funding has surged across Australian institutions since 2022, producing enormous image libraries without corresponding investment in deduplication tools. Storage costs are not trivial. Commercial cloud storage for large institutional archives routinely runs into six figures annually, and duplicate files — which in some collections account for between 15 and 40 percent of stored assets, according to digital preservation benchmarking studies published by the Digital Preservation Coalition — erode that budget without adding public value.

What Adelaide Is Actually Doing

At Lot Fourteen on North Terrace, the Australian Space Agency and several resident tech firms have developed internal image-management pipelines partly as a byproduct of satellite imagery work. Those workflows are now being adapted, informally, by at least two cultural institutions on the same precinct. The State Library, located metres away on North Terrace, has been running a phased review of its digitised photographic holdings — a collection that spans more than a century of South Australian history — with staff using open-source perceptual hashing tools to flag probable duplicates before human review confirms deletion.

The City of Adelaide's Smart Cities team, operating out of its King William Street offices, has also been piloting automated duplicate detection across its geographic information system image layers, which accumulate redundant captures during infrastructure surveys of suburbs including Bowden, Prospect and the CBD fringe. A council spokesperson confirmed the pilot in February 2026 but declined to provide completion dates or cost figures at that time. No updated statement was available before publication.

By contrast, the History Trust of South Australia, which holds significant photographic records at the Migration Museum on Kintore Avenue, has publicly acknowledged slower progress, citing staffing constraints rather than any absence of technical capability.

How Amsterdam and Singapore Are Doing It Differently

The gap with leading international programs is instructive. Amsterdam's Stadsarchief — the city's municipal archive — completed a three-year deduplication project in 2024 covering more than 1.2 million digitised images, using a combination of machine-learning classifiers and a dedicated digital archivist team. Singapore's National Archives ran a comparable exercise beginning in 2023, integrating deduplication directly into its ingest pipeline so duplicates are caught before they enter the permanent collection rather than retrospectively.

Both approaches share a feature Adelaide's programs currently lack: mandatory deduplication at point of ingest, funded as a line item rather than treated as a maintenance task. Digital preservation specialists have argued in publications including the Journal of the American Society for Information Science that retrospective deduplication is significantly more expensive per image resolved than prevention-at-ingest — estimates suggest roughly three to five times the cost per file when staff review time is included.

Adelaide's closest peer in Australia is probably Canberra, where the National Archives of Australia has run structured deduplication across born-digital government records since 2021. Brisbane and Melbourne have both announced intentions but have not yet published implementation timelines for their major cultural institution archives.

For anyone managing digital image collections in South Australia — whether at a community organisation, a university, or one of the defence contractors now clustering in the Osborne Naval Shipyard precinct as AUKUS work ramps up — the practical lesson from this city's experience is consistency over sophistication. Institutions that built even basic duplicate-flagging into their 2022 digitisation grants have materially smaller backlogs today than those that did not. The South Australian Government's digital records policy, last updated in 2023, does not currently mandate deduplication standards for funded projects. Whether that changes in the next policy revision cycle, expected sometime in 2027, may determine how quickly Adelaide closes the gap on Amsterdam.