Adelaide Leads Australian Cities in Tackling Duplicate Image Sprawl — But Global Rivals Are Moving Faster

Adelaide's cultural and government institutions are consolidating their digital image libraries at a faster clip than most Australian capital cities, but they still trail comparable mid-sized cities in Europe and North America where automated duplicate-detection tools have been standard infrastructure for several years. That gap is narrowing, but the work is uneven across the city's public sector.

The push matters now because storage costs for large public institutions have climbed sharply since 2023, and the proliferation of high-resolution imagery — from drone surveys of Port Adelaide's waterfront redevelopment to documentation of projects at the Lot Fourteen innovation precinct on North Terrace — has left archives bloated with redundant files. Across Australian state governments, the Australian Digital Health Agency estimated in its 2025 digital asset report that duplicate or near-duplicate image files account for between 18 and 24 per cent of total unstructured storage consumption in large public-sector environments. Unmanaged, that represents real budget pressure.

What Adelaide Is Actually Doing

The State Records of South Australia, based on Leigh Street in the CBD, has been running a deduplication program across its digitised photographic holdings since late 2024. The program uses perceptual hashing — a technique that detects visually similar images even when file names or metadata differ — across a collection that spans more than 80 years of government photography. The Library Board of South Australia, which oversees the State Library on North Terrace, launched a parallel audit of its Pictorial Collection in February 2025, targeting a backlog estimated internally at several hundred thousand scanned items.

Lot Fourteen tenants, including the Australian Space Agency and several defence-tech startups operating out of the old Royal Adelaide Hospital site, generate their own high-volume imagery through satellite data processing and site documentation. The precinct's shared IT services framework includes a storage-optimisation layer, though individual organisations manage deduplication independently rather than through a precinct-wide standard.

The City of Adelaide council, which covers the CBD and North Adelaide, has also been working through its asset management photography — images of streetscapes, infrastructure and public spaces accumulated over decades — as part of a broader digital transformation project tied to its 2024-2028 Smart City Strategy.

How That Compares Globally

Cities of comparable size and institutional complexity tell a different story. Rotterdam, with a metropolitan population roughly equivalent to Greater Adelaide's 1.4 million, completed a government-wide image deduplication and re-indexing project across its municipal archive in 2023, cutting storage consumption in its public digital repository by 31 per cent, according to the municipality's published annual infrastructure report. Calgary, population 1.3 million, embedded automated duplicate detection into its open-data portal as early as 2021 as part of a cloud migration project under its Digital Strategy.

Adelaide's comparable programs have moved more slowly in part because responsibility is fragmented across the state government, local council and individual institutions, rather than coordinated through a single digital infrastructure body. There is no South Australian equivalent to Victoria's Whole of Victorian Government Cloud and Digital Policy, which sets minimum standards for asset deduplication across state agencies.

That fragmentation has a dollar cost. Cloud storage pricing for Australian government entities on the AWS Asia Pacific (Sydney) region runs at roughly $0.025 per gigabyte per month for standard-tier object storage, meaning even a modest 50-terabyte reduction in duplicate imagery across SA government systems would represent savings of around $15,000 annually — modest on its own, but multiplied across dozens of agencies and compounded over years, the numbers become significant.

For institutions and businesses watching this space, the practical advice from digital archivists is consistent: run a perceptual hash audit before any major cloud migration, not after. The cost of cleaning up duplicates rises sharply once data has been moved to paid cloud storage. South Australian organisations considering migrations in the second half of 2026 — particularly those tied to the expanding defence industry cluster in the Osborne Naval Shipyard precinct or the Olympic Dam uranium operations documentation pipeline — would be well-placed to prioritise this step now, rather than carry the overhead forward.