2026-11-02 –, Conference Foyer 1
Since the Data Central Archive began with the Anglo Australian Telescope (AAT) Archive in 2020, the archive has become an important service for Australian astronomy. It has since been expanded to include data from the ANU 2.3m telescope at Siding Spring Observatory and an automated reduction pipeline system for the instrument WiFeS. Reduced data for the 2.3m is also available and queryable through the archive.
However as the archive has grown in size to 1.3 million files for the AAT archive, query performance has declined. This poster will present how cone search query times were reduced by up to 95% using GeoJSON indexing in the MongoDB database backend. The poster will also present work on HiPS fibre table visualisations that have been generated from archival data for 2dF instruments on the AAT.
Finally, we will outline planned new additions to the archive: an automated data reduction pipeline for the Veloce instrument on the AAT, and an archive of a monitoring programme of Rubin Deep Drilling Fields using the Australian SKA Pathfinder (ASKAP). We will also describe ongoing work to modernise the backend to support direct API access, improving performance and scalability to facilitate the deployment of additional future archives.
James is a Research Software Engineer with the Research Data and Software team at Australian Astronomical Optics. His main work has been on the Data Central Archive and the underlying infrastructure that supports it including data transfer from telescopes or other sources, ingestion and the web portal for the Archive. He also maintains LENS, the proposal system for the Anglo Australian Telescope and ANU 2.3m at Siding Spring Observatory.