Andreas Wicenec

Andreas Wicenec is one of the oldies at ADASS and has attended most of the conferences in the past. He is currently the director of the Data Intensive Astronomy program of the International Centre for Radio Astronomy Research (ICRAR) delivering software for the SKA and has previously worked at ESO on the ESO and ALMA archives. Trained as an astronomer he has turned most of his attention to data management and high performance computing, while still keeping an eye on his passion, astronomy.


Session

11-03
11:45
15min
Astronomers, unfortunately you need to change your hoarder mentality!
Andreas Wicenec

Astronomers historically, and sometimes for good reasons, tend to keep every bit of data, forever! In some cases to the degree that you'll find a cupboard full of 9-track tapes or even punch-cards, or a locked-down vault full of deteriorating photographic plates with hand-written observer log-books. Even if there would be valuable data on there, it would be extremely hard to get to it, or even just knowing about its existence. Any form of data needs active data management and stewardship to make and keep it findable and accessible. For some of the latest facilities the on-going costs of data management has become a significant fraction of the overall operational costs. On the other hand the value of any data changes over time. Think about yesterday's newspaper. Acknowledging this, the SKA is implementing a Data Lifecycle Management system (DLM) rather than a Data Management system. On the technical side this talk is about that implementation but with a focus on controversial topics like lossy compression and data deletion, informed by a defined life-cycle for every data item in the system.

Global data management and lifecycle in the exascale era
Banquet Hall