Angus Comrie

Angus is a senior visualisation developer at the Inter-University Institute for Data Intensive Astronomy (IDIA) in Cape Town. He serves as a consulting technical lead on the CARTA project, focusing on research and development of new features and architectural design.


Session

11-04
15:36
12min
A new CARTA controller for scalable deployment across regional centres
Angus Comrie

The Cube Analysis and Rendering Tool for Astronomy (CARTA) is a modern visualisation tool with a client-server architecture, designed to support very large image data sizes.
The current implementation of CARTA allocates a single backend to each user. This works well on the desktop and in simple site deployments, but limits our ability to scale effectively to larger images in a high-performance computing environment, as the backend process can only reside on a single node. Launching a separate backend process per image allows us to distribute computation by allocating processes to multiple nodes, using heuristics based on the image size and available resources. Serving each image from an isolated process also limits the impact of hardware or software failures on individual node.
An extension of this approach would also provide a secure and efficient method for serving files from different locations, such as SKA Regional Centres, allowing users to combine multiple data sources seamlessly in a single frontend environment.
We present an outline of the architecture changes that have been implemented to support this model in a new CARTA controller software package, currently under development.

Building and operating science platforms and workflows in the Petabyte Era
Seminar Room 2