BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//pretalx.adass.org//adass2026//speaker//BYLUZL
BEGIN:VTIMEZONE
TZID:AWST
BEGIN:STANDARD
DTSTART:20000101T000000
RRULE:FREQ=YEARLY;BYMONTH=1;UNTIL=20051231T160000Z
TZNAME:AWST
TZOFFSETFROM:+0800
TZOFFSETTO:+0800
END:STANDARD
BEGIN:STANDARD
DTSTART:20070325T040000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=3
TZNAME:AWST
TZOFFSETFROM:+0900
TZOFFSETTO:+0800
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20071028T030000
RRULE:FREQ=YEARLY;BYDAY=4SU;BYMONTH=10;UNTIL=20081025T190000Z
TZNAME:AWDT
TZOFFSETFROM:+0800
TZOFFSETTO:+0900
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
UID:pretalx-adass2026-P8CRXA@pretalx.adass.org
DTSTART;TZID=AWST:20261104T151200
DTEND;TZID=AWST:20261104T152400
DESCRIPTION:KOA is undergoing an ambitious architectural transformation sch
 eduled for completion in Summer  2027\, intended to support accelerating d
 ata volumes\,  efficient and automated operations\, and new user services 
 to meet the needs of modern analysis. Some components have been discussed 
 at earlier ADASS meetings: this presentation will give an holistic view of
  the architecture\, and the benefits of new technologies in developing it.
 \nAutomated real-time ingestion of newly acquired data is being extended t
 o include a dedicated data transfer node  to support ingestion of large da
 ta volumes  (>100 GB nightly) created by new instruments (LIGER\, SCALES\,
  and HISPEC) under development. They that will propel archive holdings fro
 m 200 TB to 1 PB\, held on-premises at NExScI . At the same time\, managem
 ent of metadata\, creation of database schema - including TAP compliant sc
 hema -  and creation of the database tables themselves have been fully aut
 omated\, with AI support.  The creation and management of user accounts fo
 r Keck Investigators have also been fully automated.  A new interactive da
 shboard-based metrics system will report archive content and usage. \nThe 
 archive services are under active migration to a query infrastructure base
 d on the Open Source "low-code" Plotly-Dash framework widely used in busin
 ess\, augmented with R-tree based indexing and interfacing with a TAP-serv
 er. Altogether\, this new query infrastructure is x20 faster than is the c
 ase now\, and is much more compact and sustainable. It will sit beneath a 
 new landing page.  KOA is participating in an institutional effort to inve
 stigate the value of use Agentic AI in new\, natural language end-user ser
 vices.  Thus far\, KOA has investigated the use of harness engineering in 
 building AI applications and in synthesizing documentation for users: the 
 harness includes  doom loop detection\, a deterministic rule engine and a 
 self-improving verifier training corpus. The harness has proved to take up
  80% of the effort in delivering a prototype LLM interface. \nUnderpinning
  the effort just described are migrations to Red Hat Enterprise and Postgr
 eSQL\,  support for archive security and access controls\, and installatio
 ns of new hardware. These efforts are coordinated at an institutional leve
 l. Given that KOA is operated by a small team\, we will summarize the mana
 gement approach and lessons learned in managing this ambitious enterprise.
DTSTAMP:20261116T153707Z
LOCATION:Conference Foyer 2
SUMMARY:The Keck Observatory Archive Hurtles Towards the 2030s - G.  Bruce 
 Berriman
URL:https://pretalx.adass.org/adass2026/talk/P8CRXA/
END:VEVENT
END:VCALENDAR
