FORFURTHERINFORMATION

Figure1: ComponentsofDiaMoniCA

ASKAPDiaMoniCA

InfluxDBasanEPICSChannelArchiverThe Australia Square Kilometre Array Pathfinder (ASKAP) Radio Telescopehas been in early science operation with the in-house developed MoniCAdata archiver platform for several years. We are seeking a new web basedplatform to take ASKAP to full capacity. InfluxDB is a highly scalable opensource time series database, designed for high volumes of data at high datarates and as such is a good fit for the requirements of ASKAP and beyond.

MovingArchivedDatatoInfluxDBWe first moved historical data from MoniCA to InfluxDB using an Extract,Transform, Load (ETL) process developed by CSIRO’s Data61 group. Thishas allowed us to examine the performance of InfluxDB with a large dataset from the beginning.

SKA scale distributed control and monitoring systems present challenges in hardware sensor monitoring,archiving, hardware fault detection and fault prediction. Tools are needed which can archive large amounts ofdata while ensuring the data is accessible to users. DiaMoniCA for The Australian SKA Pathfinder RadioTelescope integrates EPICS, our own monitoring archiver MoniCA with an open source time series databaseand web based data visualisation and analytic platforms.

EPICSandOpenSourceDataAnalyticsPlatformsCRHaskins(CASS)

DataVisualisationwithGrafanaWith EPICS monitoring data in InfluxDB, rich webbased open source data visualisation platforms suchas Grafana can now be used in place of EPICS onlysolutions. We become part of a larger user &developer community across a variety of industries.

CSIROASTRONOMYANDSPACESCIENCE

CraigHaskinse Craig.Haskins@csiro.auw www.csiro.au/cass

ControlSystemsStudio(CSS)Integration• AGrafanadynamicdashboardcanbeusedtorenderanymonitoringpoint

withouthavingtomanuallycreateadashboardview.• CSSisconfiguredtolaunchawebbrowserwidgetwiththePVname

embeddedintheURL.• Thedashboard,viaahttplookupservice,buildsthecorrectqueryexpression

forInfluxDBandtheplotisrenderedwithinCSS.

Figure2: GrafanaIntegrationwithControlSystemsStudio(CSS)

Figure5: PVlookupviaGrafanaDynamicDashboard

Real-timeIngestThe next step was to create a MoniCA archiver pluginusing the InfluxDB Java Client library. During thetransition phase, data is archived both to MoniCA andInfluxDB. After a successful trial period, the originalMoniCA archive can be decommissioned.

DataExplorationWith the archival data in an open format, standard dataanalysis tools can be used such as Jupyter Notebookswith Python Pandas.

Figure2: Real-timeIngestUsingaMoniCAArchiverPlugin

Figure3: VisualizingEPICSdatawithOpenSourceGrafanaPlugins

Figure6: GrafanainsideControlSystemsStudio

AlertingWe can also take advantage of services that arebuilt on top of InfluxDB and Grafana such asalerting via Slack.

Figure1: TheDiaMoniCAplatformforASKAP

Figure7: InteractivedataexplorationofEPICSarchivaldatawithPythonPandasFigure4: EPICSPVAlertNotificationsviaSlack