The Emerging Heliophysics Informatics Infrastructure J. Ireland ADNET Systems, Inc. / NASA-GSFC

The Emerging Heliophysics Informatics

Infrastructure

J. Ireland

ADNET Systems, Inc. / NASA-GSFC

J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA

GSFC

QuickTime™ and a decompressor

are needed to see this picture.

Credit: NASA Scientific Visualization Studio; ENLIL Heliospheric Model; BATS-R-US Magnetospheric Model

Space Weather


GSFC




Space Weather


GSFC

•Connect the physics along the Sun-Earth line.

•Data access - both observations and modeling - is key to progress.

•Tools to examine data - lots of data.

Space Weather


GSFC

Informatics infrastructure

•Informatics: a broad academic field encompassing information science, information technology, algorithms, and social science.

•Infrastructure is the basic physical and organizational structures needed for the operation of a society or enterprise.


GSFC

•Virtual Observatories (archives): simplified access to data from multiple instruments

- Solar: www.virtualsolar.org

- Magnetosphere: vmo.gsfc.nasa.gov

- Heliosphere: vho.gsfc.nasa.gov

- virtual archive for model output: ???

- SOTERIA (SODA): soteria-space.eu

- HELIO: www.helio-vo.eu

- NOAA: www.swpc.noaa.gov

Emerging...


GSFC

•Feature/Event databases

- European Grid of Solar Observations Solar Event catalog: sec.ts.astro.it/sec_ui.php

- Heliophysics Knowledgebase: lmsal.com/hek

- SOTERIA Online Solar Event Catalogue

- NOAA SWPC

- other catalogues at many different locations

Emerging...


GSFC

Locally IDL + Solarsoft + local FITS files = maximum flexibility

• Festival- IDL application

Auchère et al, 2008Sol. Phys., 248, 213

Looking at the heliosphere


GSFC

•www.solarmonitor.org

- Very little of its own content

- Relies on services - images, active region numbers - provided by others.

- Narrowly focused on active regions/flares but it is a useful web application.


Gallagher et al., Sol. Phys, 2002, 209, 171

Over the web


GSFC


Over the web

• SOHO Movie Theater- full disk + coronagraphs- arbitrary time range

http://sohodata.nascom.nasa.gov/cgi-bin/soho_movie_theater


GSFC

Over the web• http://www.lmsal.com/solarsoft/last_events/- active region / flares- near Sun field models- AIA, STEREO, ACE, GOES, Hinode

A space weather web application



GSFC

SOHO images

Mobile


solar monitor / space weather

STEREO data


GSFC

•SDO: > 1.4 TB uncompressed image data /day.

•Model output: many terabytes per run (petaflop/exaflop machines)

•Advanced Technology Solar Telescope: ~ 42 TB / day

•How to let all users examine these data?

Petabytes and beyond


GSFC

JPEG2000 Compression• Split original image

into n x n pixel blocks.• Encode each n x n pixel block using Discrete Wavelet Transform.➡ Spatially localized

• Lossy or lossless encoding.• More complex codec - but more flexible.

Cohen-Daubechies-Feauveau 7/9 wavelet

n x n


GSFC

JPEG2000 Compression

All zoom levels are encoded in one file

Wavelet transform naturally encodes multiple length-scales since wavelets

subsample locally


GSFC

• JPIP = JPEG2000 Interactive Protocol

• JPIP provides a client−server architecture for transmitting JPEG2000 imagery over networks

• Can query arbitrary parts, quality levels of images and movies

• Transfer only needed data

• XML header stores FITS keywords

Remote access to images


GSFC

•JPEG2000 file format

•Back-end: images of solar and heliospheric data in JPEG2000 format served to Helioviewer client applications. Well described API - anyone can use our images.

•Front-end: browse clients that display these images with other meta-data provided by other services.

•Open source (almost completely).

•ESA and NASA funded.

Helioviewer Project


GSFC

User makes request

client

JPEG2000

service

locationtimes data

Tiler

HV

JPIP

JHV

moviesimages

Client / server

Feature / event

service

feature meta data

times catalog


GSFC

QuickTime™ and ampeg4 decompressor


www.helioviewer.org


GSFC

JHelioviewer

QuickTime™ and ampeg4 decompressor



GSFC



examine the data your way


GSFC

Helioviewer Project•Core services solve the problem of

examining large archives of large 2d images from multiple instruments over the web

•Web client: www.helioviewer.org

•Desktop client: www.jhelioviewer.org (release candidate now available)

•More information: www.helioviewer.org/wiki


GSFC

Conclusions

•Data are getting bigger faster.

- transfer of science data still a problem

•Multiple organizational efforts are under way.

•New technology is allowing the creation of new visualization and data access tools.

•Connect solar tools to the rest of the heliosphere

- HELIO (top-down)

- VxO / Helioviewer (bottom-up)


GSFC

Some thoughts from our experience

•Data must be made available to others so that they may build their own applications.

- Separation of the archive from its delivery.

- Well documented service oriented architecture.

- Make easy accessibility to data a standard requirement for all contributors to Space Weather information.

•Shared standards.


GSFC

End


GSFC




Space Weather

Documents

The Emerging Heliophysics Informatics Infrastructure J. Ireland ADNET Systems, Inc. / NASA-GSFC