Embed Size (px)
Citation preview
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Working with ADQL
Astronomy Data Query Language
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Topcat
Aladin
The problem
Different platforms
Different languages
Different formats
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Topcat
Aladin
Theabstraction
The data
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Database Database
Database Database
Topcat
Aladin
VirtualObservatory
Registry
TAP
TAP
TAP
Data discoveryRegistry
Data accessTable Access Protocol
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
TAP Database Database
TAP
TAP Database Database
Topcat
Aladin
VirtualObservatory
ADQL
ADQL
ADQL
Astronomy Data Query LanguageSELECT … FROM table WHERE …
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
TAP Database Database
TAP
TAP Database Database
Topcat
Aladin
VirtualObservatory
ADQL
ADQL
ADQL
Observation CoreData Model
● who● what● when● where
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Topcat
Aladin
VirtualObservatory
The data
RegistryTable Access Protocol
Astronomy Data Query LanguageObservation Core Data Model
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Topcat
Aladin
TAPDatabase Database
ADQL
Data provider role
Observation CoreData Model
● tables● columns
● name● type● units● UCD
TAP schema
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Topcat
Aladin
Software developer
TCP/IPHTTPREST…
JavaSpringHibernateJDBC…
PythonDjangoFlaskWebPy...
PostgreSQLMySQLSQLServerOracle...
TAPADQL
Database Database
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Topcat
Aladin
IVOA member
Database DatabaseTAP
ADQL
##
AfwfwfFafas Af ju lk
Asf kget hipnd
!?ADQLADQLTAPTAP
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
OFFSET ?
AfwfwfFafas Af ju lk
Asf kget hipnd
!!
ADQLADQL
OFFSET
SELECT ….FROM ….WHERE ….OFFSET n
Initial proposal andgroup discussion
Sometimesthe complicated ones are easy,and sometimesthe simple ones are hard.
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
OFFSET
ADQLADQL
SELECT ….FROM ….WHERE ….OFFSET n
Consensus andupdated specification
Optional featuresvs
range of platforms
What do we do if Oracle doesnot support OFFSET
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Docker containers, providing basic installof each database platform.
A simple platform for experimentingwith ADQL syntax.
https://github.com/ivoa/cosmopterix
GitHub project- contributions welcome
Cosmopterix
Working
● PostgreSQL● MySQL● MariaDB● HSQLDB● Apache Derby● Oracle (*)
Future
● H2● SQLite● SQLServer● Qserv● SpiderEngine● Hadoop
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
A place to share example ADQL and SQL queries.
Initial goals● Provide source material for ADQL parser tests● Provide source material for ADQL query tests
Medium term goals● Provide reference material for science use cases
Long term goal● Future work on validating the BNF grammar
https://github.com/ivoa/lyonetia
GitHub project- contributions welcome
Lyonetia
ADQLADQL
##
AfwfwfFafas Af ju lk
Asf kget hipnd
!?
D.MorrisInstitute for Astronomy,Edinburgh UniversityJune 2016
Public GitHub projects.Make a clone, add your changes and send me a pull request.
Lyonetia – ADQL querieshttps://github.com/ivoa/lyonetia
Open to collaboration
Cosmopterix- Docker containershttps://github.com/ivoa/cosmopterix
ADQL-2.1 working drafthttp://www.ivoa.net/documents/ADQL/20160502/index.html
Dave [email protected]
ADQL document - LaTex sourcehttps://volute.g-vo.org/viewvc/volute/trunk/projects/dal/ADQL/
