National Center for Supercomputing Applications 259 th fastest computer in the world Michael Remijan NCSA –Research Programmer –Web-based Distributed Programming

National Center for Supercomputing Applications

259th fastest computer in the world

Michael Remijan

• NCSA– Research Programmer– Web-based Distributed Programming– Databases– Java



Applications

Overview

• Cross ID Federation (xid)• ALL-QSO• Astroforge



Cross ID Federation (xid)


Cross ID Federation (xid)Most Surveys have great spatial locations

Problems:

1. Some have poor spatial locations

2. Things look different in different wavelengths (ROSAT)

- 3 optical sources, 2 stars and something else

- Generate better probabilities using astronomy knowledge

- x1 2%,

- x2 20%

- x3 78%



ALL-QSO



ALL-QSO

• Quasars– Historically, difficult to confirm

• Intense observation (spectroscopy) – blue spectrum– Many, many small surveys

• Limited number of objects and data for those objects• Overlap between surveys

• All-QSO– Collect all major surveys into one DB– Searching capability– Semi-intelligent “unique” tool– Cross-match for more information

• Major success at early stages– Several submitted and ongoing paper (APJ)

• QSO variability is correlates with properties in X-ray/radio or IR• Data-mining algorithms to detect new quasars (AISRP Proposals)

– NCSA’s D2K– Condor & Teragrid

• Save expenses for Hubble, Chandra, Spitzer



ALL-QSO

• Further development (AISRP Proposals)– “Unique” object selection

• Only semi-intelligent– Currently: Weighting of general catalog quality– Development: Quality of data

– “Repeat” object selection• Want objects observed several times.

– Major Scientific Tool• Web application robust and load-balanced for high traffic• New types of access

– VO compliance (VOTABLE) – Web Services with Java & Python examples to download– Java desktop GUI (SLOAN)

– Pixelization Schemes (Hierarchical Triangular Mesh)• “What is everything known about QSOs, for all time, at all

wavelengths, in this pixel of the sky?



Astroforgewww.astroforge.net



Astroforge

• Code – Archive

• Hosted on Astroforge

– Library• Link on Astroforge

– Knowledge Center



Astroforge

• Further development (AISRP Proposals)– A lot depends on use

• Feedback from users to make it better

– Web Service access• Create versions & releases

• Upload, edit, delete files

– Searching• More sophisticated searching algorithms

– Webcrawlers• Existing NCSA project

• Identify software out on the web



Thank You

Documents

National Center for Supercomputing Applications 259 th fastest computer in the world Michael Remijan NCSA –Research Programmer –Web-based Distributed Programming