22
Page 1 Status of HDF-EOS, Status of HDF-EOS, Related Software, and Tools Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009

Status of HDF-EOS, Related Software, and Tools

Embed Size (px)

DESCRIPTION

HDF-EOS is a software library designed to support NASA Earth Observing System (EOS) science data, built on top of HDF (Hierarchical Data Format) developed by The HDF Group. Current status of HDF-EOS and access tools will be summarized and updates on TOOLKIT, HDFView plug-in and the HDF-EOS to GeoTIFF (HEG) conversion tool, including recent changes to the software, ongoing maintenance, upcoming releases, and issues will be discussed.

Citation preview

  • 1. Status of HDF-EOS,Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009 Page 1

2. TOOLKIT / HDF-EOS Support Maintenance support is funded on EMD to EED Bridge (EEB) contract through Dec 2010Support will continue with EOSDIS Evolution & Development (EED) award in 2010Current support (One full-time developer) : HDF-EOS2 & 5 SDP/MTD Toolkit HDF-EOS plug-in for HDFView HDF-EOS2 to GeoTIFF Converter (HEG) Other Toolkit/HDF-EOS related software Toolkit/HDF-EOS/HEG helpdesk Related web sites maintenancePage 2 3. ECS Support of HDF-EOS Both HDF4 and HDF5 based flavors of HDF-EOS are part of ECS baseline. OSs: Solaris (9, 10), Linux ( 32 and 64-bit ), Mac OS X (Power PC and Mac Intel), Windows XP (MTD Toolkit, HDF-EOS2 & 5, HEG, HDFView) Added full Cygwin support in July 2009 release Compilers: Fortran 77/90 & g77/pgf90 , C, C++, gcc, g++, gfortran (Mac Intel)Page 3 4. Downloadable Software SDP/MTD Toolkit (Science Data Processing Tools) HDF-EOS2 (HDF4 based) HDF-EOS5 (HDF5 based) heconvert (converts HDF4 - based Grid/Point/Swath structures to HDF-EOS 5 equivalents) Page 4 5. Downloadable Applications HEG - GeoTIFF conversion - Spatial subsetting, Field Subsetting - reprojection - stitching, sub-sampling and more . HDFView Plug-in, Java-based browser Plug-in (HDF4, HDF5, HDF-EOS 2 and 5 access) HE5View* (HDF5 - based browser) HE5View EOSView* (HDF4 - based browser) EOSView * Dropped support for OS updates on July 2006 Page 5 6. Software/Tools in detail What are: TOOLKIT, HDF-EOS ?Page 6 7. Toolkit Science Data Production (SDP) Toolkit : collection of tools used by - Science software developers who produce code to process instrument data. - HDF-EOS users who need to Access metadata in HDF-EOS files Perform Time/Date conversion Access Digital Elevation Model Data Access Ancillary Data, such as Digital Chart of the World database (DCW), Olson World Ecosystem files, DEM data files, etc. Page 7 8. Toolkit (cont.) Tools provided in SDP Toolkit: -AA CBP CSC CUC DEM EPH GCT IO MEM MET PC SMF TD(Ancillary Data Access) (CELESTIAL Body Position) (Coordinate System Conversion) (Constant and Unit Conversions) (Digital Elevation Model Access) (Ephemeris Data Access) (Geo Coordinate Transformation) (Input Output (File I/O)) (Memory Management) (Metadata Access) (Process Control) (Status Message File (Error/Status)) (Time and Date Conversion) Page 8 9. Toolkit (cont.)Tools provided in MTD Toolkit: - MET - TD(Metadata Access) (Time and Date Conversion)Page 9 10. HDF-EOS HDF-EOS is an extension to HDF whichstandardizes storage of and access to common Earth Sciences data structures By providing a single interface to data structures common to earth science By providing a container for EOS inventory, archive and product specific metadata By establishing a consistent relationship between geolocation and science data.Page 10 11. HDF-EOS 2 HDF4 - based, storage format for EOS standard products. Used operationally by MODIS, MISR, ASTER, Landsat, AIRS and other EOS instruments Support for Grid/Point/Swath structuresPage 11 12. HDF-EOS 5 Based on HDF5, a complete rewrite of HDF-EOS2 with a different user interface. Used operationally by EOS Aura instruments Designed to resemble HDF-EOS 2 to the maximum extent possible. Supports same data structures (and more) Added prefix HE5_ to HDF-EOS 2 functionsPage 12 13. Software Releases Toolkit/HDF-EOS: Last release July 2009 TOOLKIT 5.2.16 HDF-EOS 2.16, HDF- EOS5.1.12 with HDF4.2r4, HDF5-1.8.3, Szip2.1 Next release June 2010 TOOLKIT 5.2.17 HDF-EOS 2.17, HDF-EOS5.1.13 with new releases of HDF4, 5 (5-1.8.X) Page 13 14. Software Releases (Cont.) HEG (HDF-EOS2 to GeoTIFF Converter): Last release August 2008 Version 2.9 Next release November 2009 Version 2.10Page 14 15. Software Releases (Cont.) HDF-EOS Plug-in for HDFView: Last release September 2008 Version 2.4 Next release For HDFView Version 2.5, December 2009Page 15 16. Software Releases (Cont.) HECONVERT (HDF-EOS2 to HDF-EOS5 Converter): Early releases 2001, 2004 Version ? Last release Dec. 2008 Version 2.0 Next release Not Planned Page 16 17. Major Development/Fixes Last Release (July 2009)TOOLKIT: XML metadata writing capabilty for inventory metadata in SDP toolkit (MLS) ODL fix (WriteLable) for potential core dump while writing long input pointer metadata attributes (AIRS) Support TOOLKIT for CYGWIN pccheck utility fix for problems resulting with empty space at a line beginning in PCF file Page 17 18. Major Development/Fixes (cont.) HDF-EOS5: Support for reading HDF-EOS5 files with netCDF Correcting wrong tiling and compression infoin the structure metadata Use of unlimited dimension in HDF-EOS5 (Users Guide clarification) Correction of output attribute data types in attribute inquiry routine Fix for writing int8 data correctly to output hdf5 file with C calls. There was no such a problem with Fortran calls Page 18 19. Major Development/Fixes (cont.) HDF-EOS2: Fixed PTdeftimeperiod to return an error when stop time < start time Fix for correct internal compression method detection for the products that are compressed internally after the production, possibly using hrepack (structure metadata has no record of compression info) Numerous fixes for HEConvert (version 2.0 release) Page 19 20. Availability Access to libraries, applications, Documentation : TOOLKIT: http://newsroom.gsfc.nasa.gov/sdptoolkit/toolkit.htmlHDFView: http://newsroom.gsfc.nasa.gov/sdptoolkit/HDFView/ HDFView_hdfeos_plugin.htmlHEG: http://newsroom.gsfc.nasa.gov/sdptoolkit/HEG/HEGHome.html Page 20 21. Availability Questions, Comments, Requests: [email protected] [email protected] http://www.hdfeos.org/ : HDF-EOS ForumPage 21 22. Thank You!Page 22