Metadata for putting historical maps online / Chris Fleet (National Library of Scotland)

National Library of ScotlandLeabharlann Nàiseanta na h-Alba

National Library of Scotland

METADATA FOR PUTTING HISTORICAL MAPS ONLINE

Metadata for putting historical maps online22 July 2016


STRUCTURE

▪Map Images website overview

▪Main software and structural components

▪Metadata for maps and features

▪Metadata for georeferened images and web services

▪Future directions


Timothy Pont, ca. 1583-1614

T. Pont / J. Blaeu, 1654

James Gordon, 1661

Lewis Petit, 1715

John Home, 1774

James Crawford, 1804

Ordnance Survey, Perth, 1860

Ordnance Survey, Aberdeen, 1867

National Library of Scotland maps website http://maps.nls.uk


MAP IMAGES WEBSITE OVERVIEW

▪ NLS paper collections ca. 2 million maps

▪ NLS Map Images website 150,000 online maps - ca. 7.5%

▪2012-2015 - ca. 40,000 new maps added per annum

Google Analytics - http://maps.nls.uk - June 2016

▪ 97,039 users per month

▪ 165,177 sessions per month

▪ 797,147 page views per month

▪ 348 orders for images/printouts / £5,405 revenue

▪15 “commercial” permission requests / ca. £1,500 income


MAIN SOURCES


STRUCTURE








EXPANDING USE OF OPEN-SOURCE TECHNOLOGIES

Main open-source software:

● OSGeo suite

● GDAL

● QGIS

● GeoServer

● OpenLayers

● IIPImage Server

Main proprietary software:

● MapTiler

● ArcGIS

● Geographic Imager

● SQLServer



Find By PlaceViewer

Explore Georeferenced maps Viewer

OpenLayersViewer

WMS / WMTS Services, API

Derivative Images

Georeferenced Images

Descriptive Metadata

Shapefiles / bboxes

TIFF master images

Digital Objects Database metadata

Users

Maps

STRUCTURAL OVERVIEW : MULTIPLE COMPONENTS WITH DIFFERENT REPLACEMENT CYCLES



STRUCTURE








Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



DIGITAL OBJECT DATABASE METADATA








Unique IDs

Generated through the DOD and

retained for all derivatives - JPEG, JP2, and GeoTIFFs


Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



GEOGRAPHIC COORDINATES FOR MAP EXTENTS - ARCGIS



Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



GEOGRAPHIC COORDINATES FOR MAP EXTENTS - OPENLAYERS



GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN GEOSERVER



CACHING BOUNDING BOXES FOR RAPID ONLINE DISPLAY - GEOWEBCACHE



WEB FEATURE SERVICE (WFS)


An open standard developed by the Open Geospatial Consortium allowing requests for geographical features across the web using platform-independent calls.

URL format request with response received as Geography Markup Language (GML) or Javascript Object Notation (JSON) format

For example, a WFS request...

http://geoserver.nls.uk/geodata/wfs?service=WFS&version=1.1.0&request=GetFeature&typename=nls:OS_6inch_UK_27700&outputFormat=text/javascript&format_options=callback:loadFeatures&srsname=EPSG:3857&cql_filter=INTERSECTS(the_geom,POINT(530232 179709))

...and response

loadFeatures({"type":"FeatureCollection","totalFeatures":2,"features":[{"type":"Feature","id":"OS_6inch_UK_27700.1188","geometry":{"type":"MultiPolygon","coordinates":[[[[-16258.305954289,6704032.196635765],[-16226.801442981383,6714377.231410879],[-739.9404392996324,6714315.014511256],[-791.0370382677659,6703970.186406469],[-16258.305954289,6704032.196635765]]]]},"geometry_name":"the_geom","properties":{"IMAGETHUMB":"http://maps.nls.uk/imgsrv/iipsrv.fcgi?iiif=/10234/102347415.jp2/full/,150/0/native.jpg","IMAGEURL":"http://maps.nls.uk/view/102347415","SHEET":"Surrey III","DATES":"Surveyed: 1868 to 1873<br>Published: 1880"}},{"type":"Feature","id":"OS_6inch_UK_27700.1247","geometry":{"type":"MultiPolygon","coordinates":[[[[-17915.666782360982,6709058.027018599],[-17924.76285975371,6719409.4718413325],[-2428.1729460832776,6719408.392362227],[-2438.702515531777,6709056.951565147],[-17915.666782360982,6709058.027018599]]]]}, etc.

http://geoserver.nls.uk/geodata/wfs?service=WFS&version=1.1.0&request=GetFeature&typename=nls:OS_6inch_UK_27700&outputFormat=text/javascript&format_options=callback:loadFeatures&srsname=EPSG:3857&cql_filter=INTERSECTS(the_geom,POINT(530232

http://geoserver.nls.uk/geodata/wfs?service=WFS&version=1.1.0&request=GetFeature&typename=nls:OS_6inch_UK_27700&outputFormat=text/javascript&format_options=callback:loadFeatures&srsname=EPSG:3857&cql_filter=INTERSECTS(the_geom,POINT(530232



GEOREFERENCED SEARCH AND RETRIEVAL USING GEOGRAPHICAL COORDINATES


GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN SCOTLANDSPLACES



GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN OLDMAPSONLINE



GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN SHEETFINDER



SOURCES OF WEB TRAFFIC AND REFERRALS - 1 JULY 2015 - 30 JUNE 2016



MOST POPULAR PAGES 1 JULY 2015 - 30 JUNE 2016


ALL PAGES CONTENT DRILLDOWN



ASSIGNING PLACE METADATA THROUGH A SPATIAL JOIN


GOOGLE SPIDERING OF CONTENT



VALUE OF GEOGRAPHIC COORDINATES FOR INDEXING


● Allows flexible searching by text (place, postcode, county, etc.) and maps

● Allows multiple indexing by past/present geographies

● No need to be tied to fixed controlled vocabularies for geographic names

● Allows easier extension into other portals and harvesting sites

● Allows easier links from other websites and resources

● Allows creation of indexes of new names for new purposes

● Open, non-proprietory, and with complete institutional control over use


Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



DOD METADATA TAKEN INTO MAPS WEBSITE SQLSERVER DATABASE



MAPS WEBSITE PAGE METADATA FROM SQLSERVER



MAPS WEBSITE PAGE METADATA FROM SQLSERVER



MAPS WEBSITE E-COMMERCE MODULE



STRUCTURE








Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



DERIVATIVE IMAGES - PHOTOSHOP BATCH FOR JPG AND KAKADU BATCH FOR JP2



Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



CROPPING BORDER IN PHOTOSHOP



CROPPING BORDER IN PHOTOSHOP

Digital mapping and Georeferencing22 June 2016


ADDING CONTROL POINTS IN ARCGIS










Digital mapping and Georeferencing22 June 2016

MAPS ARE SPATIALGeoreferencing 2

Capturing corner Co-ordinates

SHAPEFILE METHOD

Linking corner co-ordinates of maps

geographic extents in each polygon - within a shapefile

Automatic cropping and georeferencing based on shapefile to create seamless mosaic

National Library of ScotlandLeabharlann Nàiseanta na h-AlbaCROWDSOURCED GEOREFERENCING - BLAEU ATLAS MAIOR


National Library of ScotlandLeabharlann Nàiseanta na h-AlbaGEOTIFF METADATA


Projections and extents information in GeoTIFF headerDriver: GTiff/GeoTIFFFiles: c:\Lomond_S_export.tifSize is 6643, 7930Coordinate System is:PROJCS[" Projection Name = Transverse Mercator Units = meters GeoTIFF Units = meters", GEOGCS["OSGB 1936", DATUM["OSGB_1936", SPHEROID["Airy 1830",6377563.396,299.3249646000044, AUTHORITY["EPSG","7001"]], AUTHORITY["EPSG","6277"]], PRIMEM["Greenwich",0], UNIT["degree",0.0174532925199433], AUTHORITY["EPSG","4277"]], PROJECTION["Transverse_Mercator"], PARAMETER["latitude_of_origin",49], PARAMETER["central_meridian",-2], PARAMETER["scale_factor",0.999601272], PARAMETER["false_easting",400000], PARAMETER["false_northing",-100000], UNIT["metre",1, AUTHORITY["EPSG","9001"]]]Origin = (228721.187000000010000,701502.853000000000000)Pixel Size = (3.000000000000000,-3.000000000000000)Metadata: AREA_OR_POINT=Area TIFFTAG_SOFTWARE=IMAGINE TIFF SupportCopyright 1991 - 1999 by ERDAS, Inc. All Rights Reserved@(#)$RCSfile: etif.c $ $Revision: 1.10.1.9.1.9.2.11 $ $Date: 2004/09/15 18:42:01EDT $ TIFFTAG_XRESOLUTION=1 TIFFTAG_YRESOLUTION=1 TIFFTAG_RESOLUTIONUNIT=1 (unitless)Image Structure Metadata: INTERLEAVE=PIXELCorner Coordinates:Upper Left ( 228721.187, 701502.853) ( 4d45'34.02"W, 56d10'31.42"N)Lower Left ( 228721.187, 677712.853) ( 4d44'39.21"W, 55d57'42.74"N)Upper Right ( 248650.187, 701502.853) ( 4d26'19.41"W, 56d10'55.71"N)Lower Right ( 248650.187, 677712.853) ( 4d25'30.96"W, 55d58'6.83"N)Center ( 238685.687, 689607.853) ( 4d35'30.87"W, 56d 4'19.55"N)Band 1 Block=64x64 Type=Byte, ColorInterp=RedBand 2 Block=64x64 Type=Byte, ColorInterp=GreenBand 3 Block=64x64 Type=Byte, ColorInterp=Blue


Find By PlaceViewer


OpenLayersViewer


Derivative Images



Shapefiles / bboxes

TIFF master images


Users

Maps



WEB MAP TILE SERVICE (WMTS)


An open standard protocol developed by the Open Geospatial Consortium for serving pre-rendered georeferenced map tiles over the Internet

Format:

server-and-url/zoom/x/y.png eg. http://geo.nls.uk/maps/popular/7/62/88.png

National Library of ScotlandLeabharlann Nàiseanta na h-AlbaHISTORIC MAPS API


National Library of ScotlandLeabharlann Nàiseanta na h-AlbaJOHN GRAY CENTRE, HADDINGTON



STRUCTURE








FUTURE DEVELOPMENTS

▪Expanding digitisation of maps and online availability

▪Growing functionality and range of uses

▪More collaborative applications

▪Greater engagement through crowdsourcing

▪Automatic georeferencing, OCR and vectorisation



Chris Fleet

[email protected]

/NationalLibraryofScotland

@natlibscotmaps

THANK YOU

Except for images or where otherwise stated this presentation is © National Library of Scotland and is licensed under the Creative Commons Attribution 4.0 International Licence. To view a copy of this license, visit: http://creativecommons.org/licenses/by/4.0/

http://creativecommons.org/licenses/by/4.0/

Data & Analytics

Metadata for putting historical maps online / Chris Fleet (National Library of Scotland)