80
ADMINISTRATIVE BOUNDARY DATA SERVICE AS PART OF SPATIAL DATA INFRASTRUCTURES Dr. Mihály Szabolcs Dr. Mihály Szabolcs Institute of Geodesy, Cartography and Remote Sensing (FÖMI) Hungary 6 th GSDI Conference September 16-19 th 2002 Budapest Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures 6 th GSDI Conference, September 16-19 th 2002, Budapest

ADMINISTRATIVE BOUNDARY DATA SERVICE AS PART OF SPATIAL DATA INFRASTRUCTURES Dr. Mihály Szabolcs Institute of Geodesy, Cartography and Remote Sensing (FÖMI)

Embed Size (px)

Citation preview

ADMINISTRATIVE BOUNDARY DATA SERVICE AS PART OF

SPATIAL DATA INFRASTRUCTURES

Dr. Mihály SzabolcsDr. Mihály SzabolcsInstitute of Geodesy, Cartography and

Remote Sensing (FÖMI)Hungary

6th GSDI ConferenceSeptember 16-19th 2002

Budapest

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

SUMMARY (1)

Transition towards the information Society is the challenge of our time. Geographic information systems play special role in forming the national, continental and global spatial data infrastructures because larger part of any kind of information can be linked to its location by direct or indirect positioning.

For a big deal of users and information the co-ordinate systems are too specific. Indirect positioning, e.g. is linking the information to administrative territorial units suits much more users’ requirements.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

SUMMARY (2)Geometrically, the administrative territorial units can be represented by their boundaries. Addition of attributes to them widens the circle of interest to them. The registry of boundaries and some attributes, the data capture and compilation of the administrative boundary database as well as the data services are generally the task of the national mapping agencies and partly those of the statisticians, all representing a part of the National Geographical Data Infrastructure. The globalisation and the increasing number of crossborder co-operations require unified interoperable data for any region and at global level.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

SUMMARY (3This awareness in Europe led to the creation of SABE (Seamless Administrative Boundaries of Europe) by the European mapping agencies to be part of the continental spatial data infrastructure. Later, under the support of the European Commission R+D framework – as a kind of geographic extension and in the same time a technological innovation – the ABDS for the CEEC (Administrative Boundary Data Services for Central and Eastern European Countries) project advanced in the topic.

The paper presents how the ABD services can be managed to fulful the requirements of the Information Society and gives example how to go from national platform to continental and global ones in a comprehensive way.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

ABD as part of spatial data infrastructure (1)

Provision of reliable up-to date basic data infrastructure is generally the task of the government. Nowadays this task is even more important, when the transition towards the Information society takes place.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The Administrative boundary data – being the base information infrastructure for different kind of analysis when spatial reference is required – are core part of the NSDI. The number of potential users is practically indefinite, range from statistics to economic analysis, from environment to logistics, from business administration to marketing, etc. A wide spread use of such kind of information can greatly contribute to modernisation of the whole infrastructure of a country, or a region. The provision and integration of such data and services seems indispensable for the modern electronik governance.

ABD as part of spatial data infrastructure (2)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

What are the key requirements for ABD service? • Firstly, the service must be reliable. It means that it must exactly reflect the

actual legal status of the territorial units. • Secondly, it must be relatively cheep and accessible for a wide range of users

(with certain products to be served for the public free of charge). • Finally, it must be interoperable in respect of merging the different data

sources as well as user friendly such that the user could specify the product wished to purchase.

 Obviously, such criteria can be met only by on-line real-time service accessible via internet, all based on interoperation between the authorised data providers, on harmonising the data content, on adequate data and quality assurance, on well automatised data handling as well as on right service and data policy.

ABD as part of spatial data infrastructure (3)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

ABDS for the CEEC project (1)• As preparatory phase of a future service, the ABDS for the CEEC project, was

supported by the INCO Programme of the European Commission.

• The project aimed at the preparation and partial implementation of on-line delivery of administrative boundary data collected, processed and delivered with defined rules for data model and products, using the new European and ISO standards.

• The project was co-ordinated by the Institute of Geodesy, Cartography and Remote Sensing (FÖMI), Hungary and was implemented by a consortium of 19 organisations from 12 countries, representing the national mapping agencies, statistical offices and other public and private organisations mainly of the central and Eastern European Countries.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Participants sssssstordd CCountryCosssssss

Institute of Geodesy, Cartography and Remote Sensing (FÖMI) HungaryTechnical University of Sofia BulgariaResearch Institute of Geodesy, Topography and Cartography (VÚGTK) Czech RepublikStatistical Office of Estonia (ESA) EstoniaMEGRIN (an organisation of European NMA’s data services) FranceHellenic Cartographic and Cadastral Organisation (HEMCO) GreeceNational Service of Geodesy and Cartography LithuaniaCentral Statistical Bureau of Latvia LatviaGEOBID PolandResearch Institute for Informatics, RomaniaMinistry for Regional Development Czech RepublikMasaryk University, Brno Czech RepublikPlancenter Ltd. FinlandHungarian Association for Geoinformation (HUNAGI) HungaryMapping Agency of Hungarian Defence Forces (MH TÉHI) HungaryCentral Statistical Office (KSH) HungaryHungarian Public Utility for Regional Development and Town Planning (VÁTI) HungaryPrime Minister’s Office HungaryGISIG (a EU-supported international consortium) Italy

ABDS for the CEEC project (2)

Country

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Tasks fulfilled:• Inventory• Generalisation• Memorandum of Undrstanding• Horizontal activities

– Standard conformity checking

– Quality assurance

– Legal protection

ABDS for the CEEC project (3)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

INVENTORY (1)• What are the data sources in different countries?

• What is the administrative hierarchy in the different countries?

• What is the legal background of different administrative territorial units?

• Who are the data owners in different countries?

• What kind of data are available in different countries?

• What are the formats of delivery AB data and their atrributes?

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

INVENTORY (2)Sources of elementary datasets• Legally based: registered and maintained by cadastre• Technically based: on topographic or ther maps.

Data resolution consolidation levels• The kind of source of AB data greatly defines the accuracy and

influences directly on the largest possible resolution of the service. Therefore, each country can join the service depending on the quality of their available data.

• Consolidation levels which can serve as data of basic resolution to be used for different products of the common ABD servise:– 1st consolidation level: 2 m resolution (1:50 000 scale)– 2nd consolidation level: 10 m resolution (1:50 000 scale) (countries with

topographic or other maps)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

INVENTORY (3)Hierarchy of administrative units:

 Country NUTS 11 NUTS 2 NUTS 3 NUTS 4 NUTS 5

Bulgaria (BG) Geographic regions

Region County Municipality2

Czech (CZ) Group of regions Region District Municipality

Estonia (E) Region County Municipality

Finland (SF) Province Region County Municipality

Greece (GR) Group of regions Development region

County Municipality

Hungary (H) Statistical region County Small region Municipality

Latvia (LA) Province County Districts Municipality

Lithuania (LI) County Municipality

Poland (PL) Province Municipality

Romania (RO) Development region

County Municipality

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Generalisation (1)• The objective of this work package was to elaborate generalisation

rules for the ABDS using a model oriented approach, formulating the requirements, coming to agreement on scales/resolutions and elaborating recommendations on the base dataset derivation. All with the aim to give the answer to the question on how we can convert our data into a product.

• Since the objective of the ABDS for the CEEC project is to deliver digital datasets of the administrative boundaries and not to produce maps, a model generalisation approach has been decided to be used rather than a cartographic one. That means in fact a simplification procedure using well elaborated and accurately tested algorithm(s).

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Steps of model generalization for ABD service:Generalisation (2)

Procedure Step ResultsSegmentation Formal checking of the dataset List of errors and corrections

Visual checking of the geometry Corrections

Graphical checking by software and interactively List of errors, list of first order segmentation points

Hierarchical segmentationby software and interactively Definition of the triple boundary points and their attributes

Hierarchical and thermatic segmentation of state boundary points by bilateral agreement using software tools

List of state boundary points with attributes

Thematic segmentation – optional, to be supported by software tools List of segmentation points with thematic significance

Generalisation simplification

Lengthening straight lines (two adjacent vertexes is smaller than 1/3 of the band with used for the simplification for the given resolution must be eliminated)

Linger straight lines

Filtering of characteristic rectangular break of lines These points marked as additional segmentation points of safeguarding geometry

Simplification (Douglas-Peucker with Duda-Hart mofification or other optional algirithms e.g. Whirpool)

Simplified set of the set of coordinates

Interactive visual checking for self-intersection or other topological irregularity

Manual elimination of the irregularity, or definition of additional segmentation points(s) at this place, then repeating the simplification

Definition of the generalisation constant for seamless resolution generalisation Seamless simplification of the dataset

Product tailoring Addition of attributes to the dataset Data about area, population, etc.

Data conversion into pre-defined GIS formats (including XML, .txt) User-friendly products

Addition of metadata Complete information to the user about the product

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Generalisation (3)• In the model generalisation process a geometry driven approach is applied. The

commonly used method of production guarantees the unified quality all over the area of participating countries.

• This method is to– Primary (elementary) datasets– Consolidation level datasets– ABD products: - standard products; tailored datasets– Guarantee the integrity, topological consistency at all resolution,– Produce predictable and repeatable results,– Reduce at maximum the data volume for the chosen resolutions,– Minimise the deviation of the boundary lines from the original position,– Allow on-line delivery of the tailored dataset,– Allow parameterisation of the main rules by the users (scroll menu with visualisation

of the effects of the chosen parameter),– Allow the calculation of the deviation from the area of the ATU.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Generalisation (4)Standard product

Resolution (m) Scale Corridor of simplification (m)

Precision (m)

0,1 1:1000 0,2 0,1

1-2 1:10 000 4 1

10 1:50 000 20 10

50 1:250 000 100 10

100 1:500 000 200 100

200 1:1 000 000 400 100

500 1:2 500 000 1000 100

1000 1:5 000 000 2000 1000

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

ABDS: Data model, Service model (1)

Factors considered

• Results of inventory

• Results of elaboration on generalisation

• International GI standartisation

• Quality aspects

• Legal and organisational issues

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Principles of Data model (1):

• The objects of the service and databases are the ATU-s (Administrative Territorial Units) of different level the properties of which are given by the attributes. The attributes and their values are related to the objects and to each other in a relational description. This idea expresses the object oriented database model.

• The main groups of the attributes are the followings: spatial identification, the thematic properties of ATU-s, the attributes of the co-ordinates delimiting the ATU-s and the data quality parameters.

• Based on international GI standardisation the spatial schema follows the geometrical description and topological description.

• The ATU-s geometrically are expressed with surfaces, bordered by boundaries, consisting of boundary lines, the last being described by points. The points are given by their plain co-ordinates and optionally by their height.

ABDS: Data model, Service model (2)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Principles of Data model (2):

• The topological description of ATU-s is done with faces, edges and nodes.

• In case of data quality the data origin, accuracy certification and actuality are involved into the database as attributes. There are additional information in the metadata.

• The thematic properties of ATU-s are the results of agreement between the countries. The thematic properties are the dominant attribute elements in databases.

• Starting points of the data to be supplied are the primary (elementary) data sources. Here the clear knowledge on data quality is the purpose rather than only the accuracy or data collection simplicity.

ABDS: Data model, Service model (3)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Principles of Services model:

• The data service is based on the concept of distributed databases of the countries, at so called National Portals, established and managed by the National Focal Points. The International Portal is assuring the unique search facilities and all kind of harmonised Value Added Services based on the connected country data set.

• The future ABD supplier consortium is expected to be interfaced to the user community with a web-site at the National portal of each country being linked to each other by Internet and being connected to their own product database by LAN through fire-wall.

• The service model foresees the following products: gazetteer, free of charge products, standard (catalogued) products, customised products and value added services, as well as providing the data in national projection systems, in 2D geographical coordinates of ETRS’89 (GRS80 ellipsoid) and in data formats of dominant GI softwares.

ABDS: Data model, Service model (4)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data flow and on-line service in ABDS - proposal

Primary data sources

Geometry data

Attribute data

Process of consolidation

Master

database

F

I

R

E

W

A

L

L

International portal

National portals

users

users

Portal

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

MEMORANDUM OF UNDERSTANDINGThe project was finalised by the signature of the Memorandum of Understanding at the Prague closing review meeting.

It describes the technical, organisational, and some other aspects of the future service.

It regulates the relationship between the SABE and the future ABDS.

The ABDS will be not a competitive product to the SABE, but rather a complementary one, as regarded the geographical scope, the technological innovation and the resolution of the data to be supplied.

On one hand the experience of SABE in managing of such kind of databases, on the other hand the geographical and resolutional extension and the technological innovations of the ABDS open together a good base for joint thinking and actions at European level, too.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Conclusion (1)

The „Administrative Boundary Data Services for the CEEC project implemented a work in harmony of general trends of Geographic Information Infrastructure and the Information Society. Its main objective, to define framework for implementation of a new ABD service in the region was achieved.

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The innovative approach on comparing with other existing

services of the same character was expressed in the following

fields:• Using administrative boundary data with legal background rather

than the topographical ones of secondary data source• Scientific selection of the generalisation/simplification methods• Providing a full range of scales (resolutions) starting with 1:10 000

large scale AB data • Presenting the possibility of unique position determination of the

points on the border between the states in a Hungarian-Romanian pilot action

• Full range of products of the service, including the product tailoring according to the demands of the users

• Steps towards an on-line real time service.

Conclusion (2)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Besides of the innovation the project has some more positive results:

• Formation of a competent network of specialists able and willing to work together

• Impact on the development on the European GI infrastructure (possible further contribution GSDI

 The positive experiences of the pilot project have proven, that we took apromising step towards the implementation of a modern international on-line service of the base data insfrastructure. Our results were highly appreciated by the European Commission. The public report of the results of the project „ABDS for the CEEC”, including the names of representatives of participating countries and organisations, can be visited web site. 

Conclusion (3)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

ABDS Data Model Administrative Boundary

Data Servicescase of Hungary

ABBREVIATIONS OF HUNGARIAN ORGANISATIONS USED LATER-ON:

CSO – Central Statistal Office of Hungary

DLO – District Land Offices of Hungary (1st level of cadastre)

CLO – County Land Offices of Hungary (2nd level of cadastre)

FÖMI – Institute of Geodesy, Cartography and Remote Sensing, Hungary (3rd level, nation-wide collection of

AB cadastre data)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

117 DLO 20CLOgeometry and attributes

actual tasks:

new data forbuilt-in areas

update for

settlements

geometry

attributes

future: only updates

ISO - attributes

CSO - attributes

Data flow in ABDScase of Hungary, consolidation level 1:10 000 scale, 2 m resolution

FÖMI

Master

database

F

I

R

E

W

A

L

L

FÖMI

storage

database

Consolidation process

TAKARNETintranet of the land offices network

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Case of Hungary

Regulation for data capture and update

Geometry - boundary of the settlement: at ministry decree level (21/1955 FM)

- boundary of the built-up areas: FÖMI internal arrangement– to be changed for

the update into ministry level  

Attributes - area volume: FÖMI internal regulation

- population: CSO

- name of ATUs: CSO

- codes of ATUs: CSO

- NUTS: CSO

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Original data sources (1)boundary points of settlements and of built-in areas

Data available in digital form

·  in EOV and other reference systems·  in ITR, Microstation, ERTOS etc. software format·  content: id of coordinates, x, y, codes – optional Data available in coordinate lists (EOV surveys)

· in EOV and other reference systems· on paper, tipped lists· content: id, x, y, type of marcation – optional 

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Original data sources (2)boundary points of settlements and of built-in areas

Data from traditional map

·  EOV other reference systems scales: 1:1.000, 1:2.000, 1:4.000, 1:1440, 1:2.880, with

·  different regulation for surveying parameters, content: boundary points of parcels at the settlement and built-in area borders (x, y, type of monument can be digitised)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data content of the files - separately for each settlement (1)

Data format: .text

1. Header: number and order of the rows can be defined for local needs

Content of the rows:

Name of the settlement (as defined by CSO)

Attributes defined by the DLOof boundaries (external, internal, see picture 1)

area volume (in ha)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data content of the files - separately for each settlements (2)

Content of the rows - header (cont.)

Attributes defined by CSO:name od the regioncode of the regionname of the countycode of the countyname of the small regioncode of the small regioncode of the settlementtype of the settlementpopulation (census of 1990)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data content of the files - separately for each settlements (3)

Content of the rows (cont.)

2. Geometry - content of the rows

External boundary 1..n

geocode of the central/label point

area volume (ha)

population

coordinates with y, x, code

1.. w, where 1=w

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data content of the files - separately for each settlements (4)

Content of the rows - geometry (cont.)

Internal boundary 1..m

geocode of the central/label point

area volume (ha)

population

coordinates with y, x, code

1.. w, where 1=w

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data content of the files - separately for each ssettlement (5)

Content of the rows - (cont.)

3. Metadata*version

format

reference system

date

quality (see codes of coordinates, b+c)

*The metadata should be placed into the first group of rows for processing

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Types of the basic ATUs, the settlements (1)

 One polygon

B) One main polygon and one or more external, separated

polygons, depending from the main polygon

C) One main polygon and a not from this polygon depending

smaller polygon within

D) One polygon with b and c – theoretical, not existing

E) Two type c as one settlement – theoretical, not existing

F) Terra incognita – polygon not depending from any polygons of

any levels

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Types of the basic ATUs, the settlements (2)

A) One polygon (99% - 3159)

·       

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Types of the basic ATUs, the settlements (3)

B) One main polygon and one or more external, separated

polygons, depending from the main polygon (0,9 % - 29)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Types of the basic ATUs, the settlements (4)

C) One main polygon and a not from this polygon depending

smaller polygon within (0.09 % - 6)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Types of the basic ATUs, the settlements (5)

D One polygon involve the other – theoretical, not existing

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Types of the basic ATUs, the settlements (6)

E) Terra incognita – polygon not depending from any polygons of

any levels (1 case)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Built-in areas – polygons below the basic ATU level

Categories

built-in area

external zonesspecial external zones(former “closed garden”)

other legally validated categories detached farmsgroup of detached farms

Number of the built-in areas by settlement: 1… n (maximum: 128, case of Debrecen)

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Case of Hungary

Codes of the coordinates (1)

A) level of ATU in the administrative hierarchy

1 = state boundary2= region3= county4 = small region5 = settlement6 = built-in area

(7 = reserved for blocks)

(8 = reserved for parcels) B) monument – only for the storage database

0= no monument

1= marked point

 

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Codes of the coordinates (2)

C) Origin (quality information)0= not known1= field survey2= photogrammetry3= digitisation4= other (e.g. calculated)

 this categories are orientation for accuracy of the data:

1 for 1 ca 10-20 cm2 for 2 ca 50 cm3 for 3 ca 100 cm

 

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Codes of the coordinates (3)

 

D) Type of nodes (segmentation points)

0= simple boundary point, not node1= node defined by geometrical segmentation (to avoid self-intersection etc.)2= node defined by thematical segmentation (optional: crossing point of roads, rivers, state borders etc.)3= triple boundary point (common point of 3 or more ATU border segments)4= triple boundary point of built-in areas and other level ATU boundaries (picture 2)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The registry data (parts of metadata of the ABD collections for the ATU boundaries (1)

Status: to be completed continuously for the settlements, ready for the built-in

area boundaries

Content:

Cover pageName of the settlementCode of the settlementName of the DLOName of the CLO

  Names and codes of the built-in areas of the settlement

Names and codes of the former “closed gardens”

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The registry data (parts of metadata of the ABD collections for the ATU boundaries (2)

Contenrt of the registry data (cont.)

1 page

Date of the execution of the data collection Name of the settlementCode and name of the countyName of the DLOCode of the settlement The neighbouring settlements(in the order as data are contained in the file: code of the settlement, name of the

settlement, competent DLO and CLO if in other county)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The registry data (parts of metadata of the ABD collections for the ATU boundaries (3)

Contenrt of the registry data (cont.)

1 page

Map sheet and reference system used for the settlementScale Date of the implementation of the surveyTechnology used for the implementation of the survey Origin of the data by group of point – coordinates by y, x, detailed description of

the source

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The registry data (parts of metadata of the ABD collections for the ATU boundaries (4)

Contenrt of the registry data (cont.)

Last page Executing officer DLODate Controlled by: name, DLO, dateMethod of controlChecking method for the topology: Sent to FÖMI: date

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Structure of data collection (1)

3 level process

1st level: DLO – locally collected data, local checking 

2nd level: CLO – regional checking, and interactive corrections if necessary with DLOs main task: common boundary points between settlements limiting DLO-borders

3. Level: FÖMI – homogenisationmain tasks: common boundary points between countiesstate boundary points – bilateral agreements with neighbouring countries 

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Structure of data collection (2)

Interactive checking process – corrections exclusively by the data ownerat local level

DLO CLO

FÖMI

Unification of districts

By settlements boundaries + corrections

correctionsUnification of

countries

By settlements boundaries + corrections

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Aspects for checking of the ABD (1)

Completeness• · lack of line segment, lack of part of the map(sheet)• · lack of attributes (codes, centroid, etc.)• · lack of coordinate at triple boundary points• · lack of elements of the codes 

Topological correctness• · not continuous line with points jutting out• · common line segment not fully in coverage (number and identity of the

points)• · al points available in the different line segments for triple boundary points• · overlapping - corrections

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Aspects for checking of the ABD (2) Segmentation points• ·identity at the common segment lines• ·identity of the common lines of settlements and built-in area’s triple

boundary points 

Quality• · homogenity on the base of the origin of the data (column c of the code of

the coordinate)

• · maximum error, requirements of the consolidation level resolution 

Actuality• · dates of the registry sheet• data concerning updates

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Software used for checking process

The files contain .text data format - conversion into XML recommended

 

Software used:•  MS Basic

• C

• Mapinfo

• MabBasic

• (ArcView)

• ITR – local programme used for field survey

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Checking process using software (1)

Checking of the format• number of points, completeness of codes, correctness of coordinates,

separation of attributes and geometry data, first and last point identity by polygons

• test programmes in MS Basic

 Checking of the completeness• number of ATUs, • existence of centroid/label point, situation within or not within the polygon • test programme in MS Basic

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Checking process using software (2)

Visual checking• self-intersections caused by wrong coordinates• ordering of polygons• not full coverage of common segment lines between two ATUs• Mapinfo, MS Basic

Checking of the triple boundary points• searching for the triple boundary points defined for different ATUs• identity of the marked triple boundary points• object building by merging coordinates of common line segments • Deleting of line points (virtual nodes) • MS Basic

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Checking process using software (3)

 Test generalisation as checking• using Douglas-Peucker with Duda Hart extension• to detect self-intersections and lack of triple boundary points• list of first group of segmentation points with intersection danger in

different scales

 Test export into different software formats

 Test visualisation – portrayal – using different software • list of coordinates • 0-surface polygons

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

State boundary Key action for ABDS: to merge data of neighbouring countries

along the state boundaries - The main steps (1)

1. Agreement on coordinates of the boundary points in common reference and coordinate system (for ABDS: ETRS 89 and UTM)

2. Definition of triple boundary points: state boundaries and ATUs at different level of the administrative hierarchy

3. Definition of the triple boundary points at built-in area level: common points of state boundary and built-in area boundaries

4. Agreement on the boundary points of the geometrical segmentation – point characteristic for the state boundary line segment between two triple boundary points

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

State boundary Key action for ABDS: to merge data of neighbouring countries along

the state boundaries - The main steps (2)

5. Agreement on the state boundary point of thematical segmentation – points of high interest (cross-border section of roads, railways, buildings, peak of mountain, etc.)

6. Agreement on the coordinates when the rounding off procedure gives different value for the same point – practically at the scale of the surveying of the points

7. Remaining task: definition of the procedures necessary for the conversion of the whole country ABD into ETRS 89 / UTM - in national frame

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Checking and definition of the segmentation points - controlling for the segmentation

Hierarchical segmentation:definition of the triple boundary points at different levels (in the case of

Hungary ca. 13.000) – see code d/definition of the common points of administrative boundary and built-inarea boundary points – see code d/4

Thematic segmentation roads, railways, buildings, etc crossing administrative boundaries andhaving precisely defined common points important: definition for different resolution standard productsoptional, not used in the case of

 

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Conversion

• Commonly used reference and coordinate system at the consolidation level of 2 or 10 m resolution: ETRS 89 and UTM

 

• Rules conforming the specifications of the national reference systems with the aim to have the whole country in ETRS 89 and UTM resulting from one or more parts of the territory converted

 

• Parameter of conversion and software tools for Hungary (available from FÖMI – www.fish.fomi.hu

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Simplification (I.)

• Production of the master database at the consolidation level:

 

- scale of the original data source: 1.1.000 – 1:4.000

- target scale / resolution as consolidation level: 1:10.000 / 2m

- algorithm used for simplification: Douglas-Peucker; main reason for its

choice: no displacement of points, only deleting

- deleting of the attribute “markation” of the co-ordinates

  

• Number of points at original scales:

• Number of points at the consolidation level 1:10.000 / 2 m:

• Number of point at the consolidation level 1:50.000 / 10 m:

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Result: consolidation levels of the ABDS

• Master database at the consolidation level is ready to start the creation, tailoring of the products and services at the resolution of 2 m, scale of 1:10.000 - from the national portal, actually in elaboration

• Simplification of the dataset into the 10 m resolution, 1:50.000 scale: one step of generalisation, first standard product for the ABDS

• Differences: number of points, upgrade period (halfyearly at 1:10.000 scale)

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Simplification (II-1)

• Creation of the standard products of ABDS for the CEEC following definition in the documents data content and generalisation rules

- AB dataset by countries ar 10, 50, 100, 200, 500 and 1.000 m resolution

- change files

• Gazetteer: showing the searched ATU – search by name in English or local language(s) – situated within the 2-3 higher level ATUs and presenting links

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Simplification (II-2)

Use of algorithms – software available: Preferred: Douglas-Peucker with Duda-Hart extension – generalisation factor

allows seamless resolution product composition

For tailoring standard product only: Whirlpool

Other could be included into the product line if needed andalgorithm defined

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Douglas –Peucker algorithm with Duda-Hart modification

•VX1

TBP1 TBP2

d2 d1

d1, d2 ordinate values of vertices

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The Whirpool algorithm

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Case of Hungary

Comparison of the algorithms Douglas-Peucker and Whirlpool

Argument for the functionality Douglas-Peucker Whirlpool

Weeding +  

Maximum deviation of original line

  Higher

Centre of the line maintained   +

Area deviation   Smaller

Shape maintenance   Better

More apt Human created objects Natural objects

Elimination of far away points + -

Self-intersection + +

Overlap + +

Only existing points (reverse engineering)

3 -

Only one step for the generalisation

  For each product separated process

Complexity of the algorithm simply complicated

Strongly generalised dataset squaring up fitting to the forms

Cutting big loops with narrow neck

  +

Line with high pont density   rough averaging

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Filtering of straight lines

V0V1

V2d1

If d1<3BW v1 eliminated

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Segmentation by characteristic rectangular nodes

VX1

VX2VX0

>5 x BWBand width (BW)

>5 x BW

α

α = 89º - 91º

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The parameter of the standard products

The label points for the ATU centres are included into the generalised product with the accuracy needed for the given resolution, always as integer.

Resolution(m)

Scale Bandwith, corridor (m)

Triple boundary point and label point sharpness (m)

:

10 1:50.000 20 10

50 1:250.000 100 10

100 1:500.000 200 100

200 1:1.000.000 400 100

500 1:2.500.000 1.000 100

1.000 1:5.000.000 2.000 1.000

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

The co-ordinates of the points and their attributes delivered in the products

1:50.000 – 1. 500.000 – all polygons, administrative centres of polygons, label points, names, codes, area volume, population and languages data + polygons of built-in areas (below basic ATU level)

1:1.000.000 (proposal) – all polygons, administrative centres of polygons with the exception of the of the built-in area, label points, names,

1:2.500.000 – (n-1)st ATU level (NUTS 4 level) polygons, label points, names

1:5.000.000 – (n-2) th ATU level (NUTS 3 level) polygons, label points, names

Note: The search interfaces of the international portal for ATU names, administrative centre names and codes will run at the 1:1.000.000 or 1.250.000 scale harmonised dataset.

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Simplification (III–1)

Personalisation of the product and service - preview of the choice

Use of the Douglas-Peucker algorithm with Duda-Hart extension as default

·        Delimitation of the area·        by countries ·        by group of different level ATUs

 ·        Definition of the bandwidth of the corridor for simplification

·        standard products·        individual product

 ·        Definition of the sharpness of the coordinates

·        recommendation following resulting of bandwidth

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Simplification (III-2)

·        Definition of the formatXML, text, dxf, dwg, MapInfo, ArcInfo, etc.

 ·        Definition of the creation of long straight – deleting points·        parameter for the bandwidth of the corridor  ·        Definition and selection of the typical “rectangulars” –

definition of new segmentation points for the individual product

·        parameter for the angle between the sides·        parameter for the sides in function of the bandwidth   

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Simplification (III-3)

Composition of the productprice calculation

Document file: description of the ATU structure following inventory

Metadata – full ISO defined contentQuality data – following ISO definition, full

contentAttributes of the ATUsAttributes of the points

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Topological errors in the generalised dataset:(Douglas-Peucker algorithm)

1. Example

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Final checking of the personalised products

1. Looking for self-intersection created additionally

2. If created, the original and generalised line segments transferred into a separate file with

• identification of the ATUs

• identification of the triple boundary points

limiting the line segments

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data structure in MapInfo format (1)

Base: .text or XML coming from master database

“Header” file

name of the file settlement

reference systemfonttypes of lineattributes – name of the rows and columnsnumber of records

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest

Data structure in MapInfo format (2)

Geometry

name and number of the of the regions (1 region = 1 settlement), number of the external and internal boundariesnumber of coordinates

In separate files:

metadata, quality data and hierarchy documentation

Case of Hungary

Dr. Mihály Sz.: Administrative boundary data services as part of spatial data infrastructures6th GSDI Conference, September 16-19th 2002, Budapest