Experience in Using Handheld Computers for Data Collection ... file• to make the enumerator’s work easier • to make uniform enumeration procedure • to introduce more controls

Les recensements après 2001, Paris , 20 et 21 novembre 20001

STATE STATISTICAL OFFICE

OF THE REPUBLIC OF MACEDONIA

Experience in Using Handheld ComputersExperience in Using Handheld Computersfor Data Collection in thefor Data Collection in the

Test Census of Population, Households and Test Census of Population, Households and Dwelling in Republic of Macedonia, 2000Dwelling in Republic of Macedonia, 2000

INSEE/Eurostat SeminarINSEE/Eurostat Seminar“The Censuses After 2001”“The Censuses After 2001”

20 20 -- 21 November, 2000, Paris21 November, 2000, Paris


STATE STATISTICAL OFFICE

OF THE REPUBLIC OF MACEDONIA BACKGROUNDBACKGROUND

•• Since 1948 Since 1948 -- 7 censuses in the Republic of 7 censuses in the Republic of Macedonia (1948, 1953, 1961, 1971, 1981, 1991, 1994Macedonia (1948, 1953, 1961, 1971, 1981, 1991, 1994))

•• Traditional census Traditional census -- field data collection with field data collection with interview done by enumerators and the answers interview done by enumerators and the answers were recorded on paper questionerswere recorded on paper questioners

•• Data processing Data processing -- in accordance with available in accordance with available technology and equipment in the statistical officetechnology and equipment in the statistical office

•• 1994 Census was realized on mainframe (UNISYS 1994 Census was realized on mainframe (UNISYS --12). First, the answers were coded on the paper 12). First, the answers were coded on the paper questioners and than the data were entered questioners and than the data were entered manuallymanually


THE 2001 CENSUS THE 2001 CENSUS OF THE POPULATION, HOUSEHOLDS AND OF THE POPULATION, HOUSEHOLDS AND

DWELLINGS IN THE REPUBLIC OF MACEDONIADWELLINGS IN THE REPUBLIC OF MACEDONIA

•• The next, respecting the UN Recommendation The next, respecting the UN Recommendation in 2001in 2001

•• Reference date: 2001, March 31, at 12:00 PMReference date: 2001, March 31, at 12:00 PM

•• Field operation 1Field operation 1-- 15 April 15 April

•• Main goal: full coverage of definited census Main goal: full coverage of definited census units and complete quality and international units and complete quality and international comparative data on all definited topicscomparative data on all definited topics

STATISTICAL OFFICE



Motives for TestingMotives for TestingHandheld ComputersHandheld Computers

•• Use of new techniques for data collection Use of new techniques for data collection and/or data processing and/or data processing ⇒⇒ shorter period of shorter period of processingprocessing

•• Directions referring the instruments for data Directions referring the instruments for data collectionscollections•• qualitative final data in as shorter as possible qualitative final data in as shorter as possible

period after the field data collectionperiod after the field data collection•• to make the enumerator’s work easierto make the enumerator’s work easier•• to make uniform enumeration procedure to make uniform enumeration procedure •• to introduce more controls in the phase of to introduce more controls in the phase of

data collectiondata collection

STATISTICAL OFFICE



STATISTICAL OFFICE

OF THE REPUBLIC OF MACEDONIA TESTSTESTS

•• Considering the offered products on our market Considering the offered products on our market and taking in account our financial possibilities and taking in account our financial possibilities ⇒⇒ Handheld computers (“Psion, Workabout” Handheld computers (“Psion, Workabout” --second generation of handheld computers from second generation of handheld computers from “Workabout” range)“Workabout” range)

•• June 1999 June 1999 -- appears idea to test the handheld appears idea to test the handheld computers for field data collectioncomputers for field data collection

•• End of July 1999 starts the preparation of the End of July 1999 starts the preparation of the application for hand computersapplication for hand computers


STATISTICAL OFFICE

OF THE REPUBLIC OF MACEDONIA Test CensusesTest Censuses

I.I. October 1999 October 1999 -- 6 ed6 ed-- 450 households450 households

II. April 2000 II. April 2000 -- 20 ed20 ed-- 1500 households1500 households

•• Used techniques of data collectionsUsed techniques of data collections

•• Paper QuestionnairesPaper Questionnaires•• Handheld computersHandheld computers

•• First test was plan just to examine how the First test was plan just to examine how the population will accept this type of population will accept this type of enumeration enumeration ⇒⇒ few questions on personsfew questions on persons


I. TESTTEST

Wider Aims than in the beginningWider Aims than in the beginning

•• How the population will react on computersHow the population will react on computers

•• How the HC application will workHow the HC application will work•• Needed time for enumeration with HCNeeded time for enumeration with HC•• How the transfer from HC will be doneHow the transfer from HC will be done

•• In order to obtain data for comparisonIn order to obtain data for comparison-- paper paper questionnairesquestionnaires

•• New way of data processing from paper New way of data processing from paper questionnairesquestionnaires

STATISTICAL OFFICE



TEST CENSUSESTEST CENSUSES

•• AimsAims•• Test of methodology and census Test of methodology and census

questionnairesquestionnaires•• HC for data collectionsHC for data collections•• New way of data processingNew way of data processing

•• Preparation for the I Test Preparation for the I Test -- within two monthswithin two months

STATISTICAL OFFICE



Technical characteristics of HCTechnical characteristics of HC

•• Designed for work on the field (lightweight, Designed for work on the field (lightweight, rugged on hits, drop and environmental rugged on hits, drop and environmental extremities)extremities)

•• RAM 2 MB and expandable memoryRAM 2 MB and expandable memory

•• Able to handle complex processing and Able to handle complex processing and programming task simultaneouslyprogramming task simultaneously

STATISTICAL OFFICE



Technical characteristics of HCTechnical characteristics of HC

•• Contemporary and fast operative system EPOK Contemporary and fast operative system EPOK which is designed in direction of mobile computer which is designed in direction of mobile computer workwork

•• Fast and save transfer of data with help of SS Fast and save transfer of data with help of SS drives which enable loading of data and drives which enable loading of data and applications on one places and transferapplications on one places and transfer on the on the other location for a short period of timeother location for a short period of time

•• Development of applications with visual toolsDevelopment of applications with visual tools

STATISTICAL OFFICE



HC APPLICATIONHC APPLICATION

•• Requirement from the statistical officeRequirement from the statistical office

•• Elements which should be built up in the Elements which should be built up in the applicationapplication

•• The way how the application should be functionThe way how the application should be function

•• Measures for data protectionMeasures for data protection

•• Program was made by the firm which rent us HCProgram was made by the firm which rent us HC

(oval)(oval)

STATISTICAL OFFICE



Elements in the applicationElements in the application

•• Questions, i.e. enumeration units and topics for Questions, i.e. enumeration units and topics for which the data should be collectedwhich the data should be collected

•• List of possible answers and classifications were List of possible answers and classifications were the answers can be selected fromthe answers can be selected from

•• Controls, those that are possible to be built up in Controls, those that are possible to be built up in the application (not all)the application (not all)

STATISTICAL OFFICE



List of possible answers List of possible answers and classificationsand classifications

•• List of possible answers for all questions (for those where List of possible answers for all questions (for those where the answer should be given with choice of one answer the answer should be given with choice of one answer from the offered list of answers)from the offered list of answers)

•• List of enumeration districts;List of enumeration districts;•• List of municipalities and settlement places (2 lists, one List of municipalities and settlement places (2 lists, one

according to present, and one according to previous according to present, and one according to previous administrativeadministrative--territorial division)territorial division)

•• List of streets by settlement placesList of streets by settlement places•• List of countriesList of countries•• List of schoolsList of schools•• Classification of occupation (ISCO)Classification of occupation (ISCO)•• Classification of industry (economic activity, NACE)Classification of industry (economic activity, NACE)

STATISTICAL OFFICE



Way of functioningWay of functioning

•• Simultaneously data entering and data codingSimultaneously data entering and data coding•• Each enumeration unit should have unique identification Each enumeration unit should have unique identification

in the frame of enumeration district (given by the program)in the frame of enumeration district (given by the program)

•• Possibility to enter data in two ways: with selection from Possibility to enter data in two ways: with selection from the offered list of answers (or from classification in the offered list of answers (or from classification in hierarchical order ) or with typing a texthierarchical order ) or with typing a text

•• The next question could not be answered if the current The next question could not be answered if the current one is not answeredone is not answered

•• To have rapport of enumerated units (cumulative) in each To have rapport of enumerated units (cumulative) in each momentmoment

•• To measure the time needed for enumeration of each To measure the time needed for enumeration of each separate enumeration unitseparate enumeration unit

STATISTICAL OFFICE



Measures for data protectionMeasures for data protection

•• Measures which will ensure protection from:Measures which will ensure protection from:

•• Loosing of already entered recordsLoosing of already entered records•• ExEx--post data correction in entered recordspost data correction in entered records•• Unauthorized using of dataUnauthorized using of data

STATISTICAL OFFICE



APPLICATIONAPPLICATION FUNCTIONINGFUNCTIONING

•• buildingbuilding

•• dwellingdwelling

•• householdhousehold

•• familyfamily

•• personperson

•• Outcome 4 secvetional tables from HC: Outcome 4 secvetional tables from HC: B, D, H, PB, D, H, P

STATISTICAL OFFICE


BF P

HD



•• The algorithm leads the enumerator from one to The algorithm leads the enumerator from one to the next enumeration unit, from one to the next the next enumeration unit, from one to the next questionquestion

•• Due to the controls Due to the controls ⇒ ⇒ appear only needed appear only needed questionsquestions

•• Problem Problem -- the program can not be terminate in the program can not be terminate in the process of enumeration for one unitthe process of enumeration for one unit

•• Returning in already enumerated household Returning in already enumerated household --by typing the identification of the B,D, H by typing the identification of the B,D, H

STATISTICAL OFFICE




•• Simple operationSimple operation

•• Methodological aspectMethodological aspect

•• The enumerator should know only the basic The enumerator should know only the basic things, such as definitions of enumeration things, such as definitions of enumeration unitsunits

•• Technical aspectTechnical aspect

•• few operations with HCfew operations with HC

STATISTICAL OFFICE



STATISTICAL OFFICE

OF THE REPUBLIC OF MACEDONIA • to connect and disconnect the computer• to chose the appropriate enumeration unit for which the data should be entered with pressing the appropriate letter• to search the answer in the lists of possible answers (or classifications) with two buttons (scroll bar)• to enter the selected answer by pressing “enter”• how to enter the textual answer;• to go back to the previous question with pressing “esc”• to enter the field record with pressing “enter”


5 days training for enumerators5 days training for enumerators

•• 2 days for methodology and the order of filing the 2 days for methodology and the order of filing the questions questions

•• 3 days were for practical work with the computers 3 days were for practical work with the computers •• 1 for filling complete records (for all units) 1 for filling complete records (for all units) •• 2 for practicing how to find answers in the 2 for practicing how to find answers in the

classification of occupation and industryclassification of occupation and industry•• Searching in these classifications was organized Searching in these classifications was organized

hierarchically, main groups, sub groups, minor hierarchically, main groups, sub groups, minor groups to the unique occupation/industry. groups to the unique occupation/industry.

•• structure structure ⇒⇒ to some extent burden for to some extent burden for enumeratorsenumerators

STATISTICAL OFFICE



Field Data CollectionField Data Collection•• Participants: enumerators, state instructors and Participants: enumerators, state instructors and

persons for technical supportpersons for technical support•• Successfully completed without major difficultiesSuccessfully completed without major difficulties•• Few technical problemsFew technical problems

•• battery chargingbattery charging•• the program itself shuted down, the enumerator the program itself shuted down, the enumerator

couldn’t restarted the program at allcouldn’t restarted the program at all•• everyday data transfer on the field was not everyday data transfer on the field was not

organizedorganized•• Population response was excellent and complete Population response was excellent and complete

⇒⇒ great interest for enumeration with HCgreat interest for enumeration with HC

STATISTICAL OFFICE



Needed timeNeeded time

Time Time Enumeration unit CumulativeEnumeration unit Cumulative(min/ sec) (min/ s(min/ sec) (min/ sec)ec)1:311:31 BuildingBuilding 1:311:311:301:30 HouseholdHousehold 3:013:012:292:29 DwellingDwelling 5:305:305:305:30 Person (1)Person (1) 11:0011:0016:3016:30 + 3 persons+ 3 persons 27:3027:30

•• Daily average of enumerated units:Daily average of enumerated units:Dwellings Households PersDwellings Households Personsons

With paper questionersWith paper questioners 10.610.6 8.68.6 35.035.0

With handheld computers 9.7With handheld computers 9.7 8.58.5 39.639.6

STATISTICAL OFFICE



FILE TRANSFER from HC to PCFILE TRANSFER from HC to PC

•• Needed equipment:Needed equipment:•• PCPC-- 32 RAM32 RAM•• CD unitCD unit•• windows 95windows 95•• office 97office 97•• visual basic visual basic -- application application

for transferfor transfer

STATISTICAL OFFICE


•• Additional elementsAdditional elements•• SS drive SS drive -- the the

diskettes from HC diskettes from HC are not standard are not standard

•• net cardnet card

• With one routine was enabled very simple and fast With one routine was enabled very simple and fast transfer of four cumulated tables for ten transfer of four cumulated tables for ten enumeration districts in four tables in Access 97 enumeration districts in four tables in Access 97 (buildings, dwellings, households, persons)(buildings, dwellings, households, persons)


DATA PROCCESSINGDATA PROCCESSING

Client Client -- server environmentserver environment

•• IBM IBM -- RS 6000 with RS 6000 with -- Unix operative systemUnix operative system•• DB2 DB2 -- relation databaserelation database•• PC PC -- Access 97 data baseAccess 97 data base•• ODBC (open data base connectivity) ODBC (open data base connectivity) -- connection connection

between client and serverbetween client and server

STATISTICAL OFFICE




Operations before importing data in DB2 Operations before importing data in DB2 •• coding of textual answers coding of textual answers •• additional formatting of some fields which were additional formatting of some fields which were

without answers (null values)without answers (null values)•• data control (those controls which were not data control (those controls which were not

included in the application)included in the application)•• corrections of discovered mistakescorrections of discovered mistakes

•• All done in Access 97All done in Access 97

STATISTICAL OFFICE




•• Tables from access database were exported in Tables from access database were exported in text file and successfully imported in DB2 tablestext file and successfully imported in DB2 tables

•• For complex table (for example tables on families) For complex table (for example tables on families) it was necessary to derived additional variablesit was necessary to derived additional variables

•• Complex and simple reports with SQL Complex and simple reports with SQL -- direct direct approach to DB2 and Access 97 approach to DB2 and Access 97 -- communication communication through ODBCthrough ODBC

•• The data from those reports were with good The data from those reports were with good qualityquality

•• Big phase of coding and data entry was jumpedBig phase of coding and data entry was jumped.

STATISTICAL OFFICE



Needed time for data processingNeeded time for data processing

•• All operations after receiving the data from the All operations after receiving the data from the field in the State Statistical Office up to the final field in the State Statistical Office up to the final data last two weeksdata last two weeks

•• Scope Scope -- 3500 Persons, 807 households 3500 Persons, 807 households 929 929 dwellingsdwellings

•• The work was done by two programmers and two The work was done by two programmers and two persons who work on corrections and codingpersons who work on corrections and coding

STATISTICAL OFFICE



Analyses and conclusionsAnalyses and conclusions

•• Handheld computers technically satisfied our Handheld computers technically satisfied our requirementsrequirements

•• Training of enumerators was satisfactory, but still Training of enumerators was satisfactory, but still there is a need for more training on classificationsthere is a need for more training on classifications

•• More careful selection of the enumeratorsMore careful selection of the enumerators•• The application was done in accordance with our The application was done in accordance with our

requirements and gave satisfactory results, but requirements and gave satisfactory results, but still there was a room for its improvementstill there was a room for its improvement

•• The data protection was totally ensuredThe data protection was totally ensured•• Few technical problems appearedFew technical problems appeared•• Time for enumeration Time for enumeration -- the same as with paperthe same as with paper

STATISTICAL OFFICE



DOUBHTS ON DOUBHTS ON POSSIBLE USE POSSIBLE USE OF HAND COMPUTERSOF HAND COMPUTERS

•• TrainingTraining

STATISTICAL OFFICE


•• Complex organization Complex organization -- field centers for every day field centers for every day data transfer (at least 60 with equipment and trained data transfer (at least 60 with equipment and trained staff)staff)

•• Control on the fieldControl on the field


DOUBHTS ON DOUBHTS ON POSSIBLE USE POSSIBLE USE OF HAND COMPUTERSOF HAND COMPUTERS

•• Confirmation of the Confirmation of the first resultsfirst results

STATISTICAL OFFICE


•• Processing Processing -- number of number of corrections, number of corrections, number of descriptive answers descriptive answers

-- needed time ???needed time ???


JUNE JUNE -- DECISION DECISION ??????STATISTICAL OFFICE



DECISION DECISION -- OLD FASHION PAPER OLD FASHION PAPER QUESTIONAIRESQUESTIONAIRES

STATISTICAL OFFICE


•• In the present circumstances, the paper In the present circumstances, the paper questioners are more safety instrument for questioners are more safety instrument for field data collection in the Census 2001 field data collection in the Census 2001 census. census.

•• The further preparation activities should go in The further preparation activities should go in direction to found out more sophisticated direction to found out more sophisticated program/application for data entry and data program/application for data entry and data coding which will result in having qualitative coding which will result in having qualitative final data in shorter period after field data final data in shorter period after field data collectioncollection

Documents

Experience in Using Handheld Computers for Data Collection ... file• to make the enumerator’s work easier • to make uniform enumeration procedure • to introduce more controls