Smart Infrastructure Asset Management Australia Research ...solutions.ait.ac.th/wp-content/uploads/2018/06/Day-2-Session-1... · ‣ Unmanned Arial Vehicle (UAV) ‣ Unmanned Ground

SIAMASmart Infrastructure Asset Management AUSTRALIA

SIAMA Asset Management Technologies

Advanced Inspection Technology

Smart Infrastructure Asset Management Australia Research and Development Pty Ltd ‘Prolonging Infrastructure Assets Life’


Smart Infrastructure Asset Management Australia Research and Development Pty Ltd Smart Infrastructure Asset Management Australia Research and Development Pty Ltd Smart Infrastructure Asset Management Australia Research and Development Pty Ltd

Smart Infrastructure Asset Management Australia (SIAMA) Research and Development

‣ Research & Development company

‣ Location - Gold Coast, Queensland, Australia & China branch – Nanjing

‣ Continuously develop innovative and effective technologies for prolonging infrastructure assets

‣ Strong theoretical background & expertise in road asset management

2


Smart Infrastructure Asset Management Australia Research and Development Pty Ltd

3

SIAMA’s Asset Management Technologies

‣ Precision Condition Data Acquisitions ‣ Unmanned Arial Vehicle (UAV) ‣ Unmanned Ground Vehicle (UGV) ‣ Mini-Crane and rail system

‣ Condition Assessment of Structural Components ‣  14 image processing techniques

‣ Concrete/Steel materials

‣ Smart Infrastructure Management Systems (SIMS) ‣  for Bridges



4

CONTENTS

‣ Background ‣ Bridge Asset Management ‣  Limitations of Current Practice ‣  Procedure of Level 2 Inspection

‣ Advanced Inspection Technologies ‣  Precision condition data collection ‣ Data analysis method

‣ Benefits



5

Make right decisions

Keep up-to-date information

Effective use of funds

Long-term planning

Cost effective operation

Increasing LCC

Must be durable

Must be safe

Limited funds

Large network

Required systematic approaches

Asset Management

Authorities

(Das, 1998; FHWA, 1996)

What is Bridge Asset Management?

‣ To determine and implement the best possible strategy that ensures an adequate level of safety at the lowest possible life-cycle cost. (Frangopol et al., 2000)



6

1982 1991 2010 1968

National Bridge Inspection Program (NBIP) by Federal Highway

Administration (FHWA) => Natl. Bridge Inventory NBI. (Czepiel, 1995)

Research on computer-based BMS

Release of commercial BMS

PONTIS d

PONTIS ver.4.x

History of Bridge Management System ‣ BMS History in the United States of America

‣ Common Benefits of a BMS ü  Developing defensible maintenance policies and strategies. ü  Updatable results from simulation of bridge conditions. ü  Systematic approaches. ü  Support for asset management in terms of MR&R funding and budget allocations. ü  Increased efficiency and effectiveness in collection and management of large size bridge

inventory and inspection data.



7

Collection of inventory data Inspection

Maintenance, repair & rehabilitation

(MR&R)

Prioritising the allocation of funds

Assessment of condition and deterioration

Traditional method

Collection of inventory data

Inspection

Project-level analysis

Network-level analysis

MR&R strategies

Cost analysis

Optimisation

Reporting MR&R

Supported by BMS

Bridge Management System Procedures

‣ Major Tasks in Bridge Management

Analytical Process Import/export data



Background (1/6)

8

Inspection Records

Major Tasks

1

2 3

Various Analysis •  Current/ •  bridge performance and risk

score in view of component/project/network-level;

•  MR&R cost & prioritisation; and

•  Network-level budget planning.

Maintenance, Repair & Rehabilitation (MR&R)

‣ What Bridge Management System (BMS) can do for you?



9

Level 2 Bridge Inspection

‣ Bridge authorities are responsible for bridge networks

‣ To maintain the structures, a Bridge Information System (BIS) or Bridge Management System (BMS) is essential

‣ Without consistent and accurate bridge condition assessment, reliable BMS outcomes could not be expected

‣ For precise bridge condition assessment, inspection service providers should recognise the fundamental limitations of the current Level 2 Bridge Inspection



10

Inspection Procedures

•  The qualified inspector will conduct a inspection.

•  The inspector will evaluate a condition rating for each individual structural element based on the standard Level 2 Inspection procedure.

Pre-site visit

1

Confirmation of required resources

2

Perform condition

assessment

3

Preliminary/final inspection report

4 & 5

‣ Typical Level 2 Bridge Inspection Procedures



11

Limitation of Level 2 Bridge Inspection

‣ Although current routine bridge inspections are required to be carried out by certified inspectors, some major issues have been identified: ‣ Visual inspections are subjective and not always reliable ‣  The manual inspection process is time-consuming and costly ‣ A number of safety risks are associated with bridge inspectors

‣ To minimise these limitations, enhanced asset management technologies are significant: ‣  SIAMA is developing an advanced Level 2 bridge Inspection method

‣ Using an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV) in order to collect high quality image data

‣ Using image processing techniques to analyse precise condition status



12

Innovative Bridge/Culvert Asset Management Technology

Step 1 Collecting all bridge component images using UAV/UGV techniques.

Step 2 Analysing data to find defects from three different types of bridge materials using 14 image processing techniques.

Step 3 Generating an inspection report automatically.

‣ 3 Steps of Process D

ata

Man

agem

ent

Dat

a P

roce

ssin

g D

ata

Acq

uisi

tion

SIAMA Condition Assessment

SIAMA automated inspection method

(via UAV, UGV, Crane and Rail)

Raw images

Defect detect software

Analysis outcomes

Engineer’s Supervision

Report condition assessment outcomes

Update to Decision-Support System database (i.e. SIMS Bridges)

Manual (Visual)-based structural inspection

method

Automatic image processing



13

Innovative Bridge Inspection Technology

‣ Step 1: The still images of the bridge components to be assessed are collected using a high-resolution digital camera via the UAV, UGV or mini crane & rail system

‣ Step 2: The captured images are classified based on the element’s identification and location on the bridge. SIAMA’s image processing techniques will be applied to detect various structural defects

‣ Step 3: The evaluated condition state of each element is used to generate the Level 2 Inspection report form (by SIMS Bridges)



14

SIAMA’s Asset Management Technology

SIA

MA

Sho

rt V

ideo

s



15

SIAMA’s Cutting-edge Inspection & Management Technology

Bridge/culvert inspection

§ UAV/UGV: The unmanned aerial and ground

vehicle can easily access hard to reach points of a structure to collect condition data.

Image processing

§  Image processing: Cutting-edge image

processing techniques to precisely detect and evaluate a defect.

Advanced data management/analysis

§ Data management: Advanced BMS, SIMS bridges,

for efficiently managing condition data and to reliably analyse bridge needs.



16

The key to SIAMA’s Smart Data Acquisition Technology lies within the capability of its UAVs (Unmanned Aerial Vehicles) and UGVs (Unmanned Ground Vehicles), which are remotely piloted to capture a detailed and accurate scan of all exposed surfaces.

Smart Data Acquisition Technology (SDAT)‘High-Tech Data Acquisition’



Unmanned Aerial Vehicle (UAV)

17

‣ Captures 60×40cm images from underneath bridge

‣ Precise UAV localisation technique is essential ü  Useful technology for precise vehicle control under

poor satellite support and/or in an indoor environment.

ü  Most challenging part. ü  there will be a large number of adoptable

applications. ü  High global competition by many research institutions



UAV Communication Layout

18



Main Components for Local Positioning System

19

Flight Controller: controls the movement of the UAV.

IMU (Internal Measurement Unit): measures orientation and acceleration of the copter.

Laser Scanners: provides measurements to surrounding objects.

On-board Computer: handles the commotion between the flight controller and the base station.



Inspection Procedure (UAV)

20



Example: SIAMA UAV Local Positioning System - Video

21

•  Indoor flight = No GPS/GNSS support

•  Position hold mode functioning well.

•  Position hold to the target (0:48-1:02 in the short-video).



Unmanned Ground Vehicles (UGVs)

‣ SIAMA’s remote controlled mini UGV is capable of conducting autonomous culvert inspections in confined spaces as low as 1.2 metres in height.

22



Unmanned Ground Vehicles (UGVs)‣  The UGV utilises the same state-of-the-art

scanning and positioning system employed by SIAMA’s UAV to navigate and capture 360-degree surface imagery of the entire length of the culvert.

‣  These images are then paired with distance measurements captured by the UGVs laser sensors to identify and record the exact position of a specific defect.

‣  SIAMA’s UGV system also allows the entire surface of the culvert to be accurately recorded and analysed while maintaining a safe and secure work environment for staff, by eliminating the issues associated with operating in confined spaces. 23



[Top view] [Rear view] 24

UGV Specification

‣ UGV



25

UGV inspection procedure



Example: UGV - Video

26



Mini Crane & Rail System ‘High-Tech Data Acquisition When Flying Isn’t An Option’

‣ As versatile as SIAMA’s UAVs are, there are some situations where using a UAV isn’t a viable option, and for these inspections, SIAMA’s Mini Crane and Rail System is used to perform under-bridge inspection and data collection activities.

27



28

Mini Crane & Rail System

‣ Crane & Rail



29

‣ Mini-Rover

[Front View] [Side View]

Mini Crane & Rail System



30

Crane & Rail Inspection Procedure



31

Field Test (Mini-Crane & Rail System)



32

The benefits of SIAMA’s Enhanced Inspection method

‣ Highly reliable inspection results and an extremely useful input resource for a BMS to reliably analyse various current and future bridge Maintenance, Repair & Rehabilitation (MR&R) needs ‣ Long-term dependable decisions that lead to extending the life span of a

structure and saving rehabilitation cost and time

‣ The process of acquiring condition data and reporting inspection results will be a much faster procedure as it is carried out by automatic processes under manual supervision thus improving productivity

‣ A more economical solution, as there is only a minimal amount of equipment needed



33

Applications - SIAMA’s Data Acquisition Technology

Various Application



34

Smart Image Processing Technology (SIPT)‘State-of-the-Art Image Processing and Analysis’



Smart Image Processing Technology (SIPT)

35

‣  Images captured during the initial data acquisition / inspection phase are processed utilising SIAMA’s state-of-the-art Smart Image Processing Technology (SIPT).

‣ The process selects the appropriate image processing technique and defect mechanism required to detect, identify and analyse the defect type and determine the element condition state.



36

Condition Assessment Using Image Processing Techniques

Concrete material

Steel material

Other material

1.  Cracking; 2.  Corrosion; 3.  Spalling; 4.  Carbonation; 5.  Surface defect; 6.  Alkali-silica reaction (ASR); 7.  Delamination.

1.  Cracking; 2.  Corrosion; 3.  Permanent deformation; 4.  Loose connection

1.  Cracking; 2.  Splitting; Spalling; Disintegration 3.  Loose mortar and stones.

Image Processing Technology

‣ Image Processing Technology - to improve the accuracy, consistency and reliability of analysing and evaluating structural defects.



0.1

Crack Width (mm) 0.

3 0.6

2C, Barriers 2C, Barriers

CS1 CS2 CS3 CS4 Condition States

CS 3

CS 3 CS 1 CS 2

Image Processing

37

‣ Example: Crack detection



38

SIMS Bridges Advanced Bridge Management System



SIMS Bridges

39

Advanced Bridge Management System

‣ SIAMA’s data analysis and management software package, Smart Infrastructure Management System (SIMS) Bridges, provides asset owners with an industry-leading asset condition, management and maintenance decision support tool.



SIMS Bridges

40

High-tech Data Analysis and Management

SIMS Bridges utilises the bridge component condition rating data outputs of SIAMA’s Smart Image Processing Technology (SIPT), to conduct current and future bridge performance analysis at a component, project and network level.

Alternately, asset owners can access the data analysis and Maintenance, Repair and Rehabilitation reporting outputs of SIMS Bridges utilising their own in-house asset inspection and condition rating data.

SIMS Bridges condition rating data assessment and reporting outputs assist asset owners to transition from reactive Maintenance, Repair and Rehabilitation (MR&R) activities towards more cost effective and proactive bridge maintenance strategies.



Enquires

[email protected]

+61 7 5564 5444

+61 7 5564 5446

www.siama.com.au

Follow Us

Documents

Smart Infrastructure Asset Management Australia Research ...solutions.ait.ac.th/wp-content/uploads/2018/06/Day-2-Session-1... · ‣ Unmanned Arial Vehicle (UAV) ‣ Unmanned Ground