19
Presented By : Reg No: Branch: AEIE 7 th Semester,2008 Purushottam Institute of Engg and Tech

Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

  • Upload
    others

  • View
    20

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Presented By :

Reg No: Branch: AEIE

7th Semester,2008Purushottam Institute of Engg and

Tech

Page 2: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

The operation of multisensor fusion is a process of combining data that is obtained from homogeneous or heterogeneous sensors for certain sensing tasks to gain a broader/deeper and more accurate understanding of the entities of interest than that of uni-sensor sensing.

Example sensing/ tasks include Object/people tracking (3D position and

orientation) SMALLab, mixed reality rehab.,

Gesture recognition Gesture communication

Page 3: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Human Brain

Integrates sensory information to make inferences regarding the surrounding environment.

Page 4: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

• Improved system performance – Improved detection, tracking, and

identification – Improved situation assessment and

awareness • Improved robustness – Sensor redundancy – Graceful degradation • Extended spatial and temporal coverage • Shorter response time • Reduced communication and computing

Page 5: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Detection, location , tracking and identification of military entities.

Sensors: radar, sonar, infrared, synthetic aperture radar (SAR), electro-optic imaging sensors etc.

Complex problem Large number and types of sensors

and targets ƒ Size of the surveillance volume

Real-time operational requirementsSignal propagation difficulties

Page 6: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Air traffic control Law enforcement Homeland security Medical diagnosis Robotics

ManufacturingƒHazardous workplace

Remote sensingƒCropsƒWeather patternsƒEnvironmentƒMineral resourcesƒBuried hazardous waste

Page 7: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Fusion across sensors. a number of sensors nominally measure the same

property, as, for example, a number of temperature sensors measuring the temperature of an object.

Fusion across attributes. a number of sensors measure different quantities

associated with the same experimental situation, as, for example, visual, pressure, sound

Fusion across domains. a number of sensors measure the same attribute over

a number of different ranges or domains, e.g., visual sensing using normal video cameras and IR cameras.

Fusion across time. current measurements are fused with historical

information, for example, from an earlier calibration. Often the current information is not sufficient to determine the system accurately and historical information has to be incorporated to determine the system accurately, for example, in video tracking.

Page 8: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Direct fusion of sensor data

Page 9: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Representation of sensor data via feature vector, with subsequent fusion of feature

vector feature i.e.selection/reduction needs to be done to take care of the curse-of-

dimensionality problem.

Page 10: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Processing of each sensor to achieve high-level inferences or decisions, with

subsequent combination of the high-level results

Page 11: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors
Page 12: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors
Page 13: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors
Page 14: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Wir

ele

ss C

hannel

Without Fusion (Direct )

After Fusion

Page 15: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

� Hand-held units

● Wand-mounted Sensors

• Wide band ground

penetrating radar

(GPR)

• Metal detector (MD)

Page 16: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Video SurveillanceTrackingActivity RecognitionMulti-modal Fusion

• Fusion for Detection/Classification/TrackingWireless Sensor Networks

Vehicle Health Management • Environmental Quality Systems

Page 17: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors. It has a very wide range of applications and hence a require more development in this field.

Page 18: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

G.L. Foresti, C.S. Regazzoni and P.K. Varshney (Eds.), Multisensor

Surveillance Systems : The Fusion Perspective , Kluwer Academic Press, 2003

Center of Excellence in Environmental and Energy Systems (http://eqs.syr.edu/)

Multisensor Data Fusion and Applications Pramod K. Varshney (Department of Electrical

Engineering and Computer Science,Syracuse University)

Page 19: Presented By : 7 Semester,2008 Tech - Latest …...Multisensor fusion and integration is a technique to get a better outpt or result by combining the outputs of more than one Sensors

Questions ???