42
Introduction Approach Pose Estimation using UWB sensor WiFi based Solutions Conclusion IIT Kanpur Low Cost solution for Pose Estimation of Quadrotor [email protected] https://www.iitk.ac.in/aero/mangal/ Intelligent Guidance and Control Laboratory Indian Institute of Technology, Kanpur Mangal Kothari January 7, 2018 IIT Kanpur 1 / 42

Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Low Cost solution for Pose Estimation ofQuadrotor

[email protected]

https://www.iitk.ac.in/aero/mangal/

Intelligent Guidance and Control LaboratoryIndian Institute of Technology, Kanpur

Mangal Kothari January 7, 2018 IIT Kanpur 1 / 42

Page 2: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Outline

Introduction

Approach

Pose Estimation using UWB sensor

WiFi based Solutions

Conclusion

Mangal Kothari January 7, 2018 IIT Kanpur 2 / 42

Page 3: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Introduction

• Our goal is to make robust systems capable of Navigating inGPS denied environments.

• Exploring the enormous scope of Indoor Navigation(Surveillance, Disaster Management or systems for firstresponse).

• System which can be used Ubiquitously overcomingnonuniform environmental conditions.

Mangal Kothari January 7, 2018 IIT Kanpur 3 / 42

Page 4: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Introduction

Why No to GPS!!

• GPS signal are highly dependent on the operating conditions.

Localization• The major milestone for autonomous navigation is localization.

• Recently, SLAM based techniques are showing promisingresults.

• Our major focus is on localization working on range basedsensors like UWB, Wi-Fi and augment with IMU(accelerometer, gyroscope and magnetometer) and opticalflow camera.

Mangal Kothari January 7, 2018 IIT Kanpur 4 / 42

Page 5: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Previous approaches

Attitude estimation• Estimation of IMU and MARG orientation using a gradient

descent algorithm (Madgwik, 2011).

• Experimental comparison of sensor fusion algorithms forattitude estimation (Cavallo, 2014).

SLAM approaches

• ORB-SLAM: a versatile and accurate monocular SLAMsystem (Mur-Artal, 2015).

• Towards a navigation system for autonomous indoor flying(Grzonka, 2009). A laser based SLAM approach.

Mangal Kothari January 7, 2018 IIT Kanpur 5 / 42

Page 6: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Previous approaches

Challenges

• Vision and Lidar SLAM approaches require sensor with heavypayload and are computationally inefficient.

• The attitude estimation approaches are computationallyefficient citing the usage of micro-controllers, but losesaccuracy.

Our approach

• We make use of on-board computers along with bringingdown the computation involved in SLAM processes andassigning more computation to attitude estimation.

Mangal Kothari January 7, 2018 IIT Kanpur 6 / 42

Page 7: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Our Approach

Why range based solutions (UWB sensors)

• Payload efficient: requires just 25-30gm of additional payload.

• Processing efficient: SLAM based solutions require highercomputational cost which in process requires powerful andheavy processors.

• Cost efficient: These solutions are cheaper. Wifi systems arebecoming common to lots of Places.

Mangal Kothari January 7, 2018 IIT Kanpur 7 / 42

Page 8: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Pose Estimation using UWB sensor

• An EKF based solution to estimate the position and attitudeof the system.

• Uses gyroscope, accelerometer and magnetometer data forquaternion estimation.

• Fusion of Sonar with accelerometer for height estimation.

• Fusion of velocity from optical flow camera with theaccelerometer data for position estimation.

• A SLAM based approach for the UWB sensor positionestimation and simultaneously correcting for system’s position.

Mangal Kothari January 7, 2018 IIT Kanpur 8 / 42

Page 9: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Quaternion Estimates

• Gyroscopic data is main input in the prediction step of theKalman fusion process for acquiring quaternion.

• Gyroscopic data suffers from bias and an integrating solutioncan thus result in erroneous output in long run.

• Assuming that the accelerometer data in the body framewhen operated by the predicted quaternion will result ingravity vector.

• Thus the accelerometer serve as measurement correction.

Mangal Kothari January 7, 2018 IIT Kanpur 9 / 42

Page 10: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Quaternion Estimates

Prediction Step for Quaternion

Sω = [0 ωx ωy ωz ] , q =1

2q ⊗ Sω

qω,t =1

2qω,t−1 ⊗ Sω, qω,t = qω,t−1 + qω,t∆t

Accelerometer Update

Eg = [0 0 0 1], Ba = [0 ax ay az ]

Ba = q∗ω,t ⊗ Ebg ⊗ qω,t

ea = z − za =

ax − 2(q1q3 − q0q2)ay − 2(q0q1 + q2q3)az − 2(12 − q21 − q22)

Mangal Kothari January 7, 2018 IIT Kanpur 10 / 42

Page 11: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Quaternion Estimates

Accelerometer transformation

ab =

cosθcosψ cosθsinψ −sinθ−cosφsinψ + sinφsinθcosψ cosθcosψ + sinφsinθsinψ sinφcosθsinφsinψ + cosφsinθcosψ −sinφcosψ + cosφsinθsinψ cosφcosθ

001

Magnetometer Update

• The accelerometer however cannot correct for the yaw motionas the rotation about yaw parallels the gravity direction.

• Based on the magnetic field of the earth we can find the northdirection.

• Our approach uses a Magnetic distortion compensation model(Madgwick’s AHRS) for the yaw estimation.

Mangal Kothari January 7, 2018 IIT Kanpur 11 / 42

Page 12: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Quaternion Estimates

Magnetometer Measurement Update

Bm = [0 mx my mz ]

Eh = [0 hx hy hz ] = qBE ⊗ Bm ⊗ q∗BE

Eb =[0

√h2x + h2y 0 hz

]= [0 bx 0 bz ]

em = z − zm =

mx − 2bx(12 − q22 − q23) + 2bz(q1q3 − q0q2)my − 2bx(q1q2 − q0q3) + 2bz(q0q1 + q2q3)mz − 2bx(q0q2 + q1q3) + 2bz(12 − q21 − q22)

Mangal Kothari January 7, 2018 IIT Kanpur 12 / 42

Page 13: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Quaternion Estimates EKF

State Vector and Observation Vector

νt =[q0 q1 q2 q3 mx my mz x y z Vx Vy Vz xd yd zd

]Tt

zt =[ax ay az mx my mz Vx ,B Vy ,B hB R

]Tt

Measurement Update

zMARG =

[zazm

]KMARG = HMARG Σ(HMARG ΣHT

MARG + Q)

νt = νt + K (z − z)

Σt = (I − KMARGHMARG )Σt

Mangal Kothari January 7, 2018 IIT Kanpur 13 / 42

Page 14: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (roll)

Figure: Estimated roll

Mangal Kothari January 7, 2018 IIT Kanpur 14 / 42

Page 15: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (roll)

Figure: Estimated roll

Mangal Kothari January 7, 2018 IIT Kanpur 15 / 42

Page 16: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (pitch)

Figure: Estimated pitch

Mangal Kothari January 7, 2018 IIT Kanpur 16 / 42

Page 17: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (pitch)

Figure: Estimated pitch

Mangal Kothari January 7, 2018 IIT Kanpur 17 / 42

Page 18: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (yaw)

Figure: Estimated yaw

Mangal Kothari January 7, 2018 IIT Kanpur 18 / 42

Page 19: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (yaw)

Figure: Estimated yaw

Mangal Kothari January 7, 2018 IIT Kanpur 19 / 42

Page 20: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (yaw)

Figure: Estimated yaw

Mangal Kothari January 7, 2018 IIT Kanpur 20 / 42

Page 21: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (yaw)

Figure: Estimated yaw

Mangal Kothari January 7, 2018 IIT Kanpur 21 / 42

Page 22: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates (yaw)

Figure: Estimated yaw

Mangal Kothari January 7, 2018 IIT Kanpur 22 / 42

Page 23: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Attitude estimates

• The roll, pitch and yaw estimates approximates the groundtruth results.

• The roll and pitch estimates show better results as comparedto Madgwick’s AHRS.

• The convergence of yaw estimates are fast as compared topixhawk’s EKF.

• The magnetic distortion compensation does not require userpredefined direction.

Mangal Kothari January 7, 2018 IIT Kanpur 23 / 42

Page 24: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Position Estimation

• Fusion of accelerometer data with the raw velocitymeasurement from optical flow camera.

• All vision based solution suffer from drift and in the long rundiverges from ground truth results.

• However, for short duration flights result accuracy matchesvision based ORB SLAM solution.

Mangal Kothari January 7, 2018 IIT Kanpur 24 / 42

Page 25: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Position Estimation

• Fusing the Sonar data and the accelerometer data along withquaternion operations to account for non linearity.

• Sonar data is precise with an accuracy of ± 5cm but suffersfrom irregularities.

• High dependence on sonar can lead to noisy and inaccurateestimates of height.

• We pass the sonar raw estimates through a median filter,which sorts out the outlier values.

Mangal Kothari January 7, 2018 IIT Kanpur 25 / 42

Page 26: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Position Estimation

Prediction Update

xt = xt−1 + Vt−1∆t

Vt = Vt−1 + (REB a− [0, 0, g ]T )∆t

Measurement Update

zPX4 =

Vx ,BVy ,Bν(10)t

(q20+q23−q21−q22)

KPX4 = HPX4Σ(HPX4ΣHT

PX4 + Q)

νt = νt + KPX4(zPX4 − zPX4)

Σt = (I − KPX4HPX4)ΣtMangal Kothari January 7, 2018 IIT Kanpur 26 / 42

Page 27: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Height Estimation

Figure: Estimated Height

Mangal Kothari January 7, 2018 IIT Kanpur 27 / 42

Page 28: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Height Estimation

Figure: Estimated Height

Mangal Kothari January 7, 2018 IIT Kanpur 28 / 42

Page 29: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Height Estimation

Figure: Estimated Height

Mangal Kothari January 7, 2018 IIT Kanpur 29 / 42

Page 30: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Position Estimation

Figure: Estimated Position Only px4flow vs ORB SLAM

Mangal Kothari January 7, 2018 IIT Kanpur 30 / 42

Page 31: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Range Only SLAM

• Range only data does not allow the other UWB sensor to belocalized until we have accurate estimate of system position.

• Our approach make use of velocity-accelerometer fusion forinitial measurements.

• Once the system is able to localize the UWB sensor the weighton the estimates from the UWB sensor is given more weight.

Mangal Kothari January 7, 2018 IIT Kanpur 31 / 42

Page 32: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Range Only SLAM

zD =√

(vt(8) − vt(14))2 + (vt(9) − vt(15))2 + (vt(10) − vt(16))2

KD = HDΣ(HDΣHTD + Q)

νt = νt + KD(zD − zD)

Σt = (I − KDHD)Σt

Mangal Kothari January 7, 2018 IIT Kanpur 32 / 42

Page 33: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Position Estimation

Figure: Position Estimate

Mangal Kothari January 7, 2018 IIT Kanpur 33 / 42

Page 34: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Position Estimation

Figure: Position Estimate

Mangal Kothari January 7, 2018 IIT Kanpur 34 / 42

Page 35: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Position Estimation

0

5 −4−20246810

−3

−2

−1

0

1

2

3

Y (m)

X (m)

Z (

m)

Ground Truth for Quadrotor

External UWB range sensor pose

External UWB sensor true location

EKF

Figure: Position Estimate

Mangal Kothari January 7, 2018 IIT Kanpur 35 / 42

Page 36: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Wifi Triangulation for Localization

• Better initialization of router position leads to better accuracyin position estimates.

• First interval involves data gathering and applying leastsquares to estimate router positions.

• The estimate router position serve as an initial guess to theEKF.

Mangal Kothari January 7, 2018 IIT Kanpur 36 / 42

Page 37: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Figure: EKF Localization

Mangal Kothari January 7, 2018 IIT Kanpur 37 / 42

Page 38: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Figure: EKF SLAM

Mangal Kothari January 7, 2018 IIT Kanpur 38 / 42

Page 39: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

WiFi RSSI Fingerprinting

• A pre-calibration is done to extract a fingerprint of the RSSIsignal.

• Based on the distribution we extract the position estimates.

• KNN and WKNN methods are used applying discrete orguassian distribution.

Mangal Kothari January 7, 2018 IIT Kanpur 39 / 42

Page 40: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Figure: Data Gathering

Mangal Kothari January 7, 2018 IIT Kanpur 40 / 42

Page 41: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Figure: EKF Localization

Mangal Kothari January 7, 2018 IIT Kanpur 41 / 42

Page 42: Low Cost solution for Pose Estimation of Quadrotor...ow camera. All vision based solution su er from drift and in the long run diverges from ground truth results. However, for short

IntroductionApproach

Pose Estimation using UWB sensorWiFi based Solutions

ConclusionIIT Kanpur

Conclusion

• We presented solutions which do not require highcomputation cost.

• The presented sensor solutions are light weight allowing UAVsto have higher payload.

• The performance of the solution performs comparable to thestate of the art techniques.

Mangal Kothari January 7, 2018 IIT Kanpur 42 / 42