Upload
istvan-rath
View
2.227
Download
2
Tags:
Embed Size (px)
DESCRIPTION
This presentation is about a tech demo for EclipseCon Europe 2012. We connect Microsoft Kinect with Eclipse technologies using: - the Jnect plugin for processing Kinect Data - the Eclipse Modeling Framework as the underlying live model representation format - EMF-IncQuery for realtime pattern matching to recognize static gestures - the Esper complex event processor to recognize gesture sequences in the event stream generated by IncQuery. More details at http://viatra.inf.mit.bme.hu/incquery/demos/jnect
Citation preview
Budapest University of Technology and EconomicsDepartment of Measurement and Informa<on Systems
Budapest University of Technology and EconomicsFault Tolerant Systems Research Group
“STANDING QUERIES” Real2me gesture recogni2on with Eclipse technologies
István DÁVID, István RÁTH
hDp://viatra.inf.mit.bme.hu/incquery/demos/jnect
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
Full model update at ~20
FPS
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
PaBern Y() {
}
Full model update at ~20
FPS
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
Full model update at ~20
FPS
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
Full model update at ~20
FPS
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
Event PaBern YMCA
SELECT * FROM paDern[ every(('Y') -‐> ('M') -‐> ('C') -‐> ('A') WHERE 2mer:within(10 sec))]
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
Full model update at ~20
FPS
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
Full model update at ~20
FPS
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
Overview
Kinectsensordata
Live EMF model
EMF-‐IncQuery paDern matcher
Esper complex event
processor
Full model update at ~20
FPS
setX(…)EMF
no2fica2on
PaDern match deltas
User moving in front of the sensor
Recognizedgesture sequences
GEF3D-‐based visualiza2on
PaDern matcher output
CEP output
EMF-‐IncQuery§ High performance incremental paDern matcher
o Provides on-‐the-‐fly model query evalua2on performance for complex queries over very large EMF instance models
o Typical use cases: on-‐the-‐fly valida2on, view maintenance/abstract databinding, derived edges/aDributes, …
§ Coming in the following weeks to Eclipse Modeling§ Version 0.6.7 available from
o The Eclipse Marketplaceo hDp://viatra.inf.mit.bme.hu/incquery
§ Featured at EclipseCon Europe 2012:Fast, Faster and Super-‐fast Model Queries(Ed Willink and István Ráth)