29
Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored by Laurent Grisoni 2010

Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

Internship at INRIA laboratory LIFL

Manipulating curves by innovativeplastic multitouch interactions

Yoann Bourse,Mentored by Laurent Grisoni

2010

Page 2: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Presentation plan

1 Motivation

2 HighlightsCurve and interpolationIntuitive and immersive experienceShape maintaining

3 ImplementationSoftware designFeatures

4 Demonstration

5 Conclusion

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 3: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Motivation

Gap between final users :

Need to control the variations of a parameter

With various mathematical knowledge

and technical tools

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 4: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

The project : Curve editor

Curve creation and manipulation

No mathematics visible

Innovative plastic manipulations

Immersion through multitouchinteractions

User-intent driven

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 5: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

1D curve

Variation of one parameter in respect to another one (time)=⇒ sorted list of Y-coordinates, indexed by X-coordinates

Overwriting paradigm

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 6: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Dealing with input frequency

Sampled list of positions of afinger=⇒ irregular, not precise.

Pointing : erasing surrounding area

Moving : erasing since last position

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 7: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Cardinal spline interpolation

Smooth join of user inputted points=⇒ Cardinal spline interpolation by hermite polynomials.

Keypoints with coordinates plus tangents=⇒ Sequence of 2nd degree polynomials

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 8: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Keeping only necessary keypoints

KeyPoints = [] ;OriginPoly = PreviousPoint = DrawnPoints.First () ;foreach (CurrentPoint in DrawnPoints) {

Check that all the points in [ OriginPoly ; CurrentPoint ]are close to their value in H(OriginPoly, CurrentPoint)Else {

Add PreviousPoint to KeyPoints ;OriginPoly = PreviousPoint ;

}PreviousPoint = CurrentPoint ;

}Add DrawnPoints.Last () to KeyPoints ;

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 9: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Shape manipulation

Michael Leyton’s ”Shape Form Deformation” theory :

Initial drawing of a simple shape

Sequence of manipulations

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 10: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Light interface

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 11: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Light interface

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 12: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Constant visual feedback

Every user action provides a notification

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 13: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Constant visual feedback

Every user action provides a notification

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 14: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Levels of expertise

Beginner/expert paradigm

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 15: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Dealing with occlusion

Gain visibility over the action

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 16: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Dealing with occlusion

Gain visibility over the action

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 17: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

User intent determination

Implicit determination in context and in real time thanks to :

Number and position of finger down

Recent absolute or relative movement of fingers

Drawing buffer for indeterminated states

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 18: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Manipulation attenuation

Linear attenuation

Elastic attenuation to maintain the 1D invariant(symmetrical around the center) :Moderation factor

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 19: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Attenuation algorithm in a nutshell

Before manipulation :

T goes towards the left :

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 20: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Curve and interpolationIntuitive and immersive experienceShape maintaining

Attenuation algorithm in a nutshell

Before manipulation :

T goes towards the right :

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 21: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Software designFeatures

Software design

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 22: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Software designFeatures

Features

Axes manipulation : stretching, translating...

Curve drawing

Curve translating

Various inovative plastic manipulations...

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 23: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Software designFeatures

Stretching

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 24: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Software designFeatures

Sanding

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 25: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Software designFeatures

Rotating

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 26: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Software designFeatures

Pulling

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 27: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Software designFeatures

Ball manipulation

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 28: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Demonstration

No multitouch computer available, but a presentation video.

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions

Page 29: Internship at INRIA laboratory LIFL - Yoann Bourse · Internship at INRIA laboratory LIFL Manipulating curves by innovative plastic multitouch interactions Yoann Bourse, Mentored

MotivationHighlights

ImplementationDemonstration

Conclusion

Conclusion

Immediate link between the user and the computer :A fixed finger pinpoints the curve, a moving finger drags it.

Intuitive immersive experience thanks to the optimal useof the multitouch interface

Yoann Bourse, Mentored by Laurent Grisoni Manipulating curves by innovative plastic multitouch interactions