Activity Report 2015

Team Mjolnir

Computing tools to empower usersInria teams are typically groups of researchers working on the definition of a common project,and objectives, with the goal to arrive at the creation of a project-team. Such project-teams mayinclude other partners (universities or research institutions).

RESEARCH CENTERLille - Nord Europe

THEMEInteraction and visualization

Table of contents

1. Members . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12. Overall Objectives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

2.1. Introduction 22.2. Computers as tools 22.3. Tools supporting transparent use 22.4. But tools also designed for analytic use 2

3. Research Program . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33.1. Introduction 33.2. Leveraging human control skills 33.3. Leveraging human perceptual skills 33.4. Leveraging human learning skills 4

4. Application Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45. Highlights of the Year . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46. New Software and Platforms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

6.1. Introduction 46.2. Libpointing 56.3. Liblag 56.4. Mouse-based lagmeter 5

7. New Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57.1. Introduction 57.2. HCI models, theories, and frameworks 57.3. Transfer functions and latency 67.4. Interaction techniques 77.5. Interactive visualization 87.6. Adaptive interfaces 8

8. Partnerships and Cooperations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98.1. National initiatives 9

8.1.1. Turbotouch (ANR, 2014-2018) 98.1.2. ParkEvolution (Carnot Inria - Carnot STAR, 2015-2016) 108.1.3. BCI-LIFT (Inria Project Lab, 2015-2019) 10

8.2. European initiatives 108.2.1. Happiness (H2020-ICT-2014-1/ICT-03-2014/RIA, 2015-2018) 108.2.2. Mjolnir/UCLIC associate team (Inria Lille, 2015-2017) 10

8.3. International initiatives 118.4. International research visitors 11

8.4.1. Visits of international scientists 118.4.2. Visits to international teams 11

9. Dissemination . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119.1. Promoting scientific activities 11

9.1.1. Scientific events organisation 119.1.2. Scientific events selection 119.1.3. Journal 129.1.4. Scientific expertise 129.1.5. Research administration 129.1.6. Learned societies 139.1.7. Hiring committees 13

9.2. Teaching, supervision, juries 139.2.1. Teaching 139.2.2. Supervision 13

2 Activity Report INRIA 2015

9.2.3. Juries 149.3. Popularization 14

10. Bibliography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15

Team Mjolnir

Creation of the Team: 2015 January 01

Keywords:

Computer Science and Digital Science:5.1. - Human-Computer Interaction5.1.1. - Engineering of interactive systems5.1.2. - Evaluation of interactive systems5.1.3. - Haptic interfaces5.1.4. - Brain-computer interfaces, physiological computing5.2. - Data visualization5.5.4. - Animation5.6. - Virtual reality, augmented reality

Other Research Topics and Application Domains:1.1.5. - Genetics2.2.2. - Nervous system and endocrinology2.8. - Sports, performance, motor skills6.1.1. - Software engineering6.5. - Information systems9.2.1. - Music, sound

1. MembersResearch Scientists

Nicolas Roussel [Team leader, Inria, Senior Researcher, HdR]Stéphane Huot [Inria, Senior Researcher, HdR]Fanny Chevalier [Inria, Researcher]Sylvain Malacria [Inria, Researcher]

Faculty MembersGéry Casiez [Université Lille 1, Professor, HdR]Thomas Pietrzak [Université Lille 1, Assistant Professor]

EngineersMatthieu Falce [Inria, until June 2015]Izzatbek Mukhanov [Inria]Sébastien Poulmane [Inria, from November 2015]

PhD StudentsJonathan Aceituno [Inria]Justin Mathew [Inria]Alix Goguey [Inria]Amira Chalbi [Inria]Thibault Raffaillac [Inria, from November 2015]

Post-Doctoral FellowTakashi Miyaki [Inria, until May 2015]

Visiting Scientists

2 Activity Report INRIA 2015

Jeronimo Barbosa [McGill University, from November to December 2015]Mathieu Nancel [University of Waterloo, from March to April 2015]Aakar Gupta [University of Toronto, from Feb 2015 until May 2015]

Administrative AssistantKarine Lewandowski [Inria]

2. Overall Objectives

2.1. IntroductionHuman-Computer Interaction (HCI) is a constantly moving field. Changes in computing technologies extendtheir possible uses and modify the conditions of existing ones. People also adapt to new technologies andadapt them to their own needs. Different problems and opportunities thus regularly appear. Over the recentyears, though, we believe incremental news have unfortunately eclipsed fundamental HCI topics on which alot of work remains to be done. In what follows, we summarize the essential elements of our vision and theassociated long-term goals.

2.2. Computers as toolsIn the early 1960s, at a time where computers were scarce, expensive, bulky and formal-scheduled machinesused for automatic computations, Engelbart saw their potential as personal interactive resources. He saw themas tools, as things we would purposefuly use to carry out particular tasks [31]. Others at the same time hada different vision. They saw computers as partners, intelligent entities to whom we would delegate tasks.These two visions constitute the roots of today’s predominant human-computer interaction paradigms, useand delegation. Our focus is on computer users and our work should ultimately benefit them. Our interest isnot in solving the difficult problems related to machine understanding. It is not in what machines understand,but in what people can do with them. Instead of intelligent systems, we aim for systems supporting intelligentuse and empowering people. We do not reject the delegation paradigm but clearly favor the one of tool use.

2.3. Tools supporting transparent useTechnology is most empowering when it is transparent. But the transparent tool is not the one you cannotsee, it is the one invisible in effect, the one that does not get into your way but lets you focus on the task.Heidegger used the term zuhanden (ready-to-hand) to characterize this unobtruded relation to things [32].Transparency of interaction is not best achieved with tools mimicking human capabilities, but with thosetaking full advantage of them and fitted to the context and task. Our actions towards the digital world need to bedigitized, and the digital world must provide us with proper feedbacks in return. Input and output technologiespose inevitable constraints while the digital world calls for more and more sophisticated perception-actioncouplings for increasingly complex tasks. We want to study the means currently available for perception andaction in the digital world. We understand the important role of the body on the human side, and the importanceof hardware elements on the computer side. Our work thus follows a systems approach encompassing theseelements and all the software layers above, from device drivers to applications.

2.4. But tools also designed for analytic useEngelbart believed in the coevolution of humans and their tools. He was not just interested in designing apersonal computer but also in changing people, to radically improve the way we manage complexity. Thehuman side of this coevolutionary process has been largely ignored by the computing industry which hasfocused on the development of walk-up-and-use interfaces for novice users. As a result of this focus on initialperformance, we are trapped in a “beginner mode” of interaction with a low performance ceiling [7]. Peoplefind it acceptable to spend considerable amounts of time learning and practising all sorts of skills. We want totap into these resources to develop digital skills. We must accept that new powerful tools might not support

Team Mjolnir 3

immediate transparent use and thus require attention. Heidegger used the term vorhanden (present-at-hand)to characterize the analytic relation to things that not only occurs when learning about them, but also whenhandling breakdowns, when they change or need to be adapted, or when teaching others how to use them.Analytic use is unavoidable and its interplay with transparent use is essential to tool accommodation andappropriation [30]. We want to study this interplay.

3. Research Program

3.1. IntroductionOur research program is organized around three main themes: leveraging human control skills, leveraginghuman perceptual skills, and leveraging human learning skills.

3.2. Leveraging human control skillsOur group has developed a unique and recognized expertise in transfer functions, i.e. the algorithmictransformations of raw user input for system use. Transfer functions define how user actions are taken intoaccount by the system. They can make a task easier or impossible and thus largely condition user performance,no matter the criteria (speed, accuracy, comfort, fatigue, etc). Ideally, the transfer function should be chosenor tuned to match the interaction context. Yet the question of how to design a function to maximize one ormore criteria in a given context remains an open one, and on-demand adaptation is difficult because functionsare usually implemented at the lowest possible level to avoid latency problems. Latency management andtransfer function design are two problems that require cross examination to improve human performance withinteractive systems. Both also contribute to the senses of initiation and control, two crucial component of thesense of agency [33]. Our ultimate goal on these topics is to adapt the transfer function to the user and taskin order to support stable and appropriate control. To achieve this, we investigate combinations of low-level(embedded) and high-level (application) ways to take user capabilities and task characteristics into accountand reduce or compensate for latency in different contexts, e.g. using a mouse or a touchpad, a touch-screen,an optical finger navigation device or a brain-computer interface.

3.3. Leveraging human perceptual skillsOur work under this theme concerns the physicality of human-computer interaction, with a focus on hapticperception and related technologies, and the perception of animated displays.

Vibrators have long been used to provide basic kinesthetic feedback. Other piezoceramic and electro-activepolymer technologies make it possible to support programmable friction or emboss a surface, and thin, organictechnologies should soon provide transparent and conformable, flexible or stretchable substrates. We want tostudy the use of these different technologies for static and dynamic haptic feedback from both an engineeringand an HCI perspective. We want to develop the tools and knowledge required to facilitate and inform thedesign of future haptic interactions taking best advantage of the different technologies.

Animations are increasingly common in graphical interfaces. Beyond their compelling nature, they are pow-erful tools that can be used to depict dynamic data, to help understand time-varying behaviors, to commu-nicate a particular message or to capture attention. Yet despite their popularity, they are still largely under-comprehended as cognitive aids. While best practices provide useful directions, very little empirical researchexamine different types of animation, and their actual benefits and limitations remain to be determined. Wewant to increase current knowledge and develop the tools required to best take advantage of them.

4 Activity Report INRIA 2015

3.4. Leveraging human learning skillsBy looking at ways to leverage human control and perceptual skills, the research yet proposed mainly aims atimproving perception-action coupling to better support transparent use. This third research theme addressesthe different and orthogonal topic of skill acquisition and improvement. We want to move away from theusual binary distinction between “novices” and “experts” and explore means to promote and assist digitalskill development in a more progressive fashion. We are interested in means to support the analytic use ofcomputing tools. We want to help people become aware of the particular ways they use their tools, the otherways that exist for the things they do, and the other things they might do. We want to help them increasetheir performance by adjusting their current ways of doing, by providing new and more efficient ways, andby facilitating transitions from one way to another. We are also interested in means to foster reflection amongusers and facilitate the dissemination of best practices.

4. Application Domains

4.1. Application DomainsMjolnir works on fundamental aspects of Human-Computer Interaction that can be applied to diverseapplication domains. Our 2015 research concerned desktop, touch-based and mobile interfaces with notableapplications to 3D animation, 2D illustration, clinical diagnosis and TV viewing experience.

5. Highlights of the Year

5.1. Highlights of the YearThe team has strengthened its ties with leading research groups in Canada:

• Fanny Chevalier has been appointed at the rank of Assistant Professor (status only) by the Depart-ment of Computer Science of the University of Toronto.

• Stéphane Huot has been granted the “Collaborator” status by the Centre for InterdisciplinaryResearch in Music Media and Technology (CIRMMT) of McGill University.

• Mitacs/Inria research awards allowed two of our Phd students to visit the University of Waterlooand McGill University. A third Mitacs award with Campus France will allow one PhD student fromCarleton University to visit us in early 2016.

• Two other PhD students and three researchers from McGill University, the University of Waterlooand the University of Toronto visited us over the year.

Fanny Chevalier spent a week with the French news website Rue89 in October and one of their journalists(Benoît Le Corre) later spent one week at Inria Lille. Four articles published on Rue89 resulted from thesevisits, with over 40,000 views at the time of this writing.

6. New Software and Platforms

6.1. IntroductionEach software listed below is characterized according to the criteria for software self-assessment proposedby Inria’s Evaluation Committee. Note that the only software mentioned here are those that were created orsignificantly modified during the year.

Team Mjolnir 5

6.2. LibpointingParticipants: Géry Casiez [correspondent], Nicolas Roussel, Izzatbek Mukhanov, Sébastien Poulmane.

Libpointing is a software toolkit that provides direct access to HID pointing devices and supports the designand evaluation of pointing transfer functions [3]. The toolkit provides resolution and frequency informationfor the available pointing and display devices and makes it easy to choose between them at run-time throughthe use of URIs. It allows to bypass the system’s transfer functions to receive raw asynchronous events fromone or more pointing devices. It replicates as faithfully as possible the transfer functions used by MicrosoftWindows, Apple OS X and Xorg (the X.Org Foundation server). Running on these three platforms, it makes itpossible to compare the replicated functions to the genuine ones as well as custom ones. The toolkit is writtenin C++ with Python, Java and Node.js bindings available (about 49,000 lines of code in total). It is publiclyavailable under the GPLv2 license.

The library has been thoroughly improved in 2015. Notable changes concern the management of pointingdevices and displays, the standardization of URIs on all platforms, HID reports parsing on Linux and OS X, theintegration of floating pixel coordinates and subpixel interaction [34], the improvement of existing bindingsand the addition of Node.js ones, and support for Web browser integration.

Web site: http://libpointing.org/

Software characterization: [A-3] [SO-3] [SM-2] [EM-2↑] [SDL-5]

6.3. LiblagParticipants: Géry Casiez [correspondent], Matthieu Falce, Nicolas Roussel.

Liblag is a software toolkit designed to support the comparison of latency compensation techniques. Thetoolkit notably includes a playground application that allows to compare different trajectory predictionalgorithms on desktop (OS X and Ubuntu) and mobile (iOS and Android) systems. The source code for thistoolkit (about 8,500 lines of code) is only available to Turbotouch partners for now.

Software characterization: [A-1] [SO-4] [SM-1] [EM-2] [SDL-1]

6.4. Mouse-based lagmeterParticipants: Géry Casiez [correspondent], Stéphane Huot, Matthieu Falce, Nicolas Roussel.

As part of the work reported in [18], we implemented our mouse-based method for measuring end-to-endlatency using Java/Swing, C++/GLUT, C++/Qt and JavaScript/HTML5. We also wrote Python scripts to parsethe logs generated by these implementations in order to compare them. This software (about 2,500 lines ofcode) should be made available in 2016.

Software characterization: [A-1] [SO-4] [SM-1] [EM-2] [SDL-1]

7. New Results

7.1. IntroductionThe following sections summarize our main results of the year. For a complete list, see the list of publicationsat the end of this report.

7.2. HCI models, theories, and frameworksParticipants: Géry Casiez, Alix Goguey, Stéphane Huot.

6 Activity Report INRIA 2015

Pointing is one of the most common and frequent action made with any interactive system whether it be adesktop computer, a mobile device or a wall-size display. Although it has been extensively studied in HCI,current pointing techniques provide no adequate way to select very small objects whose movements are fastand unpredictable, and theoretical tools –such as Fitts’ law-– do not model unpredictable motion. To informthe design of appropriate selection techniques, we studied human performance (speed and accuracy) whenselecting moving objects in a 2D environment with a standard mouse. We characterized selection performanceas a function of the predictability of the moving targets, based on three parameters: the speed (S) of the target,the frequency (F) at which the target changes direction, and the amplitude (A) of those direction changes. Ourresults show that for a given speed, selection is relatively easy when A and F are both low or high, and difficultotherwise [22].

In spite of previous work showing the importance of understanding users’ strategies when performing tasks,HCI researchers comparing interaction techniques remain mainly focused on performance. This can beexplained to some extent by the difficulty to characterize users’ strategies. To alleviate this problem, weintroduced new metrics to quantify if an interaction technique introduces an object or command-orientedstrategy, i.e. if users favor completing the actions on an object before moving to the next one, or in contrast,if they are reluctant to switch between commands [21]. Through a study comparing two novel interactiontechniques with two from the literature, we showed that our metrics allow to replicate previous findings onusers’ strategies concerning the latter.

To our knowledge, there are no general design and evaluation methodologies available for the development ofdigital musical instruments (DMI). One reason is the large diversity of design and evaluation contexts possiblein musical interaction, e.g. is this evaluation done from the perspective of the DMI designer/manufacturer,the musician playing it, or the audience watching it be performed? With our collaborators of the MIDWAYassociate team, we have analyzed all papers and posters published in the proceedings of the NIME conferencefrom 2012 to 2014 [16]. For each publication that explicitly mentioned the term “evaluation”, we looked for: a)What targets and stakeholders were considered? b) What goals were set? c) What criteria were used? d) Whatmethods were used? e) How long did the evaluation last? Results show different understandings of evaluation,with little consistency regarding the usage of the word. Surprisingly in some cases, not even basic informationsuch as goal, criteria and methods were provided. Beyond the attempt to provide an idea of what “evaluation”means for the NIME community, we pushed the discussion towards how we could make a better use of it andwhat criteria should be used regarding each goal.

7.3. Transfer functions and latencyParticipants: Géry Casiez, Alix Goguey, Stéphane Huot, Sylvain Malacria, Nicolas Roussel.

Our work on transfer functions mainly focused this year on edge-scrolling, which allows users to scroll aviewport while simultaneously dragging near or beyond its edge. Common implementations rely on ratecontrol, mapping the distance between the pointer and the edge of the viewport to the scrolling velocity.While ubiquitous in operating systems, edge-scrolling had received little attention, though previous workssuggested that rate control may be suboptimal for isotonic pointing devices (e.g. mice and touchpads) andspace beyond the window’s edge might be scarce, limiting scrolling control. To address these problems,we developed Push-Edge and Slide-Edge two position-based techniques that allow scrolling by “pushing”against the viewport edge [23]. A controlled experiment shows that our techniques reduce overshoots andoffer performance improvements up to 13% over traditional edge-scrolling.

Our work on latency focused on its measurement in existing graphical user interfaces, a problem for whichwe developed a simple method [18], [27]. Our method consists in positioning an unmodified optical mouseon the screen while displaying and translating a particular texture to fake mouse displacements, which resultsin controlled mouse events. This works with most optical mice and allows accurate and real-time latencymeasures up to 5 times per second. The method also allows easy insertion of probes at different places inthe system to investigate the sources of latency. Measurements performed on different systems, toolkits andapplications notably showed that latency is affected by the operating system and system load. Substantialdifferences were also found between C++/GLUT and C++/Qt or Java/Swing implementations, as well asbetween Web browsers.

Team Mjolnir 7

kitchen when the lie-noNothing that any landlady could do had a real terror for him.

The cat was sitting in the kitchen when the lie-no decided, rather than being

CHAPTER 2

kitchen when the lie-noNothing that any landlady could do had a real terror for him.

The cat was sitting in the kitchen when the lie-no decided, rather than being

CHAPTER 2

kitchen when the lie-noNothing that any landlady could do had a real terror for him.

The cat was sitting in the kitchen when the lie-no decided, rather than being

CHAPTER 2

H e h a d b e c o m e s o completely absorbed in himself, and isolated from his fellows that he dreaded meeting, not only his landlady, but anyone at all. H e w a s c r u s h e d b y poverty, but the anxieties

H e h a d b e c o m e s o completely absorbed in himself, and isolated from his fellows that he dreaded meeting, not only his landlady, but anyone at all. H e w a s c r u s h e d b y poverty, but the anxieties

H e h a d b e c o m e s o completely absorbed in himself, and isolated from his fellows that he dreaded meeting, not only his landlady, but anyone at all. H e w a s c r u s h e d b y poverty, but the anxieties

H e h a d b e c o m e s o completely absorbed in himself, and isolated from his fellows that he dreaded meeting, not only his landlady, but anyone at all. H e w a s c r u s h e d b y poverty, but the anxieties

H e h a d b e c o m e s o completely absorbed in himself, and isolated from his fellows that he dreaded meeting, not only his landlady, but anyone at all. H e w a s c r u s h e d b y poverty, but the anxieties

H e h a d b e c o m e s o completely absorbed in himself, and isolated from his fellows that he dreaded meeting, not only his landlady, but anyone at all. H e w a s c r u s h e d b y poverty, but the anxieties

H e h a d b e c o m e s o completely absorbed in himself, and isolated from his fellows that he dreaded meeting, not only his landlady, but anyone at all. H e w a s c r u s h e d b y poverty, but the anxieties

Press Drag Hold stillPress Drag Hold still time time

CHAPTER 1On an exceptionally hot evening early in July a young man came out of the garret in which he lodged in S. Place and walked slowly, as though in

CHAPTER 1On an exceptionally hot evening early in July a young man came out of the garret in which he lodged in S. Place and walked slowly, as though in

pointer stopped at edge

MANUAL SCROLLING

EXISTING RATE-BASED EDGE-SCROLL TECHNIQUES PUSH-EDGE SCROLLINGbaAUTOMATIC SCROLLING

AUTOMATIC SCROLLING

Figure 1. When selecting text with a touchpad, downward movements after crossing the viewport edge will (a)change the rate of automatic scrolling with existing techniques (rate control); or (b) manually scroll the document,

stopping the pointer at the edge with push-edge scrolling (position control).

7.4. Interaction techniquesParticipants: Géry Casiez, Stéphane Huot, Sylvain Malacria.

While touchpads are both widespread and expressive input devices, there has been surprisingly little researchregarding how they could be used for more than simple pointer movements. In [17], we explore the designspace of gesture shortcuts on touchpads and introduce four novel interaction techniques. SpotPad and LociPadrely on one-finger static gestures, but differ in their graphical representation. ChordPad relies on two-fingerstatic gestures with a hierarchical representation. Finally, InOutPad relies on dynamic gestures crossing theedges of the touchpad. We compare the properties of these four interaction techniques and describe how theycan be deployed on OS X.

The hands of virtual characters are highly complex 3D models that can be tedious and time-consuming toanimate with current methods. In [14], we introduce THING, a novel tablet-based approach that leveragesmulti-touch interaction for the quick and precise control of a 3D hand’s pose. The flexion/extension andabduction/adduction of the virtual fingers can be controlled individually for each finger or for several fingersin parallel through sliding motions on the tablet. We describe two variants of THING: MobileTHING, whichmaps the spatial location and orientation of the tablet to that of the virtual hand, and DesktopTHING, whichcombines multi-touch controls of fingers with traditional mouse controls for the hand’s global position andorientation. We also report on two usability studies in which we compared THING to mouse-only controls anda data glove.

Figure 2. THING enables the control of 3D hand models (in blue) by sliding fingers along sliders arranged in amorphologically-consistent pattern on the tablet’s screen.

Interactive technologies have radically changed the way visual artists work, and a large portion of the artisticproduction has now moved from paper to the computer. However, many artists still work on paper and keep

8 Activity Report INRIA 2015

using traditional painting and drawing tools. This is not only due to resistance to progress or due to thewell-known usability properties of physical tools: despite the use of pen displays, the progress of artisticstroke-rendering techniques, and the powerful and advanced functionalities of existing computer tools, theyfail to fully capture the richness and variety of artistic styles supported by physical media. We interviewedfour professional illustrators in their work environment. We also followed the work of an artist for a two-year period. We observed that artists mix a variety of techniques that involve specialized computer softwareand hardware such as Adobe Photoshop, a graphics tablet and a scanner, and traditional physical tools suchas pencils, paper, and customized light tables. Our findings inspired BricoSketch [25], an augmented paperinterface that enables illustrators to zoom into parts of their drawings and work at different levels of detailon paper. Our early results show that BricoSketch supports real tasks, improving productivity on paper whileenhancing illustrators’ creative ways of working.

Figure 3. BricoSketch. (a) An artist works on layers of physical paper with a home-made light table: she draws thepanels of a page for a graphic novel by using earlier sketches as guides. (b-d) The same artist uses our system to

add details to different parts of her illustration through partial scaled views.

7.5. Interactive visualizationParticipant: Fanny Chevalier.

The differential diagnosis of hereditary disorders is a challenging task for clinicians due to the heterogeneity ofphenotypes that can be observed in patients. Existing clinical tools are often text-based and do not emphasizeconsistency, completeness, or granularity of phenotype reporting, which can impede clinical diagnosis andlimit their utility to genetics researchers. The PhenoBlocks tool described in [13] is a novel visual analyticsplatform designed to support clinical differential diagnosis. It supports the comparison of phenotypes betweenpatients, or between a patient and the hallmark features of a disorder. An informal evaluation with expertclinicians suggests that the visualization effectively guides the process of differential diagnosis and couldreinforce the importance of complete, granular phenotypic reporting.

7.6. Adaptive interfacesParticipant: Sylvain Malacria.

Team Mjolnir 9

Figure 4. PhenoBlocks allows to compare the phenotype hierarchies of an undiagnosed query patient to adiagnosed reference patient. During differential diagnosis, clinicians use shared (green) phenotypes to gauge

confidence in their diagnostic hypothesis and missing (purple) phenotypes to identify candidates for subsequentanalysis.

As news is increasingly accessed on smartphones and tablets, the need for personalizing news applications isapparent. In [19], [20], we report on a series of studies addressing key issues in the development of adaptivenews interfaces. We first surveyed users’ news reading preferences and behaviors. We then implemented anddeployed an Android application that logs users’ interactions with the application. We used the logs to traina classifier and showed that it is able to reliably recognize a user according to their reader type. Finally weevaluated alternative, adaptive user interfaces for each reader type. The evaluation demonstrates the differentialbenefit of the adaptation for different users and the feasibility of adaptive interfaces for news applications.

In [12], we investigate the use of a companion application on a tablet to augment viewing of information-rich television programs. The application displays a synchronized graphical abstraction of the program’scontent in the form of a concept map. Two experiments were conducted involving participants watching anastronomy documentary. Results show that the companion application improved participants’ understandingand recall of the program. Participants were found to manage their visual attention systematically when usingthe companion application, and correlations were found in the way they shifted their gaze from TV screento tablet and back in response to changes in the program content. Increasing interaction with the applicationdisrupted understanding of the television program and visual attention. Participants were positive about thevalue of companion applications for understanding and recall of programs, but distraction and “knowing whereto look” were significant concerns.

8. Partnerships and Cooperations

8.1. National initiatives8.1.1. Turbotouch (ANR, 2014-2018)

Participants: Géry Casiez [correspondent], Nicolas Roussel, Thomas Pietrzak.

10 Activity Report INRIA 2015

Touch-based interactions with computing systems are greatly affected by two interrelated factors: the transferfunctions applied on finger movements, and latency. This project aims at transforming the design of touchtransfer functions from black art to science to support high-performance interactions. We are working onthe precise characterization of the functions used and the latency observed in current touch systems. We aredeveloping a testbed environment to support multidisciplinary research on touch transfer functions and willuse this testbed to design latency reduction and compensation techniques, and new transfer functions.

Partners: Inria Lille’s NON-A team and the “Perceptual-motor behavior group” from the Institute of MovementSciences.

Web site: http://mjolnir.lille.inria.fr/turbotouch/

Related 2015 publications: [23], [18], [27].

8.1.2. ParkEvolution (Carnot Inria - Carnot STAR, 2015-2016)Participants: Géry Casiez [correspondent], Sébastien Poulmane.

This project studies the fine motor control of patients with Parkinson disease in an ecological environment, athome, without the presence of experimenters. Through longitudinal studies, we collect raw information frompointing devices to create a large database of pointing behavior data. From the analysis of this big dataset, theproject aims at inferring the individual’s disease progression and influence of treatments.

Partners: the “Perceptual-motor behavior group” from the Institute of Movement Sciences and Hôpital de laTimone.

Web site: http://parkevolution.org/

8.1.3. BCI-LIFT (Inria Project Lab, 2015-2019)Participants: Géry Casiez, Nicolas Roussel [correspondent].

The goal of this large-scale initiative is to design a new generation of non-invasive Brain-Computer Interfaces(BCI) that are easier to appropriate, more efficient, and suited for a larger number of people.

Partners: Inria’s ATHENA, NEUROSYS, POTIOC, HYBRID & DEMAR teams, Centre de Recherche enNeurosciences de Lyon (INSERM) and INSA Rouen.

Web site: https://bci-lift.inria.fr/

8.2. European initiatives8.2.1. Happiness (H2020-ICT-2014-1/ICT-03-2014/RIA, 2015-2018)

Participants: Thomas Pietrzak, Nicolas Roussel [correspondent].

The main objective of this project is to develop and evaluate new types of haptic actuators based on AdvancedThin, Organic and Large Area Electronics (TOLAE) technologies for use in car dashboards.

Partners: CEA (coordinator), Inria Rennes’ HYBRID team, Arkema, Bosch, Glasgow University, ISD, WalterPack, Fundacion Gaiker.

Web site: http://happiness-project.eu/

8.2.2. Mjolnir/UCLIC associate team (Inria Lille, 2015-2017)Participants: Sylvain Malacria [correspondent], Nicolas Roussel.

The goal of this project is the design and implementation of novel cross-device systems and interactiontechniques that minimize the cost of divided attention. Of particular interest are notification systems on smartwatches and in distributed computing systems.

Partner: University College London Interaction Centre (United Kingdom).

Team Mjolnir 11

8.3. International initiatives8.3.1. MIDWAY (Inria associate team, 2014-2016)

Participants: Fanny Chevalier, Stéphane Huot [correspondent], Justin Mathew.

The goal of the project is the design and implementation of a musical interaction design workbench to facilitatethe exploration and definition of new interactive technologies for both musical creation and performance.

Partner: Inria Saclay’s EXSITU team and the Input Devices and Music Interaction Laboratory (IDMIL) fromthe Centre for Interdisciplinary Research in Music Media and Technology (CIRMMT) at McGill University,Canada.

Web site: http://insitu.lri.fr/MIDWAY/

Related 2015 publications: [16].

8.4. International research visitors8.4.1. Visits of international scientists

Visiting scholars:• Marcelo Wanderley, 4 one week visits, Professor at McGill University, Canada• Edward Lank, November 24-25th, Associate Professor at the University of Waterloo, Canada• Mathieu Nancel, March-April, Postdoctoral researcher at the University of Waterloo, Canada

Internships:• Jeronimo Barbosa, November-December, PhD student at McGill University, Canada• Aakar Gupta, February-May, PhD student at University of Toronto, Canada

8.4.2. Visits to international teamsTwo internships sponsored by Mitacs — Inria research awards:• Alix Goguey: 4 months (June-September) at the University of Waterloo with Daniel Vogel• Justin Mathew: 3 months (June-August) at McGill University with Catherine Guastavino and

Marcelo Wanderley

9. Dissemination9.1. Promoting scientific activities9.1.1. Scientific events organisation

• CHI (ACM): Stéphane Huot (video previews co-chair)• UIST (ACM): Stéphane Huot (video previews co-chair)• VIS (IEEE): Fanny Chevalier (arts program co-chair)• IHM (AFIHM): Stéphane Huot (alt.IHM co-chair)• RES#01: Nicolas Roussel

9.1.2. Scientific events selectionConference program committees:• UIST (ACM): Géry Casiez• InfoVis (IEEE): Fanny Chevalier• UbiComp (ACM): Stéphane Huot• IHM (AFIHM): Sylvain Malacria• MOCO: Nicolas Roussel

12 Activity Report INRIA 2015

Reviewing activities:• CHI (ACM): Géry Casiez, Fanny Chevalier, Stéphane Huot, Sylvain Malacria, Thomas Pietrzak,

Nicolas Roussel• UIST (ACM): Alix Goguey, Stéphane Huot, Sylvain Malacria, Thomas Pietrzak, Nicolas Roussel• MobileHCI (ACM): Sylvain Malacria• ITS (ACM): Sylvain Malacria• VR (IEEE): Stéphane Huot• NIME: Stéphane Huot• ICMI (ACM): Géry Casiez• IHM (AFIHM): Géry Casiez, Fanny Chevalier, Nicolas Roussel

9.1.3. JournalEditorial boards:• Journal d’Interaction Personne-Système (AFIHM): Géry Casiez

Reviewing activities:• Transactions on Computer Human Interaction (ACM): Sylvain Malacria, Thomas Pietrzak• Transactions on Visualization and Computer Graphics (IEEE): Fanny Chevalier• Behaviour & Information Technology (Taylor & Francis): Thomas Pietrzak

9.1.4. Scientific expertise• Idex Université de Lille project: Nicolas Roussel (strategic research council and writing committee

member)• PICOM competitiveness cluster: Nicolas Roussel (scientific board member)• HAP2U startup: Nicolas Roussel (scientific board member)• IRISA lab: Nicolas Roussel (scientific orientation committee member)• Pictanovo: Nicolas Roussel (Expériences Interactives jury member)• Agence Nationale de la Recherche (ANR): Fanny Chevalier (reviewer), Stéphane Huot (reviewer),

Sylvain Malacria (reviewer), Thomas Pietrzak (reviewer)• Acquitaine and Nord - Pas de Calais regions: Nicolas Roussel (reviewer)• Délégation Régionale à la Recherche et à la Technologie Nord-Pas-de-Calais (DRRT): Fanny

Chevalier (reviewer)

9.1.5. Research administrationFor Inria:• Evaluation committee: Nicolas Roussel (member)• Gender equity and equality committee: Nicolas Roussel (member)• Strategic orientation committee for the information system (COSS scientifique): Nicolas Roussel

(member)• International relations working group (COST-GTRI): Stéphane Huot (member)

For Inria Lille – Nord Europe:• Scientific officer (délégué scientifique): Nicolas Roussel• Technical development committee (CDT): Nicolas Roussel (member)• Research jobs committee (CER): Nicolas Roussel (member)• Support to researchers (accompagnement des chercheurs): Nicolas Roussel (adviser)• Consultative committee (Comité de centre): Fanny Chevalier (member), Alix Goguey (member)• Operational legal and ethical risk assessment committee (COERLE): Stéphane Huot (local corre-

spondent)• Activity reports (RAweb): Fanny Chevalier & Nicolas Roussel (local correspondents)

Team Mjolnir 13

For the CRIStAL lab of Univ. Lille 1:• Laboratory council: Géry Casiez (elected member)

9.1.6. Learned societies• Association Francophone d’Interaction Homme-Machine (AFIHM): Géry Casiez (board member,

president), Stéphane Huot (board member and scientific council member), Thomas Pietrzak (boardmember)

9.1.7. Hiring committees• Inria’s eligibility jury for senior researcher positions (DR2): Nicolas Roussel• Inria Lille’s eligibility jury for junior researcher positions (CR2 & CR1): Stéphane Huot (vice-

president)• Univ. Lille 1’s hiring committee for a Computer Science Professor position: Géry Casiez (president)• Univ. Paris-Sud’s hiring committee for a Computer Science Assistant Professor position: Géry

Casiez (member), Fanny Chevalier (member)

9.2. Teaching, supervision, juries9.2.1. Teaching

DUT Informatique: Géry Casiez, Algorithmique, 80 hrs, 1st year, IUT A de Lille - Univ. Lille 1

DUT Informatique: Géry Casiez, Modélisation mathématique, 14 hrs, 2nd year, IUT A de Lille -Univ. Lille 1DUT Informatique: Géry Casiez, Projets, 18 hrs, 2nd year, IUT A de Lille - Univ. Lille 1Licence Informatique: Thomas Pietrzak, AEL : Automates et Langages, 36 hrs, L3, Univ. Lille 1Licence Informatique: Thomas Pietrzak, ASD : Algorithmes et Structures de Données, 36 hrs, L3,Univ. Lille 1Master Informatique: Thomas Pietrzak (32 hrs), Nicolas Roussel (8 hrs), Sylvain Malacria (8 hrs),IHM : Interaction Homme-Machine, M1, Univ. Lille 1Master Informatique: Géry Casiez, Multi-Touch Interaction, 10 hrs, M1, Univ. Lille 1Master Informatique Image Vision Interaction (IVI): Géry Casiez (16 hrs), Fanny Chevalier (16 hrs),Thomas Pietrzak (16 hrs), NIHM : Nouvelles Interactions Homme-Machine, M2, Univ. Lille 1Master: Thomas Pietrzak, IHM et Interface à Gestes, 12 hrs, IMA5 (M2 level), Polytech LilleMaster: Géry Casiez (6 hrs), Thomas Pietrzak (10.5 hrs), 3DETech : 3D Digital EntertainmentTechnologies, M2 level, Télécom LilleMaster Sociologie Réseaux Sociaux Numériques (RSN) : Fanny Chevalier, Statistiques et visualisa-tion de données, 8 hrs, M2, Univ. Lille 1Master Sociologie Réseaux Sociaux Numériques (RSN): Fanny Chevalier, Outils et PratiquesNumériques, 6 hrs, M1, Univ. Lille 1Research Masters in Computer Science & HCID Masters (EIT ICT Labs European Master inHuman-Computer Interaction and Design): Stéphane Huot, Mixed Reality and Tangible Interaction,18 hrs, M2, Univ. Paris SudResearch Masters in Computer Science & HCID Masters (EIT ICT Labs European Master inHuman-Computer Interaction and Design): Stéphane Huot, Advanced Programming of InteractiveSystems, 13.5 hrs, M1 & M2, Univ. Paris Sud

9.2.2. SupervisionPhD in progress: Thibault Raffaillac, Languages and system infrastructure for interaction, startedOctober 2015, advised by Stéphane Huot & Stéphane Ducasse

14 Activity Report INRIA 2015

PhD in progress: Amira Chalbi, Comprendre et mieux concevoir les animations dans le contexte desinterfaces graphiques, started October 2014, advised by Nicolas Roussel & Fanny Chevalier

PhD in progress: Alexandre Kouyoumdjian, Multimodal selection of numerous moving targets inlarge visualization platforms: application to interactive molecular simulation, started October 2013,advised by Stéphane Huot, Patrick Bourdot & Nicolas Ferey (in Saclay)

PhD in progress: Alix Goguey, Ìnteracting between physical and digital tools, started October 2013,advised by Géry Casiez

PhD in progress: Andéol Evain, BCI-based interactions, started September 2013, advised by AnatoleLecuyer, Géry Casiez & Nicolas Roussel (in Rennes)

PhD in progress: Oleksandr Zinenko, Interactive code restructuring, started September 2013,advised by Stéphane Huot & Cédric Bastoul (Université de Strasbourg)

PhD in progress: Justin Mathew, New visualization and interaction techniques for 3D spatial audio,started June 2013, advised by Stéphane Huot & Brian Katz (in Saclay)

PhD: Jonathan Aceituno, Direct and expressive interaction on the desktop: increasing granularity,extent, and dimensionality, Univ. Lille 1, defended in October 2015, advised by Nicolas Roussel

9.2.3. Juries• Merwan Achibet (PhD, Université de Rennes): Géry Casiez, examiner

• Louis-Pierre Bergé (PhD, Université de Toulouse): Géry Casiez, reviewer

• Mohamed Ikbel Boulabiar (PhD, Université de Bretagne Sud): Géry Casiez, reviewer

• William Delamare (PhD, Université de Grenoble): Géry Casiez, reviewer

• Camille Fayollas (PhD, Université de Toulouse): Nicolas Roussel, reviewer

• Jérémy Frey (PhD, Université de Bordeaux): Nicolas Roussel, president

• Nazim Haouchine (PhD, Université Lille 1): Géry Casiez, president

• Leonhard Lichtschlag (PhD, RWTH Aachen University): Stéphane Huot, reviewer

• Gustavo Rovelo (PhD, Universitat Politècnica de València): Géry Casiez, reviewer

• Quentin Roy (PhD, Télécom ParisTech): Stéphane Huot, reviewer

• Matthias Schwaller (PhD, Université de Fribourg): Nicolas Roussel, reviewer

• Siju Wu (PhD, Université d’Evry): Géry Casiez, reviewer

9.3. Popularization• “L’onde de choc des attentats du 13 Novembre, jusque dans Wikipédia” article published on Rue89’s

Web site, December: Fanny Chevalier

• “Data Visualization - Voir grand, petit à petit”, talk at the Big Data day organized at EuraTechnolo-gies, November: Fanny Chevalier

• “Mouvement & Informatique”, talk for TEDx Valenciennes, October: Nicolas Roussel

• “Des ordinateurs et des Hommes - les défis de l’Interaction Homme-Machine”, talk at Lycée CésarBaggio as part of Inria Lille’s “Chercheurs Itinérants” program, October: Stéphane Huot

• “Adoiraccourcix : l’identification des doigts au service de raccourcis tactiles”, talk at Lycée Thérèsed’Avila and Lycée Queneau during as part of Inria Lille’s “Chercheurs Itinérants” program, October:Alix Goguey

• “J’étudie les relations homme-machine, posez-moi vos questions”, Ask-me-anything article pub-lished on Rue89’s Web site, October: Fanny Chevalier

• “La Recherche en Interaction Homme-Machine”, talk at Rue89, October: Fanny Chevalier

Team Mjolnir 15

• “Recherche en Sciences du Numérique & Design”, talk for Lille Design at EuraTechnologies,September: Nicolas Roussel

• “Inria and its Lille – Nord Europe research center”, talk as part of the press visit organized for theICML conference, July: Nicolas Roussel

• “Mieux explorer pour mieux raisonner - la visualisation interactive au service du savoir-faire del’analyste”, talk at EuraTechnologie, July: Fanny Chevalier

• “Des ordinateurs et des Hommes - les défis de l’Interaction Homme-Machine”, talk for the Centrede Vulgarisation de la Connaissance at Université Paris-Sud, January: Stéphane Huot

10. BibliographyMajor publications by the team in recent years

[1] G. BAILLY, T. PIETRZAK, J. DEBER, D. J. WIGDOR. Metamorphe: augmenting hotkey usage with actuatedkeys, in "Proceedings of CHI’13", ACM, April 2013, pp. 563-572, http://dx.doi.org/10.1145/2470654.2470734

[2] G. CASIEZ, S. CONVERSY, M. FALCE, S. HUOT, N. ROUSSEL. Looking through the eye of the mouse: asimple method for measuring end-to-end latency using an optical mouse, in "Proceedings of UIST’15", ACM,November 2015, pp. 629-636, http://dx.doi.org/10.1145/2807442.2807454

[3] G. CASIEZ, N. ROUSSEL. No more bricolage! Methods and tools to characterize, replicate and comparepointing transfer functions, in "Proceedings of UIST’11", ACM, October 2011, pp. 603-614, http://dx.doi.org/10.1145/2047196.2047276

[4] G. CASIEZ, N. ROUSSEL, R. VANBELLEGHEM, F. GIRAUD. Surfpad: riding towards targets on a squeezefilm effect, in "Proceedings of CHI’11", ACM, May 2011, pp. 2491-2500, http://dx.doi.org/10.1145/1978942.1979307

[5] G. CASIEZ, N. ROUSSEL, D. VOGEL. 1 euro filter: a simple speed-based low-pass filter for noisy input ininteractive systems, in "Proceedings of CHI’12", ACM, May 2012, pp. 2527-2530, http://doi.acm.org/10.1145/2207676.2208639

[6] F. CHEVALIER, P. DRAGICEVIC, C. HURTER. Histomages: fully synchronized views for image editing, in"Proceedings of UIST’12", ACM, October 2012, pp. 281-286, http://dx.doi.org/10.1145/2380116.2380152

[7] A. COCKBURN, C. GUTWIN, J. SCARR, S. MALACRIA. Supporting novice to expert transitions in userinterfaces, in "ACM Computing Surveys", November 2014, vol. 47, no 2, http://dx.doi.org/10.1145/2659796

[8] R. H. KAZI, F. CHEVALIER, T. GROSSMAN, S. ZHAO, G. FITZMAURICE. DRACO: bringing life toillustrations with kinetic textures, in "Proceedings of CHI’14", ACM, April 2014, pp. 351-360, http://dx.doi.org/10.1145/2556288.2556987

[9] S. MALACRIA, G. BAILLY, J. HARRISON, A. COCKBURN, C. GUTWIN. Promoting hotkey use throughrehearsal with ExposeHK, in "Proceedings of CHI’13", ACM, April 2013, pp. 573-582, http://doi.acm.org/10.1145/2470654.2470735

16 Activity Report INRIA 2015

[10] J. WAGNER, S. HUOT, W. MACKAY. BiTouch and BiPad: designing bimanual interaction for hand-heldtablets, in "Proceedings of CHI’12", ACM, 2012, pp. 2317-2326, http://doi.acm.org/10.1145/2207676.2208391

Publications of the yearDoctoral Dissertations and Habilitation Theses

[11] J. ACEITUNO. Direct and expressive interaction on the desktop: increasing granularity, extent, and dimension-ality, Université Lille1 - Sciences et Technologies, October 2015, https://tel.archives-ouvertes.fr/tel-01255896

Articles in International Peer-Reviewed Journals

[12] J. DOWELL, S. MALACRIA, H. KIM, E. ANSTEAD. Companion apps for information-rich televisionprogrammes: representation and interaction, in "Personal and Ubiquitous Computing", 2015, 14 p.[DOI : 10.1007/S00779-015-0867-7], https://hal.inria.fr/hal-01174692

[13] M. GLUECK, P. HAMILTON, F. CHEVALIER, S. BRESLAV, A. KHAN, D. J. WIGDOR, M. BRUDNO.PhenoBlocks: Phenotype Comparison Visualizations, in "IEEE Transactions on Visualization and ComputerGraphics", August 2015, vol. 22, no 1, pp. 101-110 [DOI : 10.1109/TVCG.2015.2467733], https://hal.inria.fr/hal-01226032

International Conferences with Proceedings

[14] M. ACHIBET, G. CASIEZ, A. LÉCUYER, M. MARCHAL. THING: Introducing a Tablet-based Interac-tion Technique for Controlling 3D Hand Models, in "In Proceedings of CHI’15, the 33th Conference onHuman Factors in Computing Systems", Seoul, South Korea, A. PRESS (editor), April 2015, pp. 317-326[DOI : 10.1145/2702123.2702158], https://hal.inria.fr/hal-01252496

[15] L. BAGNÈRES, O. ZINENKO, S. HUOT, C. BASTOUL. Opening Polyhedral Compiler’s Black Box, in "CGO2016 - 14th Annual IEEE/ACM International Symposium on Code Generation and Optimization", Barcelona,Spain, March 2016, https://hal.inria.fr/hal-01253322

[16] J. BARBOSA, J. MALLOCH, M. M. WANDERLEY, S. HUOT. What does " Evaluation " mean for the NIMEcommunity?, in "NIME 2015 - 15th International Conference on New Interfaces for Musical Expression",Baton Rouge, United States, Louisiana State University, May 2015, pp. 156-161, https://hal.inria.fr/hal-01158080

[17] M. BERTHELLEMY, E. CAYEZ, M. AJEM, G. BAILLY, S. MALACRIA, E. LECOLINET. SpotPad,LociPad, ChordPad and InOutPad: Investigating Gesture-based Input on Touchpad, in "27ème con-férence francophone sur l’Interaction Homme-Machine", Toulouse, France, ACM, October 2015, 8 p.[DOI : 10.1145/2820619.2820623], https://hal.archives-ouvertes.fr/hal-01218582

[18] G. CASIEZ, S. CONVERSY, M. FALCE, S. HUOT, N. ROUSSEL. Looking through the Eye of the Mouse:A Simple Method for Measuring End-to-end Latency using an Optical Mouse, in "UIST ’15 Proceedings ofthe 28th Annual ACM Symposium on User Interface Software & Technology", Charlotte, United States, A.PRESS (editor), ACM, November 2015, pp. 629-636 [DOI : 10.1145/2807442.2807454], https://hal-enac.archives-ouvertes.fr/hal-01226729

[19] M. CONSTANTINIDES, J. DOWELL, D. JOHNSON, S. MALACRIA. Exploring mobile news read-ing interactions for news app personalisation, in "17th International Conference on Human-

Team Mjolnir 17

Computer Interaction with Mobile Devices and Services", Copenhagen, Denmark, August 2015, 6 p.[DOI : 10.1145/2785830.2785860], https://hal.inria.fr/hal-01252631

[20] M. CONSTANTINIDES, J. DOWELL, D. JOHNSON, S. MALACRIA. Habito News: A Research Tool toInvestigate Mobile News Reading, in "MobileHCI’15 - Proceedings of the 17th International Conference onHuman-Computer Interaction with Mobile Devices and Services Adjunct", Copenhague, Denmark, ACM,2015, pp. 598–598 [DOI : 10.1145/2786567.2792896], https://hal.archives-ouvertes.fr/hal-01252632

[21] A. GOGUEY, J. WAGNER, G. CASIEZ. Quantifying Object- and Command-oriented Interaction, in "Pro-ceedings of Interact’15, the 15th IFIP TCI3 Conference on Human-Computer Interaction", Bamberg, Ger-many, IFIP, September 2015, pp. 231-239 [DOI : 10.1007/978-3-319-22723-8_18], https://hal.inria.fr/hal-01252527

[22] A. KOUYOUMDJIAN, N. FEREY, P. BOURDOT, S. HUOT. Characterizing the Influence of Motion Parameterson Performance when Acquiring Moving Targets, in "Interact 2015, 15th IFIP TC.13 International Confer-ence on Human-Computer Interaction", Bamberg, Germany, Lecture Notes in Computer Science, SpringerInternational Publishing, September 2015, vol. 9299, pp. 148-155, https://hal.inria.fr/hal-01207511

[23] S. MALACRIA, J. ACEITUNO, P. QUINN, G. CASIEZ, A. COCKBURN, N. ROUSSEL. Push-Edge and Slide-Edge: Scrolling by Pushing Against the Viewport Edge, in "CHI 2015 - 33th Conference on Human Factorsin Computing Systems", Seoul, South Korea, April 2015, 4 p. [DOI : 10.1145/2702123.2702132], https://hal.inria.fr/hal-01110989

[24] T. PIETRZAK, N. ROUSSEL, A. GUPTA, R. BALAKRISHNAN. Dialogic Manipulation for Tactile Displays, in"27ème conférence francophone sur l’Interaction Homme-Machine", Toulouse, France, ACM, October 2015,10 p. [DOI : 10.1145/2820619.2820640], https://hal.archives-ouvertes.fr/hal-01218783

[25] T. TSANDILAS, G. MAGDALINI, S. HUOT. BricoSketch: Mixing Paper and Computer Drawing Toolsin Professional Illustration, in "International Conference on Interactive Tabletops and Surfaces (ITS’15)",Funchal, Portugal, November 2015, pp. 127-136 [DOI : 10.1145/2817721.2817729], https://hal.archives-ouvertes.fr/hal-01207358

[26] O. ZINENKO, C. BASTOUL, S. HUOT. Manipulating Visualization, Not Codes, in "International Workshopon Polyhedral Compilation Techniques (IMPACT)", Amsterdam, Netherlands, January 2015, 8 p. , https://hal.inria.fr/hal-01100974

Patents and standards

[27] S. CONVERSY, G. CASIEZ, M. FALCE, S. HUOT, N. ROUSSEL. Arrangement to measure and use latencybetween an input interface and an output interface of a processing device, October 2015, no Europeanapplication number 15306665.9, https://hal.inria.fr/hal-01252627

[28] T. GROSSMAN, G. FITZMAURICE, R. H. KAZI, F. CHEVALIER, S. ZHAO. Animating Sketches via KineticTextures, May 2015, no US20150145870, https://hal.inria.fr/hal-01263126

Other Publications

[29] T. GROSSMAN, F. CHEVALIER, R. H. KAZI. Your Paper Is Dead! Bringing Life to Research Articles withAnimated Figures, 2015, pp. 461-470, Proceedings of the ACM Extended Abstracts on Human Factors inComputing Systems [DOI : 10.1145/2702613.2732501], https://hal.inria.fr/hal-01169592

18 Activity Report INRIA 2015

References in notes

[30] M. CHALMERS, A. GALANI. Seamful interweaving: heterogeneity in the theory and design of interactivesystems, in "Proceedings of DIS’04", ACM, 2004, pp. 243-252, http://doi.acm.org/10.1145/1013115.1013149

[31] D. C. ENGELBART. Augmenting human intellect: a conceptual framework, Stanford Research Institute,October 1962, no AFOSR-3233, http://www.dougengelbart.org/pubs/augment-3906.html

[32] M. HEIDEGGER. Sein und zeit, Max Niemeyer Verlag, February 1927

[33] E. PACHERIE. The phenomenology of action: a conceptual framework, in "Cognition", 2008, vol. 107, no 1,pp. 179 - 217, http://dx.doi.org/10.1016/j.cognition.2007.09.003

[34] N. ROUSSEL, G. CASIEZ, J. ACEITUNO, D. VOGEL. Giving a hand to the eyes: leveraging input accuracyfor subpixel interaction, in "Proceedings of UIST’12", ACM, October 2012, pp. 351-358, http://dx.doi.org/10.1145/2380116.2380162