SESAR ATC MultiTouch Technology

Use touch screen interfaces for sharing content Application executive within the SESAR Air Traffic Management

Relatore: Prof. Carlo Martino Master: Davide Angelelli Number : 342379

24 Gennaio 2013

University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis A.A.2011-2012

The project

Technologies used

Operational tests

Preliminary studies

Analysis of the state of the art

Conclusions

SUMMARY

Università degli studi di Roma la Sapienza Tesi di Laurea Utilizzo delle interfacce touch screen per la condivisione dei contenuti

24 January 2013 Davide Angelelli 2


Relatore

Note di presentazione

Dopo una breve introduzione andremo a descrivere il sistema a tre serbatoi in cui abbiamo svolto le simulazioni e illustreremo brevemente le procedure utilizzate per identificarlo, successivamente presenteremo l’osservatore dello stato discreto progettato … per poi andare a concludere questa presentazione


Il Progetto

The project idea

Introduce touch-screen interface in the control systems of the Civil Air Traffic (ATC)


Relatore



Davide Angelelli 4

Il Progetto

The project stems from the customer to have a system of European air traffic control safer and easier. Develop then at Finmeccanica - SelexSI - SCARL - SESM (at the urging of ENAV) a prototype, to introduce a new the new frontier of human machine interfaces (HMI) and it can be used in the workstations of air traffic control ATC.

For whom and why:

24 January 2013


Relatore



Davide Angelelli 5

The project on which we have taken action:

The SESAR project is aimed at creating a new generation system for the European air traffic management. The Single European Sky (SES) is the response of 'European Union to solve the problem. The initiative, which was adopted in March 2004 to solve some problems which arise after the events of 11 September 2011 that showed how the planes can be a serious threat to the security of the population. This project aims to provide a solution to various problems: Provide a safe means of transport of passengers and overflown by planes populations Optimization of routes and flights in the environment, become more and more essential in our day.

24 January 2013

Il Progetto University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis A.A.2011-2012

Relatore




The project stems from the customer to have a system of European air traffic control safer and easier. To this end, I decided to introduce touch-screen technology coadivuandola the new community platform SESAR and proposing a new generation system in line with today's technologies for the European air traffic management. The Single European Sky (SES) with the platform SESAR is the answer of 'EU solution to the problems generated on 11 September 2001; in collaboration with Finmeccanica I designed and implemented a project to integrate SESAR for a more intuitive, secure, and usable data.

University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Project Analisys

Relatore



Davide Angelelli 7

STRENGTHS PRACTICALITY 'OF USE THROUGH gestures': Use the Touch Screen mode GESTURE, over,

that is, the actions are the result of some gestures made with fingers directly on the display, on the track or on EBay Strip.

Ability to grow or shrink with two fingers an object

much more easily than with a device to a single point, such as a mouse or a stylus.

24 January 2013


Preliminary Studies

Relatore



Davide Angelelli 8

STRENGTHS BETTER MANAGEMENT OF CONTENTS: Content sharing and use by the supervisor of a

portable wireless device (iPad or similar) Use the Speech-To-Text to send commands to the

pilot, with generation of CPDLC message AUTOMATIC (with confirmation Operator);

24 January 2013

Preliminary Studies University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 9

Il Progetto

What concepts introduced

As in the movie Minority Report (Spielberg 2002) today the latest technological innovations (iPhone, Tablets, and other, with touch control screens or multitouch), make it possible to interact with the computer to a more ergonomic and cognitive-intuitive than traditional methods (mouse, keyboard or trackball).

24 January 2013


Relatore




The Project

Over the years the HMI (Human Machine Interface) controller (which is Tactical Planner) have evolved quite remarkable, going from systems Communications Radio Radar Analog Display of the 60 LCD screens in Lavagna with the Mouse and Keyboard 2000s. The HMI, however, from a simple interview with Radio Display Analog, introduced an intensive interaction with mouse and keyboard to configure the appropriate display depending on the traffic situation from gestire.Allo state of the art in the new multi-touchscreen, function Speech-to-Text allows us to redefine the new frontier of 'HMI.

Purposes: Redesigning the Human Machine Interface


Relatore



Davide Angelelli 11

Expectations of operators: Searching for a better view (scaling, zoom level) Search for a simplicity of use Searching for a better interaction with the interfaces

Solution: Use two or more fingers and / or more hands to control the user interface. By using only two fingers, the user is able to manipulate interface elements in a way that mimics real interactions. The touch virtual objects as works with real objects. Introduction of five typical gestures selected from a large set of gestures.


Expectations from users and Proposed Solutions

24 January 2013


Relatore



Davide Angelelli 12

Technologies used: Multitouch interfaces and surfaces

Recent technological innovations (iPhone, Tablets, etc. screens with touch control or multitouch), make it possible to interact with the computer to a more ergonomic and cognitive than traditional methods (mouse, keyboard oTrackball).

24 January 2013


User Interface

Relatore



Davide Angelelli 13

The two aspects Technological treated: Hardware: Various systems have been tested by small sizes, furniture, WI-FI for example supervisor. Ipad up to 55 multi-touch tables " Software: Propose an interface that can manage through your fingers and gesture information about eliminating the use of the mouse

24 January 2013


User Interface

Relatore



Davide Angelelli 14

Le interfacce Hardware testate:

- Monitor 21” touchscreen; per gli operatori (postazione fissa)

- Tavolo tattico di controllo; per i supervisor

(postazione fissa per i supervisori) - Ipad wifi; per i supervisor (postazione mobile)

24 January 2013


User Interface

Relatore



Davide Angelelli 15

Apple IPAD

The Apple iPad used in the test version of Apple's operating system iOS 4.2. The software uses the following gesture: - Running the command 1 Touch - Navigazioene: two-finger zoom, pan finger. The application interface has a structure similar to the Windows version, which has a sidebar on the left that shows the directories, the overview document on the right side and a full view of the document at the center once selected.

24 January 2013

User Interface University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 16

3M multi-touch screen: Lo schermo 3M multi-touch è stato utilizzato con un computer standard Intel con processore I7 e su piattaforma Windows 7. Il software integrato riprende il software attualmente utilizzato dagli ATC I gesti implementati sono: - 1 tocco per attivare le finestre: - 2 dita divergenti per zoom - 2 dita parallele per spostamento (pan),

24 January 2013

The Project University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 17

Custom Multi-touch Display 46 "- 55" 32 touches (32 inputs or control points) www.virtualmind.it This model was a favorite of the MTV series, especially for its high resolution 1920x1080 full HD panel. E 'was chosen since forsisce the possibility to have a control station tactic for supervisisor, of a whole area Moreover, it is able to manage through more inputs simultaneously more content by introducing the concept of sharing information in real time.

24 January 2013


User Interface

Relatore



Davide Angelelli 18

The software developed: • It 'been partially transformed the interface in terms of visual communication in order to make the operators interact with their fingers and their gesture instead of mouse gestures have been implemented, and deleted some useful commands not as overlapping maps.

• It follows that on the devices tested and released; touch screens 21 "for operators, workstations Ipad mobile wi-fi to the Supervisor, the control console 46" the interface is easier and more intuitive with the possibility to manage the different tracks in different scales, of the aircraft as described in successive images. Also introduced was the concert of mobility control location for supervisors.

24 January 2013

Application Software University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 19 24 January 2013


Relatore





Relatore





Relatore



Davide Angelelli 22

Concepts and introduced Gesture -

Gesture Implementation

Click-Touch With a single touch you from running a command, in System Preferences just a single or a double touch. Pan To pan (scroll) and 'simply sliding two fingers on the surface in any direction: vertical, horizontal or diagonal.

24 January 2013

Gesture University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



24 Gennaio 2013 Davide Angelelli 23

Gesture introduce -

Gestur System Implementation.

Browse Using three fingers, flick left and right on the Multi-Touch surface to turn pages. Rotate With the thumb and index finger on Multi-Touch surface, rotates clockwise or counterclockwise to rotate an image..

Gesture University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 24

Test operative place: FINMECCANICA SCARL -

Date 12-09-2012

component hardware experimental test: - Standard working position desk ATM - Workstation Window 7 Client - 3M M2256P (22”) - Custom multitouch 46” - Apple iPad (9,7”) - Apple Trackpad - Interview questionnaire - Video Camera - Eye-Tracking

24 January 2013

Testing University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 25

Test Participant: 10 technicians, including: • 6 people test route / TMA experience • 2 person ATC • 2 Engineers The age of the test was between 25 to 42 years. Their work experience within an environment ATC is between 4-10 years. Two of the test participants have a background in route / TMA as a controller. The test was supported by: • 1 specialist in human gestures • 2 Engineers


24 January 2013

Testing University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 26

Evaluation of the overall results: The evaluation results were obtained from video eye tracking system and external camera (for example, the timing of implementation of activities), verbal feedback of the subjects and analysis of questionnaires. The main statements extracted from the debriefing sessions: - The gestures defined by mobile devices to be used, as this is more intuitive for the user. - The route with multitouch support seemed faster than navigating using mouse and keyboard. - Acceptance by the people who carried out the test: HIGH

24 January 2013

Il Progetto University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 27

Evaluation of specific results: Virtualmind 55” multitouch www.virtualmind.it - Accuracy; rating: Good - Colors; rating: Good 32 possible inputs at the same time, (the haptic sensation), feeling the touch of the surface sheet touch has been identified as provable discomfort - The fingers glide over the surface well. - Problems with screens have been identified by the persons who carried out the test (sometimes flickering on the edges, shadows, viewing angle poor) - Not all the gestures of Windows have been identified as the most intuitive.

24 January 2013

Il Progetto University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis RESULTS

Relatore



http://www.virtualmind.it/

Davide Angelelli 28

Evaluation of specific results: Apple Ipad

•The performance of 'iPad has been detected as not sufficient in some

cases; Longer time of loading maps in PDF format compared to PC

• Sometimes were perceived delays browsing and loading, this may

depend on a current release of the app matures, optimization is

necessary.

• The Multitouch gestures were identified as the most intuitive

24 January 2013


Relatore




SWOT ANALYSIS The idea is to develop (at the urging of ENAV) a prototype study, to find the new frontier of the new HMI. Use the touch screen mode GESTURE, where actions are the result of some gestures made with fingers directly on the display, on the track or on EBay Strip: to. Actions Configuration Display b. Controls on the track or on the FPL, with generation of CPDLC message AUTOMATIC (Operator to be confirmed) I. Change of Quote II. Change of Direction III. Change of speed IV. other variables b.1 Use the Speech-To-Text to send commands to the pilot, with generation of CPDLC message AUTOMATIC (Operator to be confirmed).

24 January 2013

Il Progetto University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis Swot Analysis

Relatore



Davide Angelelli 30

POINTS OF WEAKNESS The fingertips are much larger than most of the icons on the

graphic display Studies show that some users (30% of cases) have

significantly better results with pointing indirectly via mouse input.

RISK Possible arm fatigue when you act on vertical surfaces Lack of tactile feedback (eg. Keyboard classical)

24 January 2013


Relatore



Davide Angelelli 31

CHANCE The true potential of multi-touch technology is the ability for the user to use multiple fingers of both hands to control the user interface: By using only two fingers, the user is able to manipulate interface elements in a way that mimics very real interactions. The touch and manipulate virtual objects works, almost, as with real objects. Management is intuitive, through gestures allows an 'experience of interaction based on reality. Using multiple fingers allows users of multi-touch systems can make better use of their skill to get more complex interactions.

24 January 2013


Relatore




Evaluation of overall usability: Results As you can see in the picture some questions were not applicable to the equipment tested, the data are shown in parentheses for each outcome. The results can be interpreted as a good acceptance of multitouch systems and their functionality tested. Especially in the "suitability for learning", the subjects were very satisfied, this is due to the widespread use of multi-touch technology in their private lives, for example, Apple's iPhone and iPod family, Android tablets and phones, etc.

Università degli studi di Roma la Sapienza Tesi di Laurea Utilizzo delle interfacce touch screen per la condivisione dei contenuti Testing University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis

Relatore



Davide Angelelli 33

Conclusion The multitouch devices, either as standard display with multitouch functionality, that handheld devices or tablets, such as Apple's iPad or other tablets, are mature enough from the technical point of view to be used in ATC environments. Although the iPad has proven to be the best multitouch hardware, especially for its smooth surface and its form factor, also the display Multitouch 3M is able to provide performance similar with regard to image quality and touch recognition. If some of the drawbacks are solved, for example, the viewing angle of the bottom, this technology will be accepted by users.

24 January 2013

Il Progetto University of Rome La Sapienza - Faculty of Engineering-Architecture Degree in Visual Communication Design and Multimedia Master Thesis Conclusion

Relatore



Documents

SESAR ATC MultiTouch Technology