The Fifth IEEE International Conference on Software Testing, Verification and Validation

General Chair Giuliano (Giulio) Antoniol École Polytechnique de Montréal, Canada

Program Chairs Antonia Bertolino ISTI-CNR, Italy

Yvan Labiche Carleton University, Canada

First of all, we would like to thank…

ICST 2012 Organizers

Industrial Chairs Peter Zimmerer, Siemens AG, Germany Saurabh Sinha, IBM Research, India Thomas J. Ostrand, AT&T Labs Research, USA

Workshop Chairs Massimiliano Di Penta, University of Sannio, Italy Arnaud Gotlieb, INRIA, France

Ph.D. Symposium Chairs Natalia Juristo, Univ. Politécnica de Madrid, Spain Vahid Garousi, University of Calgary, Canada

Poster Chair Antonino Sabetta, SAP Research, France

Financial Chair Dave Binkley, Loyola University in Maryland, USA

Publicity Chair Gordon Fraser, Saarland University, Germany

Publications Chair Francesca Lonetti, CNR, Italy

Local Arrangements Chair Yann-Gaël Guéhéneuc, École Polytechnique de Montréal, Canada

Registrar Elliot Chikofsky, Reengineering Forum, USA

Webmaster Aminata Sabané, École Polytechnique de Montréal, Canada

ICST Sponsor and Supporters

….and you all

•  250 Participants from 27 different countries

USA24%

Canada24%

Europe41%

Asia7%

Africa1%

South America

3%

A True International Venue United States Canada Germany France United Kingdom Italy Sweden Spain Brazil Luxembourg

China Austria Norway Japan Switzerland South Korea Netherlands Australia Slovenia Greece

United Arab Emirates Poland Pakistan Lebanon Israel India Hungary

Ten Very Popular Workshops

31 Participants to the PhD Symposium

Workshop Registrations

Students are 32 % of Registrations

32

68

Students

Regular

Program of the week

Tuesday, April 17 Saturday, April 21 Workshop on Combinatorial Testing (CT 2012)

4th International Workshop on Constraints in Software Testing, Verification and Analysis (CSTVA'2012)

International Workshop Mutation Analysis (Mutation 2012)

Security Testing (SECTEST 2012)

The First International Workshop on Load Testing of Large Software Systems (LT 2012)

Verification Of modeL Transformations (VOLT 2012)

Advances in Model Based Testing (A-MOST 2012)

Search-Based Software Testing (SBST 2012)

The Second International Workshop on Regression Testing (Regression 2012)

Testing: Academy & Industrial Conference: Practice&ResearchT echniques (TAIC PART 2012)

Chairs: Massimiliano Di Penta, University of Sannio, Italy Arnaud Gotlieb, INRIA, France

Ten Workshops

Doctoral symposium, Tue April 17

PhD Proposals; •  A Smart Structured Test Automation Language (SSTAL), Nan Li •  Industrial Applicability of Visual GUI testing for System and Acceptance Test

Automation, Emil Börjesson •  Mitigating the Effect of Coincidental Correctness in Spectrum Based Fault

Localization, Aritra Bandyopadhyay •  Prioritization of Test Cases using Software Agents and Fuzzy Logic, Christoph Malz,

Nasser Jazdiand Peter Göhner •  Using Statistical Process Control for Root Cause Analysis of Load Test

Problems,Thanh H. D. Nguyen •  Web Mutation Testing, Upsorn Praphamontripong

Chairs: Natalia Juristo, Universidad Politécnica de Madrid, Spain Vahid Garousi, University of Calgary, Canada

DS PC: Benoit Baudry, Aysu Betin-Can, Ali Mesbah, Jeff Offutt, Gregg Rothermel, Richard Torkar, Jeff Voas

•  We open every day with a keynote talk in plenary session •  Three or two technical sessions in parallel (check the

program schedule) •  One panel on Wed. afternoon:

Model-based testing--rebranding old ideas? •  One panel/round table on Fri. afternoon:

ICST: what did you like, what did you dislike and which is your great idea to make it more effective?

•  Closure cerimony (awards, ICST 2013 announcement, and SC voting)

Main Conference -- Wed.-Fri.

ICST 2012 PC members James Andrews, University of Western Ontario, Canada Andrea Arcuri, Schlumberger and Simula Research Lab,

Norway Erik Arisholm, Testify, Norway Fevzi Belli, Paderborn University, Germany James Bieman, Colorado State University, USA Kiril Bogdanov, The University of Sheffield, UK Fabrice Bouquet, The Université de Franche Comté,

France Mario Bravetti, Bologna University, Italy Renee Bryce, Utah State University, USA Jeffrey Carver, University of Alabama, USA Tsong Yueh Chen, Swinburne University of Technology,

Australia Myra Cohen, University of Nebraska, USA Guglielmo De Angelis, ISTI-CNR, Italy Juergen Dingel, School of Computing Queen's University,

Canada Hyunsook Do, North Dakota State University, USA Sebastian Elbaum, University of Nebraska, USA Sigrid Eldh, Ericsson, Sweden Khaled ElFakih, American University of Sharjah, UAE Robert Eschbach, ITK Engineering AG, Germany Robert France, Colorado State University, USA Angelo Gargantini, University of Bergamo, Italy Sudipto Ghosh, Colorado State University, USA Mark Grechanik, Accenture, USA Wolfgang Grieskamp, Google, USA Roland Groz, LSR-IMAG, France Mark Harman, University College, UK Toru Hasegawa, KDDI R&D Labs, Japan

Amit Paradkar, IBM, USA Ioannis Parissis,Grenoble Institute of Technology, France Alex Petrenko, CRIM, Canada Marco Pistoia, IBM, USA Andrea Polini, University of Camerino, Italy Alexander Pretschner, Karlsruhe Institute of Technology,

Germany Filippo Ricca, University of Genoa, Italy Niciolas Riviere, LAAS, France Brian Robinson, ABB, USA Ismael Rodriguez, Complutense de Madrid University, Spain Marc Roper, University of Strathclyffe, Scotland Sreedevi Sampath, University of Maryland- Baltimore

County, USA Sara Sprenkle, Washington & Lee University, USA Paul Strooper, University of Queensland, Australia Nikolai Tillmann, Microsoft, USA Paolo Tonella, ITC-IRST, Italy Jan Tretmans, Radboud University Nijmegen, Netherlands T.H. Tse, University of Hong Kong, China Andreas Ulrich, Siemens, Germany Willem Visser, University of Stellenbosch, South Africa Helene Waeselynck, LAAS-CNRS, France Laurie Williams, North Carolina State University, USA Eric Wong, University of Texas - Dallas, USA Tao Xie, North Carolina State University, USA Fatiha Zaidi, Paris Sud University, France Andreas Zeller, Saarland University, Germany

Gerard Holzmann, NASA/JPL, USA Thierry Jeron, IRISA / INRIA Rennes, France Sarfraz Khurshid, University of Texas - Austin, USA Myungchul Kim, Department of Computer Science

KAIST, Korea Jens Knoop, Technische Universität Wien, Austria Bogdan Korel, Illinois Institute of Technology, USA Pieter Kritzinger, University of Cape Town, South

Africa Bruno Legeard, Smartesting, France Yu Lei, University of Texas at Arlington, USA Yves LeTraon, University of Luxembourg,

Luxembourg Shaoying Liu, Hosei University, Japan Stephane Maag, Institut Telecom, France Rajib Mall, IIT Kharagpur, India Eda Marchetti, ISTI-CNR, Italy Darko Marinov, University of Illinois, USA Eliane Martins, Campinas University, Brazil Wassim Masri, American University of Beirut,

Lebanon Phil McMinn, University of Sheffield, UK Mercedes Merayo, Complutense de Madrid

University, Spain Ali Mesbah, University of British Columbia, Canada Henry Muccini, University of L'Aquila, Italy Nachiappan Nagappan, Microsoft, USA Jeff Offutt, George Mason University, USA Marcel Oliveira, Federal University of Rio Grande do

Norte, Brazil

…and additional reviewers Mithun Acharya, Fabrice Ambert, Moussa Amrani, Fatmah Assiri, Olivier Baldellon, Aritra Bandyopadhyay, Alexandre Bartel, Sofia Bekrar, Mutlu Beyazit, Puneet Bhateja, Matthias Büchler, Frederic Dadeau, Fabien Duchène, Arnaud Dury, Donia El Kateb, Maged Elaasar, Burak Emir, Ylies Falcone, Patrick Francis, Phyllis Frankl, Ruizhi Gao, Jaco Geldenhuys, Divya Gopinath, Juliana G. Greghi, Nevin Güler, Niusha Hakimipour, Karim Hossen, Upulee Kanewala, Sungwon Kang, Moonzoo Kim, Jacques Klein, Johannes Kloos, Laura Kovacs, Maurizio Leotta, Mo Li, Nan Li, Yihao Li, Michael Linschulte, Luis Llana, Ivano Malavolta, Alessandro Marchettto, Pat Morrison, Tejeddine Mouelhi, Pramila Mouttappa, Ulrich Neumerkel, Duc Hoai Nguyen, Razieh Nokhbeh Zaeem, Alberto Nuñez, Catherine Oriat, Johan Oudinet, Sascha Padberg, Sylvain Peyronnet, Pasqualina Potena, Upsorn Praphamontripong, Rahul Purandare, Xiao Qu, Pablo Rabanal, Devadatta Sadhu, John Slankas, Ben Smith, Will Snipes, Amelie Stainer, Brett Stevens, Frederic Voisin, Guowei Yang, Tao Yue, Fadi Zaraket, Lingming Zhang

PC stats

North America38%

Europe45%

South Americ a3%

Asia9%

Afri ca5%

15% from industry

77 PC members 67 sub-reviewers 21 countries

(excerpt from the ICST charter)

•  TPCs must explicitly incorporate a process of rotating members on and off of the TPC, as follows: –  No TPC member shall serve on more than three

consecutive TPCs •  following which they must be omitted from the TPC for at

least one year.

–  The PCs must explicitly seek permission from the SC to remove more than 50% of the previous year's TPC.

Submissions stats

•  176 submissions –  Research: 145

•  Acceptance: 28% –  Industry: 31

•  Acceptance: 22%

•  535 reviews •  Each submission had

at least 3 reviews –  A few had four

39

2

1047

24

0

20

40

60

80

100

120

140

Accept Research->Industry

reject

Research Industry

Authors (31 countries)

North America

36%

South America

7%

Europe43%

Asia13%

Africa1%

Europe45%

Asia33%

North Americ

a

South Americ

a

Research Industry

Wednesday - April 18, 9.30 Viewpoints on the Challenges in Avionics Verification and

Validation

Pierre Labrèche (CMC Electronics, Canada)

Thursday - April 19, 9.00 Quality, Can We Define It?

Ray J. Payette (IBM Business Analytics, USA)

Friday - April 20, 9.00 Reproducible Tests? Non-duplicable Results in Testing and

Verification

Michael Ernst (University of Washington, USA)

Keynotes

Posters, Thur - April 19 Afternoon

•  Queuing model-based load testing of large enterprise applications, Leonid Grinshpan •  Incremental Test Case Generation for UML-RT Models Using Symbolic Execution, Eric

James Rapos and Juergen Dingel •  Automatic derivation of test execution plans from a Video Conferencing System Product

Line modelling, Shuai Wang, Arnaud Gotlieb, Marius Liaaen and Lionel Briand •  Towards a Method for Reducing the Test Suites of Database Applications, Gregory

Kapfhammer •  Property-Driven Software Engineering Approach, Antinisca Di Marco, Francesca Lonetti

and Guglielmo De Angelis

Chair: Antonino Sabetta, SAP Research Sophia-Antipolis, France DS PC: Roberta De Souza Coelho, Federal University of Rio Grande do Norte, Brazil

Francesca Lonetti, CNR-ISTI, Italy Ioannis Parissis, Grenoble INP-LCIS, France Pingyu Zhang, University of Nebraska, USA

Awards!

•  Best ICST 2012 paper

•  Google diversity grants

•  Best presentation: please cast your votes!!

Please let us hear from you!

•  You got two sets of questionnaires in your bag – Best presentation award: sheets per session,

please vote when exiting a session – Feedback/advise on ICST: your filled

questionnaire will be input for last day panel

Social events

•  Welcome reception: in the Atrium @ 19h –  you have a ticket for a free drink –  bring your yellow ticket!

•  Banquet: tomorrow evening in Seasons rooms –  Open bar @ 19h before banquet –  Bring your green ticket!

Practical information

•  Most events are planned on this floor –  salon Été is on the second floor!

•  Coffee breaks are served in the Atrium

•  Lunch in Season room(s) –  same room is used for two functions!

Practical information

•  People with the ICST T-shirts are student volunteers helping to run the conference

•  Please look after your belongings, we cannot lock the rooms during coffee breaks and lunch

•  Montreal is by any standard a very safe city …

•  March 18 – 22, 2013 in Luxemburg

•  General Chair Yves Le Traon

•  Program co-chairs: Benoit Baudry, Alessandro Orso,

Have a fruitful conference !