Innovation in Quality Assurance – What is the Impact on Trading technology?

Quality Assurance & Related Software Development for Innovative Trading SystemsTel: +7 495 640 2460, +1 415 830 38 49www.exactpro.com

Innovation in Quality Assurance – What is the Impact on Trading technology?

Iosif Itkin, Co-Founder and CEO ExactproLondon Stock Exchange Group

Trading Show New YorkOctober 2015

http://exactpro.com/

Exactpro Systems

Exactpro is: Clients Worldwide:

2 Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

A specialist firm focused on functional and non functional testing of systems that process wholesale financial products, particularly market infrastructure

A UK company with operations in the US and four QA & software development centres in Russia

Part of London Stock Exchange Group as of May 29, 2015

Incorporated in 2009 with 10 people, our company has experienced significant growth as satisfied clients require more services - now employing over 310 specialists

http://www.exactpro.com/

3

FrAgile Process

Crowd-sourced Testing

Formal Verification Methodologies

Cognitive Technology

Quality Assurance Trends

Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com


4

FrAgile Process

Test is DeadIdeas before ProductsHappy Software DevelopersSoftware Engineer in Test



5

Crowd-Sourced Testing

Immediate Feedback from Diverse User BaseInstrumentation is Required to Process Data



6

Formal Methods

Model CheckingTheorem ProvingStatic AnalysisVerification

http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?id=2006-001A


http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?id=2006-001A


7

What’s Next?

Can We Learn from Other Industries?

Be Both Faster and Safe

Who Had the Most Severe Problems with Technology?



8

Proposed Approach

Build Software to Test Software

Test Tool Sophistication should Match Platform’s Complexity

A Good Robot is Required to Survive in Robot Apocalypse

Summer Glau - The Sarah Connor ChroniclesGrace Park - Battlestar Galactica



9

Trading Systems

Testing Instruments, Risk Control and Monitoring Tools should have the Same Priority as the Trading Platform

Testability is Required for Agile Process and Continuous Integration

SET = Building Software to Test Software

No Formal Artefacts from Agile Process. Parallel Stream for Test Harness

Formal Verification can Improve Quality

The Software will Break Anyway

The Absence of Adequate Monitoring and Kill Switches is What Turns a Problem into a Disaster



10

Passive Testing



11

Assembling Test Infrastructure


12

Test Harness for Algo Trading


13

Achieving Efficiency


14

Thank you

November 11 November 12 – 14
