76

How software that runs Wikipedia is tested

  • Upload
    sqalab

  • View
    319

  • Download
    1

Embed Size (px)

DESCRIPTION

Презентация доклада Željko Filipin на конференции SQADays-14 English Day, Львов 7 ноября 2013

Citation preview

Page 1: How software that runs Wikipedia is tested
Page 2: How software that runs Wikipedia is tested
Page 3: How software that runs Wikipedia is tested

Communication1/9

Page 4: How software that runs Wikipedia is tested

Cucumbercukes.info

Page 5: How software that runs Wikipedia is tested
Page 6: How software that runs Wikipedia is tested
Page 7: How software that runs Wikipedia is tested

Maintainability2/9

Page 9: How software that runs Wikipedia is tested
Page 10: How software that runs Wikipedia is tested
Page 11: How software that runs Wikipedia is tested
Page 12: How software that runs Wikipedia is tested
Page 13: How software that runs Wikipedia is tested
Page 14: How software that runs Wikipedia is tested
Page 15: How software that runs Wikipedia is tested
Page 16: How software that runs Wikipedia is tested

Browser automation3/9

Page 18: How software that runs Wikipedia is tested
Page 19: How software that runs Wikipedia is tested

Combinatorial explosionbrowser / operating system / version

4/9

Page 20: How software that runs Wikipedia is tested

Sauce Labssaucelabs.com

Page 21: How software that runs Wikipedia is tested
Page 22: How software that runs Wikipedia is tested
Page 23: How software that runs Wikipedia is tested

Visibility / transparency5/9

Page 25: How software that runs Wikipedia is tested
Page 26: How software that runs Wikipedia is tested
Page 27: How software that runs Wikipedia is tested
Page 29: How software that runs Wikipedia is tested
Page 30: How software that runs Wikipedia is tested
Page 31: How software that runs Wikipedia is tested

Bug tracker: Bugzillabugzilla.wikimedia.org

Page 32: How software that runs Wikipedia is tested
Page 33: How software that runs Wikipedia is tested

Continuous integration: Jenkins

integration.wikimedia.orgwmf.ci.cloudbees.com

Page 34: How software that runs Wikipedia is tested
Page 35: How software that runs Wikipedia is tested
Page 36: How software that runs Wikipedia is tested

Test results: Sauce Labssaucelabs.com

Page 37: How software that runs Wikipedia is tested
Page 38: How software that runs Wikipedia is tested
Page 39: How software that runs Wikipedia is tested
Page 40: How software that runs Wikipedia is tested
Page 41: How software that runs Wikipedia is tested
Page 42: How software that runs Wikipedia is tested

Code reuse6/9

Page 43: How software that runs Wikipedia is tested

mediawiki-seleniumRuby gem

github.com/wikimedia/mediawiki-selenium

Page 44: How software that runs Wikipedia is tested
Page 45: How software that runs Wikipedia is tested

Speed7/9

Page 46: How software that runs Wikipedia is tested

Not there yet :(github.com/grosser/parallel_tests

Page 47: How software that runs Wikipedia is tested
Page 48: How software that runs Wikipedia is tested

Help wanted!8/9

Page 49: How software that runs Wikipedia is tested

volunteeringinternship

lists.wikimedia.org/mailman/listinfo/qa

Page 50: How software that runs Wikipedia is tested

Works at my machine!9/9

Page 52: How software that runs Wikipedia is tested

MediaWiki-VagrantGit, VirtualBox, Vagrant

mediawiki.org/wiki/Mediawiki-Vagrant

Page 53: How software that runs Wikipedia is tested
Page 54: How software that runs Wikipedia is tested
Page 55: How software that runs Wikipedia is tested
Page 56: How software that runs Wikipedia is tested

Ruby Version Manager (RVM)

Ruby versions and gemsetsrvm.io

Page 57: How software that runs Wikipedia is tested
Page 58: How software that runs Wikipedia is tested
Page 59: How software that runs Wikipedia is tested
Page 60: How software that runs Wikipedia is tested
Page 61: How software that runs Wikipedia is tested
Page 62: How software that runs Wikipedia is tested
Page 63: How software that runs Wikipedia is tested
Page 64: How software that runs Wikipedia is tested
Page 65: How software that runs Wikipedia is tested

Bundlerbundler.io

Page 66: How software that runs Wikipedia is tested
Page 67: How software that runs Wikipedia is tested
Page 68: How software that runs Wikipedia is tested
Page 69: How software that runs Wikipedia is tested
Page 70: How software that runs Wikipedia is tested
Page 71: How software that runs Wikipedia is tested

Why Ruby!?ruby-lang.org

10/9

Page 72: How software that runs Wikipedia is tested
Page 73: How software that runs Wikipedia is tested

Communication: CucumberMaintainability: page-object gem

Browser automation: selenium-webdriver gemCombinatorial explosion: Sauce LabsCode reuse: mediawiki-selenium gem

(Speed: parallel_tests gem)Help wanted: Ruby

Works at my machine: RVM, Bundler gem

Page 74: How software that runs Wikipedia is tested

How to fail at test automation?

11/9

Page 76: How software that runs Wikipedia is tested