Assure End User Experience byTesting In Real World Scenarios

Kaushik NathHead of Product Strategy, 99tests

Bharath SDirector of Operations,

99tests

About 99tests

99tests - In A Nutshell

UsabilityTesting

SecurityTesting

Functional ExploratoryTesting

AutomationTesting

LocalisationTesting

AuFnUx LnSc

150+Countries

20000+Testers

Test Case DrivenTesting

Tc

99tests Advantage

Save money & time

Access to top notch professional testers

across globe

App testing in thereal world

Easy integration

Flexible Engagement Models

Testers with Domain-Specific

Knowledge

How we work?

Requirement gathering & analysis + Test strategy creation

( Through a personalized requirement discussion, Testing needs & plans are

chalked out )

Project creation & launch Within 24 hours( Testers & validators are assigned to the projects )

Monitoring Project progress( Bug logging, Bug Validation & Testing

coverage analysis )

Project delivery( Sharing bug reports, Test Summary

Reports & Recommendations )

Crowd Testing - Relevance

Testing For Customer Experience

Real World Network Conditions

Wide Variety in Screen Size

Device coverage

Massive variety of OS versions+

Customization of OS by manufacturers

100+ Companies

Difficulty to test in a distributed environment

Real People In Real Condition

Google map vs. Apple map

Challenges In Customer Experience Testing

The Process

• Clients give broad requirements.

• Users, from the crowd, as they are like real users, are able to expand to large variety of end user expectations and requirements.

• How do we choose the crowd in such case – We carefully choose with a broad demographics and expertise

• Exploratory → Test Case (Carefully Designed) → Usability Testing with Non-Testers (Real Users).

The 99tests Process

Exploratory Test caseCarefully Designed - Maximum Coverage

Usability

Case Study - Increasing The Review Rating

A mid sized travel segment clientNo testing team, agile process, with 15 days release cycleRegular bug fixes and new features added to the applicationWeb and Mobile Web Application

What 99tests provided25 testers across the globe with a mix of travel domain expertiseCoverage of up to 50 devicesExploratory testing followed by regression cycles

Results:Reduced the number of issues identified by their actual usersIncrease the quality index of the application from 4.2 to 4.8

User Review Rating

Case Study - Enhanced End User ExperienceFor A Leading Airline Service Enterprise In The APJ Region

Large Enterprise Airline Booking PlatformHuge testing teamWeb, Android and iOS applicationMonthly release cycle

What 99tests provided50 testers across the globe with a mix of travel and ticketing expertiseCoverage of more than 50 configurationsExploratory testing followed by regression cycles

Results:Critical bugs identified before release and reported to the clientIncrease of (Internal) Quality Index from 3.8 to 4.4

Bugathon

THANK YOU