Pocket Gems Android QA Process

Embed Size (px)

Citation preview

  • 7/31/2019 Pocket Gems Android QA Process

    1/18

    Slide 1

    Defragging Your AndroidDevelopment

    Jeff DeCew Mobile Engineer

    Arjun Dayal Product Lead

  • 7/31/2019 Pocket Gems Android QA Process

    2/18

    Meet Your Presenters!

    Arjun DayalAndroid Product Lead

    MIT Course 6Former PM on Xbox

    Kinect

    Jeff DeCewAndroid Mobile Engineer

    Olin EngineeringFormer Software

    Engineer at Blue Origin

  • 7/31/2019 Pocket Gems Android QA Process

    3/18

    Pocket Gems

    Founded 2009, backed by Sequoia Capital

    14 Android and iOS and titles

    Pioneer in free to play mobile games

    1st farm game

    1st store game

    1st zoo game

    1st hotel game

    1st exploration simulation game

  • 7/31/2019 Pocket Gems Android QA Process

    4/18

    Android growth is accelerating!

    > 300 million activations to date

    850,000 new activations per day

    > 1 Billion app installs per month!

    New Google Play consolidated marketplace

    = Huge Opportunity!

  • 7/31/2019 Pocket Gems Android QA Process

    5/18

    Pocket Gems 4 titles on Android with Many More to Come!

    + ManyMore ToCome!

    Tap Zoo (iOS #1 grossingapp in 2011) Tap Zoo: Santas Quest

    Tappily Ever After Tap Safari (New!)

  • 7/31/2019 Pocket Gems Android QA Process

    6/18

    So much is involved in creating a successful game

    1. Killer game concept

    2. Intuitive UI & engaging art

    3. In-App Purchase vs. paid

    4. Backend services + scale for millions of users

    But dont forget about

    5. Device type support

    6. Memory and performance

    7. Regions & locales

  • 7/31/2019 Pocket Gems Android QA Process

    7/18

    Tip 1: Pick the rightset of devices that make your experience shine!

    Lots of choice is great, but dont let it bog you

    down

    Start with market device info

    Its better to exclude a device for launch than

    receive poor ratings from users who have a

    subpar experience

  • 7/31/2019 Pocket Gems Android QA Process

    8/18

    Tip 2: Dont forget that screen resolution matters

    Tablets vs. high res phones vs. low resphones

    Android allows you to restrict

    Scale UI appropriately

    10 tablet vs. a 4 phone yields differentresults!

    Teeny tiny button hit targets on a high resphone dont work well

    Know your limits!

  • 7/31/2019 Pocket Gems Android QA Process

    9/18

    Use the right tools

    Script your builds!

    Build with an IDE sparingly

    Sandbox your QA and Production builds

    Utilize CI systems

    Unit and integration testing with Robolectric

    Makes testing simpler and easier

    Add a cheat menu

  • 7/31/2019 Pocket Gems Android QA Process

    10/18

    Welcome to the matrix. Place your bets!

    2.1 2.2 3.1 4.0 4.0.3

    Galaxy Ace

    Droid X

    Galaxy Nexus

    Galaxy Tab (Tablet)

    LG Optimus

    Note: For illustration purposes only.

  • 7/31/2019 Pocket Gems Android QA Process

    11/18

    Welcome to the matrix. Place your bets!

    2.1 2.2 3.1 4.0 4.0.3

    Galaxy Ace

    Droid X

    Galaxy Nexus

    Galaxy Tab (Tablet)

    LG Optimus

    Note: For illustration purposes only.

  • 7/31/2019 Pocket Gems Android QA Process

    12/18

    Evolve the matrix over time with new data!

    2.1 2.2 3.1 4.0 4.0.3

    Galaxy Ace

    Droid X

    Galaxy Nexus

    Galaxy Tab (Tablet)

    LG Optimus

    90 % of $$$

    Note: For illustration purposes only.

  • 7/31/2019 Pocket Gems Android QA Process

    13/18

    Now that I have chosen, what should I be running?

    Full pass: Select devices

    Compatibility tests - "Broad, but shallow

    Touch every feature

    Minutes, not hours

    Prioritize most popular devices vs. all

    Test to the s

    Its all about risk!

  • 7/31/2019 Pocket Gems Android QA Process

    14/18

    Feedback loop is key. Leverage the tools you already have!

    Standard loop: Develop -> QA -> Release

    Google crash reporter, stats on devices, OS version,country, etc.

  • 7/31/2019 Pocket Gems Android QA Process

    15/18

    Learn from your mistakes

    Have a robust, verbose crash reporting system

    Stack traces and info stacksAutomatic deobfuscation

    Rolling log data

    Group reports hash based on partialstacktrace

    Prioritization is key

    Move on if there is not enough info

    Utilize reviews and customer support

  • 7/31/2019 Pocket Gems Android QA Process

    16/18

    Provide the right experience to the right people!

    Tiered failure schemes help everyone

    Dear QA,

    File a bug on thisissue please!

    -Android

    Dear Developer,

    Stop writing garbagecode!

    -AndroidCRASH!

    User continues on with

    normal game play, butlog is created.

  • 7/31/2019 Pocket Gems Android QA Process

    17/18

    New ICS features are compelling

    Design custom android experiences!

    Android Beam

    Resizable widgets

    Google+ integration

  • 7/31/2019 Pocket Gems Android QA Process

    18/18

    Slide

    Thanks + Q&A Were accepting resumes right now! Email

    [email protected]

    We love partnering with other developers!

    Use our new kiosk to start earning $$$ now:http://poc ketgems.co m/kiosk

    Presenters: [email protected], [email protected]