20
Frans Couperus Director Global Sales, Marketing, Business Development w2bi, Inc Mobile Device Automated Mobile Device Automated Testing and Certification Testing and Certification : : Profit or Peril, Pain vs. Gain Profit or Peril, Pain vs. Gain

w2bi ACF Automated Device Testing and Certification · 2017. 12. 8. · ¾Automation based on Qualcomm’s ICD specification ¾Test pairs are automatically generated. If a PRL does

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

  • Frans CouperusDirector Global Sales, Marketing, Business Developmentw2bi, Inc

    Mobile Device Automated Mobile Device Automated Testing and CertificationTesting and Certification::

    Profit or Peril, Pain vs. GainProfit or Peril, Pain vs. Gain

  • Who is w2bi, Inc?Who is w2bi, Inc?

    Wireless To Business Integration

    Supplier of software solutions to the Emerging – Mature Wireless MarketsRecognized Market Leader of Automated Device Testing SolutionsSolutions deployed in USA, Canada, Korea, Taiwan, and IndiaOwned by employees and management Organically Funded from Direct OperationsCash Flow Positive since Year 1Consistent growth history throughout 10 years of operationHeadquarters and R&D in NJ, USADevelopment and Support Center in Chennai, IndiaComprehensive Test Lab in NJ, USALocal Agents serving Korea (UniOne), Taiwan (GCOM), India

  • Who is w2bi, Inc?Who is w2bi, Inc?

  • Products and ExperienceProducts and Experience

    Is Your Mobile Device Testing Platform Multi-Sweet?

    Device & Application

    Testing

    Mobile Applications

    Device Mgmt & Content Delivery

    Framework

    mVantage

    Q-GENERICQUIKPROBEQ-DAATQUIKDRIVE

    Q-POWER

  • Market Situation

    • Wireless subscriptions growth projected at 4B in 2010• Wireless device growth projected at over 3B in 2010• Number of device vendors expected to expand to meet

    the above demand and supply increased market diversification of devices.

    • Market pressure on Operator and OEM resourcesdevices becoming more complex reduced time to market intervalsshortened non-overlapping market life-cycles.

    • Subscriber Contracts & Roaming Agreements Cannot Operationalize Services

    • Low-Cost Devices infuse additional services challenges

  • Mobile Device Testing

    Lab –Network Emulated Live - Field Interop DeviceLaunch

    Testing OPEX Increases

    Safe for NetworkRF Parametric

    Minimum PerformanceSignal Conformance

    FeatureSystem DeterminationSystem DeterminationOTASP / OTAPA / OTADMMIP / DMUSMS / EMS / MMSERI / E911Data Thruput (1X/Rev 0/Rev A)

    CDG2 CDG3

  • X

    Benefits of Automated Device TestingBenefits of Automated Device Testing

  • OPEX Savings

    AddtlAddtl Benefits of Automated TestingBenefits of Automated Testing

    70%240-960180-660MIP/DMU

    61%240-300150-180E911 (call processing)

    39%120-15045-60ERI - Roaming Verification

    50%180-24090-120OTAPA

    50%300-360150-180OTASP

    39%120-15045-60Data Throughput 1X / EvDO

    39%480-600180-240EvDO Hybrid Mode SD

    42%300-480150-180System Determination

    Derivable Benefits of Automation

    ManualRun Time(Minutes)

    Automated Run Time(Minutes)

    Lab – Network Emulated Operator SpecificFeature Test Plans

  • Fully Automated & Unattended Testing Environment

    Tests are automatically executed, full control of both the handset and emulation hardware

    No Need for User Intervention

    No Inconsistencies between test engineers

    Automation based on Qualcomm’s ICD specification

    Test pairs are automatically generated. If a PRL does not generate an appropriate test pair for a given test, the test is automatically skipped

    Auto Run Time - 122 hrs (5 days)

    Man Run Time - 290 hrs (12 days)

    - Does test consistently, cost-effectively, repeatedly- Does not take vacation, get sick, or change jobs

  • Why Test System Acquisition?One of the most fundamental yet complex mobile device functions Provides insight into how a device will interact with the Live networkThe ability of a device to acquire the correct CDMA system when in either a home or roaming area is key to delivering a quality subscriber experience using cost effective wireless servicesPrevents unnecessary loss of revenue or revenue turnover to competing roaming partners

    Live Testing Challenges

    CCF & w2bi Collaboration

    Live Networks are dynamic and can impact testing reproducibilityDevice behavior can be impacted by non technical factors Finding the right live network conditions can require extensive travelLive network testing provides limited insight into device performanceDevice design variances spawn inconsistent troubles in Live Networks

  • System Determination Test Groups 1x

    7ACQUISITION MATCH ONLY2.18

    17MRU 2.15

    25OTASP DIALING2.14

    10EMERGENCY CALL ON NEGATIVE SYSTEM2.13

    1RESCAN TO A DIFFERENT GEO2.12

    3WILDCARD SYSTEM ID2.11

    3DEEP SLEEP2.10

    18SYSTEM LOST DURING TRAFFIC STATE2.9

    20SYSTEM LOST DURING IDLE STATE2.8

    26SERVICE REDIRECTION2.7

    8PRL Capacity TEST2.6

    44SILENT REDIAL2.5

    48RESCAN2.4

    3NEGATIVE SYSTEM2.3

    8AVAILABLE SYSTEM2.2

    17ACQUISITION2.1

    Test CasesTest Case DescriptionTest ID

    1X SYSTEM DETERMINATION TEST CASES - 683A

  • System Determination Test Groups 1x-EvDO

    51ACQUISITION MATCH ONLY3.20

    19MRU 3.17

    25OTASP DIALING3.16

    9EMERGENCY CALL ON NEGATIVE SYSTEM3.15

    1RESCAN TO A DIFFERENT GEO3.14

    5WILDCARD SYSTEM3.13

    9DEEP SLEEP3.12

    133SYSTEM LOST DURING TRAFFIC STATE3.11

    133SYSTEM LOST DURING IDLE STATE3.10

    43SERVICE REDIRECTION3.9

    5PRL UPLOAD TEST3.8

    4SYSTEM ACQUISITION DURING TRAFFIC STATE3.7

    5VOICE CALL DURING A DATA SESSION3.6

    92SILENT REDIAL3.5

    449RESCAN3.4

    12NEGATIVE SYSTEM3.3

    16AVAILABLE SYSTEM3.2

    42ACQUISITION3.1

    Test CasesTest Case DescriptionTest ID

    1XEV-DO SYSTEM DETERMINATION TEST CASES - 683C

  • Key Capabilities

    Dynamically generates the needed RF conditions from the PRL using w2bi patent pending technology

    Does not use any predefined presets to set RF conditions on the emulation hardware

    Supports any operators production or test PRL loaded onto either the test device or system

    Supports IS-683A and IS-683C formatted PRL files

  • Test Environment

    GPIB

    RF

    Automation Controller PC

  • GUI / CONTROLLER

    VENDOR C

    Traditional Solution Strategy

    VENDOR A

    GUI / CONTROLLER GUI / CONTROLLER

    VENDOR B

    GUI / CONTROLLER

    VENDOR D

    Decreases flexibility…. Increases cost and expense

    Increases Vendor Specific Training (times x)Lack of Vendor Consistency and Standards for UI / Test ReportsDecrease of reusable assets, both human capital and equipment capitalIncreases testing duration and test transition

  • Market Aligned Solution StrategyMarket Aligned Solution Strategy

    VENDOR A

    W2bi GUI / AUTOMATION

    VENDOR B VENDOR D

    Vendor Neutrality enables choice…… and is chosen most often

    VENDOR C

    Reduces Vendor Specific Training (times x) … Harmonizes testing experienceStandardized UI / Test Reporting… Commonality with OEM Lab Test & CertificationEnables Vendor Choices... preserving human knowledge base & vendor automationCross platform training of users … a thing of the pastCapital Investment Protection

  • Interruption TestingInterruption Testing

    Home Roam

    OTADM in progress…

    Phone in roaming mode…

    xOTADM interrupted

  • Comprehensive Results RenderingComprehensive Results Rendering

    Text verification (OCR)Text verification (OCR)

    Image verificationImage verification

  • Consistent & Comprehensive Log ReportsConsistent & Comprehensive Log Reports

    Easily sharable results in two formatsHTML logsEXCEL logs

    Detailed information regarding the steps taken to execute each test and the corresponding results identify the exact point of failure

  • Thank you

    Celebrating 10 years of your trust in usCelebrating 10 years of your trust in us

    Frans CouperusDir. Global Sales, Marketing, Business Dev

    w2bi, Inc2401 Morris Avenue

    Union, NJ [email protected]+1.908.688.1700 x14+1.732.259.0923 (m)