UMTS Radio Access - Operator Acceptance and Performance ... · UMTS Radio Access - Operator Acceptance and Performance Testing SPIReNT 8100 MOBILe DeVICe TeST SYSTeM 0.00% 20.00%

spirent 8100 MOBiLe DeViCe test sYsteM

UMTS Radio Access - Operator Acceptance and Performance Testing

APPLICATIONS

Manufacturers:• Research & Development• Design verification• Performance analysis• Benchmarking• Regression test

Operators:• Pre-launch evaluation• Acceptance test• Mobile applications test• Software regression test• End user and network KPI

analysis

Spirent 8100 UMTS Radio Access - Performance solutions decrease the time and cost required to verify fundamental and critical capabilities of mobile devices which are not fully addressed by today’s conformance/certification test standards: data throughput, call reliability and mobility. Real-world device performance in these areas is a major contributor to an optimal end-user experience, which in turn helps to assure network operator and device manufacturer success.

Data Throughput Test Packs automate performance testing of handsets, data cards and embedded modules from physical to application layer, including Rx diversity support. Call Reliability and Mobility Test Packs provide automated testing of a device’s ability to reliably make and maintain voice and data calls across 2G and 3G networks. Testing is carried out under realistic conditions using flexible multi-cell, multi-RAT network emulation, including radio channel conditions and interfering cells. Powerful data analysis and reporting tools deliver comprehensive KPIs for evaluating performance of a single device or for benchmarking of multiple devices.

UMTS Radio Access - Performance test capability is part of the Spirent 8100 Mobile Device Test System - an open, scalable multi-purpose test system that is expandable beyond initial testing needs. The system meets a range of high-value mobile device testing requirements using highly capable components including an SR3420 Network Emulator with network-grade protocol stacks to enable delivery of high-quality devices to end users.

BeNefITS• Reduce time to market – run more tests on a single,

automated platform• Reduce device returns and customer churn through improved

device quality – identify 2G/3G data performance and call reliability/mobility issues under real-world conditions in the lab

• Address the entire lifecycle of testing needs with a single solution – R&D, DVT, Benchmarking/Evaluation, Acceptance, Applications, Regression

• Purchase only the capability you need, when you need it – offered with turnkey and user-customizable test modules and scenarios; upgradeable to A-GNSS location performance and conformance testing

Delivers automated solutions for repeatable data throughput, call reliability and mobility performance analysis of HSPA, WCDMA and GSM/GPRS/EDGE devices.


SPIReNT 8100 MOBILe DeVICe TeST SYSTeM

Data Throughput

• Multi RAB - simultaneous PS & CS call

• HSPA Physical & Application Layer Data Rate Tests

• Multi-cell option (3 WCDMA, 1 GSM) to create interference and neighbor cells

• Programmable CQI vs. TBS table to evaluate CQI performance/sensitivity

• Integrated RX Diversity

• Integrated Sweep Looping Functions

• Dynamic control and monitoring

• Fixed or Normal CQI tests

• FTP, HTTP, & UDP Protocol

• Static and Dynamic Fading Conditions

• Programmable Uplink (U/L) and Downlink (D/L) Rates Up to Full-rate ~21 Mbps

• UDP Protocol Bi-Directional and Multi-hour Stress test

• Round Trip Latency tests (Short Ping and Long Ping)

• 2.5G GPRS/EDGE Option

KeY feATUReSCall Reliability and Mobility

• Multi-cell option (3 WCDMA, 1 GSM) to create interference and neighbor cells

• Mobile Terminated and Mobile Originated call support

• PS, CS, and Multi-RAB scenarios

• UE Measurement Accuracy tests

• Call Setup & Call Maintainability tests

• Data Call Reconfiguration

• SHO & HHO Call Maintainability (PS and CS support)

• GSM, WCDMA, HSPA and HSPA+ support

• 2G-3G Inter-RAT Handover and Reselection testing

• Service Recovery and Service Availability

• Downlink Power Usage tests

• Measurement & reporting of key End User KPIs including:

• Call Drop Rate, Call Setup Failure Rate

• Measurement & reporting of key Parametric KPIs including:

• Handover and Reselection Success Rate and Connection Establishment Time

• Complete device automation through either:

• Configurable AT commands

• Pre-defined API interface

Powerful reporting tools enable device throughput performance benchmarking.



ADVANCeD AUTOMATION AND CONfIGURABLe TeST CASeS Spirent’s industry-leading Test Manager provides the highest level of test automation and visibility into the performance of the device under test. Test Manager enables development of custom, automated tests for regression, pre-compliance, or network operator acceptance test requirements without the need to write complex scripts or code. Customizable parameters such as network reselection, handover, and MAC-hs criteria allow device performance to be fully characterized under a wide range of real-world network settings.

The ability to make run-time changes to test case parameters greatly simplifies device debugging. Pending test case parameters can be changed after a test session has begun to adjust the focus of an investigation while working through test scenarios to isolate issues.

WIDe RANGe Of PeRfORMANCe TeST PACKSUMTS Radio Access - Performance test coverage is grouped into Test Packs, enabling test coverage to be matched to testing and budgetary requirements. Test Packs address 2G and 3G packet and circuit switched environments, as well as full multi-cell mobility scenarios. Data Throughput Test Packs address data throughput performance testing of GPRS/EDGE and WCDMA/HSPA/HSPA+ devices. In additional to single-cell 2G and 3G call reliability, the Call Reliability and Mobility Test Packs address advanced scenarios such as Inter-RAT Handover, Inter-RAT Reselection and Out of Service Recovery to provide modeling of real-world issues not effectively covered by current standards-based conformance/certification testing.

Test Suites tune parameters in a group of core test cases from one or more Test Packs to align with a particular test plan or test standard. Test Suites are maintained by Spirent to ensure they evolve with the test plan or standard.

UMTS Radio Access - Performance Test Packs offer a wide range of flexible test coverage options.

Test Manager enables test parameters to be easily customized.

OPeRATOR ACCePTANCe TeSTINGSpirent 8100 Radio Access Performance solution offers a broad range of automated, preconfigured and validated test cases based on operators’ test plans. The turnkey Data Performance, Call Reliability, Mobility, Voice Quality, and Adversarial Data tests allow operators and their vendors to greatly improve their device development and evaluation cycle – meaning faster time to market. In addition to pre-configured tests, the solution also offers operators the flexibility to develop a broader range of performance tests, quickly and easily creating custom, automated test suites for existing or new test plans.

ReSeARCH AND DeVeLOPMeNT TeSTINGFor developers and evaluators looking for the ultimate flexibility in test case creation, a Development Library option offers a powerful set of tools focused on Application, Protocol, and Physical Layer testing of devices. A UI-based “script” engine allows for rapid creation and editing of custom test cases in a multi-cell/multi-RAT environment with optional fading and noise.

Development library is ideally suited to software/hardware development, including integration, interop., regression and application testing. An integrated “RF playback engine” helps re-create an RF environment in the lab by allowing modeling and variation of features and parameters for cell power, fading, noise, Doppler frequency, phase shift, AWGN SNR and multi-path.



0.00%

20.00%

40.00%

60.00%

80.00%

100.00%

3G CS Call Maintain - Single Cell, PB3, RSCP = -95 dBm, CPICH_Ec/No = -20 dB

0.00%

20.00%

40.00%

60.00%

80.00%

100.00%

3G CS Call Maintain - Single Cell, VA120, RSCP = -95 dBm, CPICH_Ec/No = -20 dB

IN DePTH DATA ANALYSIS, AND POWeRfUL RePORTING TOOLSData Throughput and CQI Histogram charts greatly simplify the analysis of handset and data card throughput performance while running tests and during post-test analysis. The CQI histogram provides insight into how well the receiver is performing under dynamic real-world fading and noise conditions, as well as allowing benchmarking of CQI performance between devices or across firmware versions.

Event charts and logging greatly simplify the reporting of device call reliability and mobility performance, in real time and during post-test analysis. A Procedure Chart provides insight into performance of the device relative to network defined conditions during testing, which enables benchmarking of key performance metrics between devices or across firmware versions. Root cause failure analysis is aided by integrated network logging and reporting.

CONfIGURABLe ReAL NeTWORK AND Rf CHANNeL eMULATIONQuantifying the data throughput or call setup/drop rate performance of devices on live networks can be extremely challenging given their highly-variable nature. Operating parameters such as traffic variation and number of connected users can change at any time, impacting the collection of consistent field test data.

The Spirent SR3420 Network Emulator provides the ability to simulate realistic multi-cell 2G and 3G network conditions in the lab. The SR3420 is highly configurable, with a real-time state machine that delivers an experience much closer to the real network than other network emulators. It is designed to address the needs of high-speed data throughput testing by delivering up to 21 Mbps in the downlink at the application layer.

The SR3420’s range of configurable network, RNC, and Node B parameter options, from SIBs to Physical Channels enable real network settings to be reproduced. SIB Parameters such as Cell Quality Level “Qqualmin”and Handover “Reporting Range” can be all configured to test call performance under a wide range of network scenarios. In addition to providing full Inter-RAT capability, the SR3420 also supports testing of GSM, GPRS, EDGE and WCDMA using co-channel and adjacent channel interference rather than noise, since true interfering cells present a much more realistic scenario.

Powerful reporting and charting simplifies performance analysis.

Ideal for regression testing and benchmarking of call reliability performance.

Call Maintenance - Single Cell (failure Rate)

Same vendor, different device

Same device, different firmware



Spirent’s industry-leading SR5500 Wireless Channel Emulator generates realistic fading conditions that accurately and repeatably model the time-varying degradation of the RF signals received by the device due to multi-path, shadowing and propagation losses. The SR5500 allows the flexibility to choose from a suite of pre-programmed 3GPP-recommended models or to develop custom fading profiles that reflect other real-world fading scenarios.

Leading network operators and mobile device developers make use of these configurable network parameters and RF fading conditions to model a particular type of network for effective testing of device performance under specific real-world network conditions.

PROVIDeS ANSWeRS TO KeY PeRfORMANCe QUeSTIONS

• How well does Physical Layer throughput perform?

• How well does Rx Diversity perform?

• How does fading impact performance?

• How well does Application Layer throughput perform?

• How sensitive is throughput to code power or C/N?

• What is the impact of key MAC-hs parameters on throughput?

• How well does the device set up a call?

• How well does a device maintain a call?

• How reliable are calls during mobility scenarios?

• How much downlink power does a device require?

• Which device performs better in terms of call reliability and why?

• How well does a device maintain service during Inter-RAT handover?

• How well does a device recover from extended loss of service?

Address real-world device performance issues including handovers and cell reselection.

Creation of custom fading profiles is easy with the SR5500.



WCDMA, HSDPA, HSUPA, HSDPA+ (64QAM)

Number of Cells Up to 3 WCDMA/HSPA Cells; Up to 3 Interfering Cells

Bands 1, 2, 3, 4, 5, 6, 8, 9, 11

Uplink Power Control Algorithms 1 and 2

Downlink Power Control Mode 0; 1 to 6 dB

DPCH Gain -25 to -1 dB

P-CPICH, SCH, PCCPCH, S-CCPCH -40 to -1 dB

HS-PDSCH and HS-SCCH Channel Gain -40 to -1 dB

AGCH, RGCH, HICH -40 to -1 dB

Voice Calls AMR 12.2, AMR 5.9

Packet Calls UL: 64, 128, 384 kbps; DL: 64, 128, 384 kbps

Voice + Packet Calls Voice + Packet (R99); Voice + Packet (HSPA)

HSDPA/HSDPA+ UE Categories 1-14; Fixed or Normal CQI modes

HSUPA UE Categories 1-5 (10 ms TTI); CAT 4 (2 ms TTI), CAT 6 (2 ms TTI)

Handover Capability Cell Selection/Re-selection Soft Handover Intra/Inter-Frequency Hard Handover HSDPA Serving Cell Change

Ciphering Release 99, HSPA (UEA1)

OCNS Release 99 (12 codes); Release 5 and 6 (5 codes)

GSM for Inter-RAT

Number of Cells 2 GSM Cell; Up to 2 Interfering Cells

GSM Bands 850, 900, 1800, 1900

Voice call Supports AMR 12.2

Ciphering A5/1, A5/3

WCDMA to GSM Voice handover Blind, Synchronous

Channel / Propagation Conditions

Standard 3GPP Fade Models WCDMA: Case 1, Case 2, Case 3. Case 6, PA3, PB3, VA30, VA120 GSM: RA130, RA250, TU1.5, TU3, TU50, HT100

Custom Channel/RF Models (user defined)

Definable parameters with 10ms granularity: - Cell Power (Ior) - Multi-path - Fade Model/Profile - Doppler Frequency - Phase Shift - AWGN SNR

Rf Specifications

Number of Uplink RF Channels 2

Number of Downlink RF Channels** 2 Channels on A50*, A100, A300, A600 4 Channels on A304

RF Output Resolution 0.1 dB

RF Output Accuracy +/- 1 dB

AWGN SNR Ratio -30 dB to 32 dB

TeCHNICAL SPeCIfICATIONS

* Fading/Noise optional on 8100-A50 configuration. ** Upto 4 channels supported – 2 channels per SR5500 Wireless Channel Emulator.



ORDeRING INfORMATIONData Throughput testing is supported on the A50, A100, A200, A300 and A600 configurations of the Spirent 8100 Mobile Device Test System.

Call Reliability and Mobility testing is supported on the A200 (single cell test cases only), A300 and A600 configurations of the Spirent 8100 Mobile Device Test System.

1 Test Suites require one or more Test Packs.2 Available to AT&T and its authorized suppliers only.

For detailed Test Pack and Test Suite descriptions, see the Radio Access – Performance Test Packs data sheet.

Please contact your regional Spirent sales representative for detailed ordering information.

PeRfORMANCe TeSTS

Test Pack Part Number Test Pack Name & Performance Test Coverage

TM-DATA-HSDPA WCDMA/HSPA/HSPA+ Data ThroughputPhysical Layer (FRC or RMC) and end-to-end Application Layer performance covering FTP, UDP, HTTP and Round Trip Latency for WCDMA (R99) and HSPA/HSPA+ devices.

TM-DATA-EGPRS GPRS/eDGe Data ThroughputEnd-to-end Application Layer performance covering FTP, UDP, HTTP and Round Trip Latency for GPRS and EDGE devices.

TM-UCR-3GCR 3G Call ReliabilityAbility to make or maintain voice and/or data calls with one primary 3G radio link.

TM-UCR-R99-MOBILITY 3G R99 MobilityAbility to maintain voice and/or data calls while moving from one cell to another and/or performing radio link modification.

TM-UCR-HS-DL-MOBILITY 3G HSDPA DL MobilityAbility to maintain HSDPA data transfers while moving from one cell to another and/or performing radio link modifications.

TM-UCR-2GCR 2G Call ReliabilityAbility to make or maintain voice and/or data calls with one primary 2G radio link.

TM-UCR-2G3GRES 3G-2G ReselectionIdle Mode reselection performance.

TP-UCR-2G3GHCS 3G-2G Hierarchical Cell Selection3G to 3G inter-frequency and intra-frequency HCS selection and reselection performance (with a roadmap to 3G to 2G).

TM-UCR-2G3GICR Inter-RAT Call ReliabilityAbility to maintain voice calls while moving between 3G and 2G cells.

PRe-CONfORMANCe TeSTS

Test Suite Part Number Test Suite Name & Contents1

TS-DATA-PRECONF-34.121 3GPP 34.121 Section 9.2.1 Pre-ConformanceNon-validated test cases covering 3GPP TS 34.121 Sections 9.2.1 A to G.

TS-HCS-PRECONF-34.123 3GPP 34.123 Section 6.1.2 Pre-Conformance HCSNon-validated HCS test cases from 3GPP TS 34.123 Sections 6.1.2.3, 6.1.2.5, 6.1.2.10 and 6.1.2.3.10a.

OPeRATOR VALIDATION & Ue ACCePTANCe TeSTS

Test Suite Part Number Test Suite Name & Contents1

TS-DATA-EGPRS-ATT AT&T GPRS and eDGe Data Throughput2

TS-DATA-HSPA-ATT AT&T WCDMA and HSPA Data Throughput2

TS-UCR-CS-ATT AT&T Call Reliability & Data Mobility2

TS-UDL-DRIVE-TEST-ATT AT&T Simulated Drive Test2

TS-DATA-HSPA-REL7-ATT AT&T HSPA+ Data Throughput Test2

TS-UDL-DAM-ATT AT&T Device Aggressiveness Test2

TS-UDL-3G-PESQ-ATT AT&T 3G Voice Quality PeSQ with Rate Matching2

© 2010 Spirent Communications, Inc. All of the company names and/or brand names and/or product names referred to in this document, in particular the name “Spirent” and its logo device, are either registered trademarks or trademarks pending registration in accordance with relevant national laws. All rights reserved. Specifications subject to change without notice. Rev. B 07/10

AMeRICAS 1-800-SPIRENT • +1-818-676-2683 • [email protected]

eUROPe AND THe MIDDLe eAST +44 (0) 1293 767979 • [email protected]

ASIA AND THe PACIfIC +86-10-8518-2539 • [email protected]



SPIReNT GLOBAL SeRVICeSSpirent Global Services provides a variety of professional services, support services and educa-tion services — all focused on helping customers meet their complex testing and service assurance requirements. For more information, visit the Global Services website at www.spirent.com/gs or contact your Spirent sales representative.

Documents

UMTS Radio Access - Operator Acceptance and Performance ... · UMTS Radio Access - Operator Acceptance and Performance Testing SPIReNT 8100 MOBILe DeVICe TeST SYSTeM 0.00% 20.00%