TEMS Automatic 9.2 - Technical Product Description-1-1

8/11/2019 TEMS Automatic 9.2 - Technical Product Description-1-1

1/31

Prepared by: Date: Document : Ascom Network Testing 8/8/2013 NT13-24169

Ascom (2013). TEMS is a trademark of Ascom. All other trademarks are the property of their respective holders.No part of this document may be reproduced in any form without the written permission of the copyright holder.The contents of this document are subject to revision without notice due to continued progress in methodology, design andmanufacturing. Ascom shall have no liability for any error or damage of any kind resulting from the use of this document.

TEMS Automatic 9.2 Technical ProductDescription


2/31

Ascom (2013) Document :NT13-24169

Contents

1 Introduct ion ................................................................ 1 1.1 Key Features o f TEMS Automatic ............................................1

1.2 Who Is TEMS Automatic Intended For? ..................................2

1.3 Where to Find More Information ..............................................2

2 New Features and Functionalit y ............................... 3

2.1 Whats New in TEMS Automatic 9.2 ........................................3

2.2 What Was New in TEMS Automatic 9.1 ...................................4

2.3 What Was New in TEMS Automatic 9.0 ...................................4

3 Overview of TEMS Aut omatic ................................... 5

4 How TEMS Automatic Works .................................... 6

4.1 Testing Capabil it ies ..................................................................6

4.1.1 Voice Testing ..............................................................................6 4.1.2 Data Service Testing ..................................................................7 4.1.3 Scanning ....................................................................................9

4.2 Operator Console for Remote Probe Administration .............9

4.2.1 Workflows: Test Script Administration ......... ......... ......... ......... .....9 4.2.2 Probe Administration ................................................................ 11 4.2.3 System Administration .............................................................. 12

4.3 Measurement Probes: Remot e Test Units (RTUs) ................ 12

4.3.1 Deployment: Mobile vs. Fixed Probes ......... ......... ......... ......... ... 12 4.3.2 Radio vs. Ethernet Testing ........................................................ 12 4.3.3 Data Upload .............................................................................. 13 4.3.4 RTU Base Unit Characteristics ................................................. 13

4.4 Real-time Status Indicator (RSI): Local GUI ...................... 14

4.5 Quali ty Test Nodes ................................................................. 15

4.5.1 CallGenerator ........................................................................... 15 4.5.2 Mobile CallGenerator (MCG) .................................................... 16 4.5.3 PS Data Test Nodes ........ ......... ......... ......... ......... ......... ......... ... 16

4.6 Post-processing wit h TEMS Disc overy ............................. 17

5 Product Package, Sys tem Components ................ 18

5.1 Product Package Overvi ew .................................................... 18

5.2 RTUs ........................................................................................ 18

5.2.1 Device Support ......................................................................... 18 5.2.2 Some Examples of Typical RTU Device Configurations ......... ... 19 5.2.3 Device Capabilities ................................................................... 19 5.2.4 CS Voice Quality Testing .......................................................... 20


3/31

Ascom (2013) Document :NT13-24169

5.2.5 PS Data Quality Testing ......... ......... ......... ......... ......... ......... ...... 21 5.2.6 Interference Measurements ...................................................... 22 5.2.7 Measurement Control Capabilities ............................................ 23

5.2.8

Measurement Trigger Capabilities ............................................ 24

5.2.9 Data Upload Trigger Capabilities .............................................. 24 5.2.10 Scanning Capabilities of RTU Devices/External Scanners ........ 25 5.2.11 RTU Capabilities ....................................................................... 26 5.2.12 RTU-5 Technical Specifications ................................................ 26 5.2.13 RTU-5 Environmental Specifications ......... ......... ......... ......... ..... 27

6 TEMS Automatic System Configuration ................ 28

6.1 Scalabi li ty Options ................................................................. 28

6.2 Hardware and Sof tware Requir ements ................................. 28

6.3 Intra-system Communication ................................................. 28


4/31

Ascom (2013) Document :NT13-24169 1(28)

1 IntroductionFor true end-to-end testing of UMTS wireless networks, Ascom offers the air interface

monitoring tool TEMS Automatic.TEMS Automatic helps operators to:

Increase revenue: Problems can be located and fixed before they start affectingcustomers, improving customer satisfaction and cutting churn. Fewer blocked anddropped calls means more call time and higher earnings, and a higher quality ofservice also helps attract new subscribers.

Boost efficiency: Being autonomous, TEMS Automatic is highly cost- and staff-efficient, providing a comprehensive and continuously updated overview of networkquality.

Optimize investments: A wireless telecom network represents a huge investmentand needs optimizing to bring the best possible return. TEMS Automatic providesthe means both to collect the relevant data and to conduct analyses on which tobase wise investment decisions. It can also be used to test new features beforerollout to ensure their performance in the live network.

TEMS Automatic provides comprehensive data collection support, including servicetesting over packet-switched and circuit-switched radio bearers, The product supportsall major radio technogies, such as UMTS, CDMA and LTE, for the worldwide market.

1.1 Key Features of TEMS Automatic

TEMS Automatic is a multi-purpose solution for data collection and end-to-end testing,developed for 24/7 monitoring, troubleshooting, and benchmarking. It produces multi-level output, spanning the whole range from raw route data to KPIs.

TEMS Automatic provides users with:

Insight into the end-users perception of the network , thanks to measurementstaken in the air interface rather than at network nodes (where other monitoring toolsare used). A faithful measure of the end-to-end quality is obtained both for voice(using PESQ) and for data transfer.

24/7 measurements w ithout the cost of 24/7 staff. Every corner of the network isprobed around the clock by autonomous data collecting units. The state of thenetwork as perceived by subscribers can be fed back to technicians and modified ata pace approaching real-time control.

Automated measurements in the t ruest sense. Not only test calls andmeasurements, but also data uploading and system configuration are carried outautomatically. This enables rapid feedback on the state of the network almost inreal-time to the entire organization, all the way from RF engineers in the field tomanagement.

Benchmarking capabilities in the form of multi-device test units and mechanismsfor careful synchronization of test calls and data sessions.

Remotely conf igurable data collecting probes. Test units can have theirmeasurement instructions and their software uploaded from a central administrationconsole.


5/31


1.2 Who Is TEMS Automatic Intended For?

TEMS Automatic is designed to benefit all levels of the operators organization:

RF engineers are notified of all sorts of local malfunctions (weak signal reception,bad C/I, low data throughput, etc.), prompting them to try out various tweaks to thenetwork configuration. TEMS Automatic provides KPIs with drill-down functionalityfor evaluating network problem areas.

Managers are able to supervise the organizations processes and services. Theycan keep track of KPIs (dropped call rate targets, for example) by studying reportsautomatically distilled from measurement data at user-specified times. They areaided in making decisions on investments and organizational improvements. Bygetting a tighter grip on the networks end-to-end voice and data quality, thecompany is also in a better position to offer customers reliable service levelagreements.

Network pl anners learn about spots with recurrent problems by requestingstatistics confined to specific areas. This helps them reveal deficiencies in thenetwork layout or the underlying theoretical models, also providing input forimprovements. As a result they are able to boost network utilization and getmaximum mileage out of the existing network before new investments are made.

Marketing staff can extract statistics on usage patterns, furnishing the basis forprecisely targeted advertising campaigns. Being more intimately familiar with thenetworks quality of service, they can also work out more advanced and precisecharges for various services. It is less risky to promise, and charge for, quality thathas been thoroughly assured.

The customer care unit can order coverage information to enlighten customerswho are making complaints or enquiries. Complaints can be cross-checked againstnetwork status reports to help determine whether a problem resides in the networkor in the customers handset.

1.3 Where to Find More Information

Our monthly newsletter TEMS News contains articles on new TEMS product releasesand their features, general information on the TEMS portfolio, and much more. To signup for this free service, go to www.ascom.com/nt/en/index-nt/nt-news.htm and click theTEMS News link. In this section of our website you can also read our press releasesand find out about upcoming events where Ascom Network Testing will participate.

You can also follow Ascom Network Testing on Facebook, LinkedIn and YouTube, aswell as subscribe to our RSS feed. Links are provided in the Follow Us sectionat www.ascom.com/networktesting.
http://www.ascom.com/nt/en/index-nt/nt-news.htmhttp://www.ascom.com/networktestinghttp://www.ascom.com/networktestinghttp://www.ascom.com/nt/en/index-nt/nt-news.htm


6/31


2 New Features and Functionality

2.1 Whats New in TEMS Automatic 9.2The new features in the TEMS Automatic 9.2 release are described in more detail inthe separate document TEMS Automatic 9.2 Whats New.

What follows is a concise summary of the new features in TEMS Automatic 9.2 runningRTU-5 with Windows 7 (not valid for probes running Windows XP).

Windows 7 with support for dynamic TCP/IP, enabling enhanced stress testing (fileupload/download).

HTTP file upload: an add-on to our existing HTTP file download capability.

Streaming testing over TCP/IP, using a public server like YouTube, with MOS

quality scores calculated by the VQmon algorithm. Iperf 3.0 support, addressing the need for more efficient stress testing.

Email (SMTP, POP3/IMAP) service testing, optionally with attachments.

Multi-RAB mobile-originated call setup enhanced to support voice testing incombination with testing of any PS service and computation of associated KPIs,bringing tests closer to real-life end user behavior. Both mobile-to-mobile andmobile-to-fixed connections can be tested.

Scanning with PCTEL SeeGull MX, a multi-technology scanner. Either one MX ortwo EX units can be connected to the RTU-5. The MX requires its own direct powersupply, while the EX can be powered from the RTU-5.

Support for workflows, a TEMS common component for design and verification oftest scripts. For quicker access, the workflow designer is integrated with theOperator Console.

The RTU-5 supports the new TRP logfile format. Please note that *.trp logfilesrequire TEMS Discovery for post-processing.

The RTU-5 can house the following measurement devices:

o PCI-e Ericsson F3607 EU & US UMTS

o PCI-e Sierra Wireless MC7700/MC7710 EU & US UMTS/LTE

The RTU software platform is multi-technology ready, being capable of supportingother devices as well as other technologies (such as CDMA or TD-LTE) on request.For TEMS Automatic 9.2 this is offered as a service; please contact an Ascomsales representative for further details.

The Operator Console is capable of managing a mixed RTU fleet containing bothRTU-5 units running Windows 7 (TEMS Automatic 9.2) and older RTUs configured withWindows XP (TEMS Automatic 9.0).

For post-processing, TEMS Discovery is required to support logfiles uploaded fromRTU-5 units with Windows 7.


7/31


2.2 What Was New in TEMS Automatic 9.1(TEMS Automatic 9.1 was never released externally. It introduced a subset of thefeatures listed for TEMS Automatic 9.2 in section 2.1 above.)

2.3 What Was New in TEMS Automatic 9.0

Below is a concise summary of the new features in TEMS Automatic 9.0. Thesefeatures are described in more detail in the TEMS Automatic 9.0 Technical ProductDescription.

Introduction of RTU-5 hardware platform.

Introduction of LTE support.

New measurement device: Sierra Wireless MC77x0 (UMTS/LTE).

Enhanced voice testing with POLQA support for mobile-to-mobile testing withsupport for narrowband (8 kHz) as well as super-wideband (SWB, 48 kHz).

Support for PCTEL SeeGull EX scanner.

A set of new KPIs for DNS lookup and HTTP downlink file transfer.


8/31


3 Overview of TEMS AutomaticFor data service as well as voice testing, whether for benchmarking or general-purpose

quality monitoring, TEMS Automatic uses RTUs (Remote Test Units). These areautonomous data-collecting devices installed in vehicles traveling the network area, oralternatively in fixed locations such as airports and shopping malls.

RTUs interact with quality test nodes for voice telephony and data services. A built-inGPS unit records driving routes.

System administration is done from the Operator Console , which can be operatedthrough a Web interface. A key part of this administration is the assignment of workorders to RTUs, telling them where, when, and how to perform their testing.

RTUs make regular contact with the fixed side of the system in order to upload logfilesand receive new instructions. The logfiles are subsequently stored in a TEMS

Discovery relational database for post-processing.

TEMS Automatic system overview.

TEMS Automatic deserves its name in a multitude of ways, one basic design principle

being that the system should do a maximum of work while requiring a minimum of userintervention. Automat ion therefore pervades all the chief tasks performed: fromregistration of new RTUs (done by the unit of its own accord), through measurementand testing (handled autonomously by the RTU as instructed in work orders), todelivery of collected data (uploads are initiated by the RTUs themselves according towhatever schedule has been laid down).

TEMS Automatic is easy to learn and use , employing a familiar operating system andstandardized system components. Administration is straightforward and hassle-free:from the Operator Console, which can optionally be accessed through a Web interface,users have a complete overview of test units, work orders, and server applications.From the Operator Console the performance of each RTU can be monitored in realtime, and the test units can be upgraded remotely with new software and devicefirmware.

RTUs (RemoteTest Units)mounted in

vehicles

Fixed-mounted

RTU

Fixed part of TEMS Auto mat ic sy stem

OperatorConsole for

administration


9/31


4 How TEMS Automatic WorksThis chapter goes into more detail regarding the core functionality of TEMS Automatic:

Testing capabilities voice, data, scanning

Administration Operator Console

Measurement probes RTUs

Local GUI RSI

Quality Test Nodes including CallGenerator

The chapter is rounded out with a sketch of the post-processing tool TEMS Discovery.

4.1 Testing Capabil it ies

4.1.1 Voice Testing

4.1.1.1 Mobile-to-mobil e vs. Mobile-to-fixed

Circuit-switched voice can be tested in a variety of configurations: mobile-to-mobile between RTUs, or between devices in the same RTU; or mobile-to-fixed with RTUdevices engaging a CallGenerator connected to a PSTN network, using analog PSTNor digital E1 (ISD) voice boards.

Mobile- originated and mobile- terminated calls are distinct categories, and

comprehensive data is logged from both caller and receiver.Voice calls can be combined with concurrent data sessions in multi-RAB testing. Themain objective here is usually to find out how the data traffic affects the performance ofthe CS voice service. Any of the supported data services can be involved in multi-RABtesting.

4.1.1.2 Quality Measurement

TEMS Automatic has several algorithms for assessing audio quality in general andspeech quality in particular:

POLQA (Perceptual Objective Listening Quality Assessment), standardized as ITURecommendation P.863. POLQA is measured in a mobile-to-mobile configuration RTU to RTU, or RTU to Mobile CallGenerator , and operates in either narrowband(3003400 Hz) or super-wideband (5014000 Hz) mode.

PESQ (Perceptual Evaluation of Speech Quality), standardized as ITURecommendation P.862.1. PESQ is measured in a mobile-to-fixed configuration(RTU to CallGenerator) as well as in a mobile-to-mobile configuration (RTU to RTU,or RTU to Mobile CallGenerator 1).

1

The Mobile CallGenerator is simply a modified RTU-4Gs unit, playing precisely the same role in voicetesting as the stationary CallGenerator. See section 7.1.2.


10/31


SQI (Speech Quality Index), which uses radio link parameters to calculate theperceived speech quality on a radio channel.

Both PESQ and POLQA are designed to mimic human speech perception. Throughouttest calls, a speech sentence is played on the voice channel. The two algorithmscompute a quality estimate by comparing the transmitted sentence with the undistortedreference, also taking the fixed-side equipment into account.

PESQ and POLQA are both part of a larger package of audio quality measurements(AQM) that also includes echo delay and attenuation, speech path delay, voice jitter,volume level, and silent call detection.

By using PESQ/POLQA and SQI together it is possible to detect non-radio problemsthat affect speech quality (suggested by a good SQI and a bad PESQ/POLQA valueoccurring simultaneously).

POLQA offers differentiated narrowband and super-wideband modes, which make itpossible to compare PSTN and ISDN speech quality to that achieved with allcommonly used speech codecs in mobile networks (for example, AMR-WB).

4.1.2 Data Service Testing

4.1.2.1 General: KPIs and Events

TEMS Automatic measures throughput and decode error/retransmission rates for datatransfer in UMTS (including HSPA/HSPA+). Throughput figures always include theapplication-level throughput, that is, that experienced by the user operating the FTPclient, streaming client, or HTTP Web browser.

For packet-switched data transfer, TEMS Automatic offers a set of KPIs for rigorouslydescribing the performance of PS data services as perceived by the end-user. Theseinclude PS end-to-end access time, mean throughput, and transfer time. Further KPIsindicate failure rates: PS end-to-end non-accessibility and data transfer cut-off ratio.

A couple of measures at a lower level are KPIs in their own right (PS unavailability,attach time, attach failure ratio). Other measures of a similar nature, such as PSservice access time, are given as PIs (performance indicators).

Various events report on the status of the data connection, such as PS Attach/Detach,PDP Context Activation/Deactivation, and Routing Area Update.

4.1.2.2 IP Data Logging

TEMS Automatic has the capability to record application layer signaling for PS services(IP data logging). This is an important tool for troubleshooting PS services. Within anRTU work order, the function can be switched on and off for each PS data servicetesting action.

The IP packets are recorded in the PCAP format, which is used by several open-source packet sniffer applications including Wireshark. TEMS Automatic archives theIP data together with the regular TEMS logfiles holding RF data, and the IP and TEMSdata are time-aligned in the process.


11/31


4.1.2.3 Configuration of TCP Settings

One common reason that expected wireless data throughput rates are not achieved isa non-optimal configuration of the TCP protocol in the client. TCP profiles, defining keyparameters such as send and receive window sizes, can therefore be configured fromthe Operator Console and assigned individually to RTU devices. A suite of predefinedTCP profiles for LTE, HSPA, EDGE, and GPRS is delivered with TEMS Automatic.

4.1.2.4 Choice of Data Connection: NDIS vs. RAS

Like TCP settings, the choice of data connection type RAS or NDIS substantiallyaffects end-user performance, especially for high throughputs. For users desiring totake full advantage of HSPA throughput capabilities, an NDIS data connection ispreferable to RAS. Test unit devices supporting NDIS can therefore be configured fromthe Operator Console to use either NDIS or RAS.

4.1.2.5 Video Streaming

TEMS Automatic can test video streaming over HTTP from video upload sites on theWeb (public servers), using Internet Explorer 9 as Web browser.

The viewer-perceived streaming quality is evaluated using the VQmon algorithm.Developed by Telchemy, VQmon bases its scoring on a parametric model taking IPsniffing data (among other things) as input. The algorithm is content-sensitive, whichmeans that it allows properties of the streamed video to influence the quality scores,preventing inexpertly shot or edited footage from unduly biasing the scores. Forexample, VQmon detects blank or frozen images as well as suspiciously blurry footage

that might result from the camera not being properly controlled.

4.1.2.6 Messaging

TEMS Automatic comes with comprehensive support for testing of SMS, MMS, andemail messaging, where messages are exchanged between RTUs. Crucialperformance metrics calculated include average transfer time and send failure rate.

For receiving of email, IMAP is offered as an option alongside POP3. The IMAP(Internet Message Access) protocol for email retrieval is a refinement of POP3, which itis gradually supplanting. Emails may optionally contain attachments.

4.1.2.7 Throughput and Latency MeasurementsThe throughput limits of the network can be probed using a number of services, notablyFTP or Iperf. The latter service is specifically designed to gauge maximum TCP andUDP bandwidth performance by interacting with an Iperf server.

Network latency is conveniently measured with Ping.

4.1.2.8 Web Brow sing

HTTP sessions can be conducted either with Internet Explorer (version 7 or 9) or withthe RTUs own internal Web browser. For tests aiming to imitate user behavior andoperating conditions as closely as possible, it is advantageous to use a commercialbrowser like Internet Explorer. The RTU-internal browser, on the other hand, is more


12/31


suitable when the focus is on judging network performance rather than on emulatingthe users experience.

4.1.3 ScanningScanning of radio frequency carriers is useful, for example, in comparing frequencyplans with the reality of the live network. With TEMS Automatic, this can easily be doneacross wide areas of UMTS (GSM as well as WCDMA) and LTE networks.

GSM and WCDMA scanning can be done either with the RTUs internal EricssonF3607gw embedd e d module or with an external PCTEL SeeGull MX/EX/EX miniscanning receiver. 1

GSM scanning in TEMS Automatic encompasses BSIC decoding, System Informationdecoding, and C/I measurement.

In WCDMA it is possible to do Top-N CPICH scanning on up to 12 UARFCNs at a time,as well as BCH (SIB) decoding.

System Information/SIB data underlies the generation of missing neighbor events.Basing neighbor analysis on broadcast information is a robust approach in that it doesnot rely on cell files, which have to be kept rigorously up-to-date to provide good inputto the analysis.

LTE scanning is performed with an external scanner (PCTEL SeeGull MX/EX LTE).Some examples of scanning options are:

RSSI scanning

Signal scanning

Spectrum scanning

Enhanced power scanning

Example of configuration options: For Enhanced power scanning, the bandwidth of anEARFCN to be scanned can be selected from 100 kHz up to 20 MHz, and theresolution can be adjusted in steps of 2.5 kHz.

4.2 Operator Console for Remote Probe Administ ration

The Operator Console is a PC-based client application whose principal function is tocontrol the measurement probes (RTUs). It incorporates a design tool for composing

RTU workflows. Other tasks handled from the Operator Console include monitoring ofserver applications as well as various system administration tasks.

4.2.1 Workflows: Test Script Administr ation

Every operation of a test probe is controlled by a workflow , specifying what measurements to make, where and when to make them, and for how long. Thestructure of the workflow supports sequential as well as parallel testing, the latterincluding multi-RAB testing (concurrent voice and data sessions).

1 Scanning with the Ericsson F3607gw module will be reintroduced in TEMS Automatic 9.2.1.


13/31


A workflow may consist of a simple task or multiple tasks, whose execution may begoverned by control logic: loops, branching, ifelse conditions, and more.

Also notable in this context is the possibility of running multiple PS data sessions withinthe same PDP context , with fixed or random-length pauses between the sessions.The user can also control whether or not PS Attach and PS Detach will be performedfor every measurement and included in the logfile. If the user enables the work orderoption Always PS Attached, several data sessions can be run consecutively, and noDetach/Attach sequence is performed between measurements (for example: PS Attach PDP Context Activation Measurement PDP Context Deactivation PDPContext Activation Measurement ...). This pattern provides a closer mimicking ofend-user behavior: an entire testing sequence can be conducted within the same PDPcontext, just as a commercial smartphone would.

In the script designer, a workflow is assembled by picking measurement activities fromthe left-hand pane and inserting them by drag and drop at the desired position, asexemplified in the screenshot that follows.

Workflow scripts are currently compatible with RTU-5 units equipped with TEMS Automatic 9.2 software. Earlier probes use the older work order structure for testinginstructions.

4.2.1.1 Data Recording

During execution of a work order, radio parameters in combination with IP traceparameters are recorded; during data service testing, the performance of the data connection is measured in parallel.


14/31


15/31


All available software and firmware releases are arranged in a tree structure, wherethey are sorted by release number, cellular technology, and supporting hardware. Asoftware upgrade is made by drag-and-drop to the target RTU group. The version

numbers of the software and firmware currently running on an RTU can be inspected inits properties dialog.

4.2.2.4 Data Upload

RTU data upload behavior, too, is specified by the Operator Console user. A range ofoptions is provided: the RTU may be set to upload at a fixed time of day, or right aftereach test is finished, or when the vehicle ignition is turned off. Regarding the wake-upupload, see section 4.3.3.

There is also the possibility of uploading selected logfiles manually, from selectedRTUs. This is done with the Manual Upload Tool, launched from the Operator Console.

4.2.3 System Administ ration

Among system administration functions may be mentioned the ability to control anddifferentiate user access to the Operator Console. New users can be assigned topredefined user groups with set privileges.

4.3 Measurement Probes: Remote Test Units (RTUs)

4.3.1 Deployment: Mobile vs. Fixed Probes

RTUs are primarily intended as unattended mobile probes to be installed in vehicles,preferably ones that are in intensive circulation and cover a lot of ground, such as taxis,company cars, or buses used for public transportation. Trains and ferries, too, may besuitable as RTU carriers.

Traveling outdoors, the RTUs will usually have line-of-sight to GPS satellites, enablingpositioning of measurement data using the RTUs built-in GPS or a connected externalGPS.

While designed mainly for outdoor use, RTUs can also be deployed indoors . They arethen installed in fixed locations with known coordinates: in airports, subway/railway/busstations, shopping malls, sport and entertainment venues, or other public places.

4.3.2 Radio vs. Ethernet Testing

The core area of application of TEMS Automatic is testing of mobile networks, andspecifically their radio interfaces in their successive incarnations UMTS, CDMA/EV-DO, and LTE.

Follwoing the trend of handsets interacting with both fixed and mobile telephonynetworks, TEMS Automatic has the ability to do PS data service testing over anEthernet connection , using fixed-mounted RTUs.


16/31


4.3.3 Data Upload

RTUs automatically upload their data to the fixed side on a regular basis, according touser-specified rules. Compare section 4.2.2.4. An advanced option of special interest isthe wake-up upload, where the RTU starts up independently of regular operation (forexample, at night) to transfer its data, and then goes back to sleep.

Uploads take place over any device that is currently assigned to this task. The uploaddevice can be either dedicated , in which case it is not used for measurement, orshared , which means it is tasked with both upload and measurement (though notsimultaneously).

For stationary RTUs, the Ethernet port can be used for data testing and even for dataupload of log files.

4.3.4 RTU Base Unit Characteristics

The RTU is based on a ruggedized computer platform , accommodating up to fourmeasurement devices in its four internal PCI-e slots, and further equipped with twoUSB ports where external measurement devices can be connected.

Additionally, the RTU is configured with an in-built 8-slot SIM switch , seamlesslyshared across all measurement devices and accessible from the outside, so that SIMscan be easily changed.

The RTU also includes an internal GPS , essential for mobility. Alternatively, the RTUcan connect to an external GPS, which can of course be one with dead reckoningfacilities.

RTUs can be cascade connected , which is ideal when several RTUs are installed atthe same location: the test units can then share a GPS and be monitored with thesame Remote Status Indicator application. 1

All of the above strengths render the RTU base unit flexible and scalable and hencefit for a variety of benchmarking and quality monitoring scenarios. Benchmarkingbecomes scrupulously fair by employing the same measurement devices for all partiesbeing compared.

Embedded measurement devices (PCI-e modules) commonly used at present areEricsson F3607gw Mobile Broadband Modules and Sierra Wireless MC7700/MC7710data cards.

External devices supported using the USB ports are PCTEL EX and MX, andsimplifying the installation they can be mounted onto the RTU by means of a specialmounting plate.

The RTU has an external power outlet, through which it can power supply externaldevices such as a PCTEL EX scanner. Please note that the PCTEL MX scanner musthave its own direct power supply; it cannot use the RTU external power outlet.

Extrernal accessories like antenna combiners and uninterruptible power supply (UPS)can be mounted onto the RTU by means of a special mounting plate.

1 This function will be reintroduced in TEMS Automatic 9.2.1.


17/31


Protective covers can be fastened onto the front and rear panels of the RTU to protectcables and cable connectors, making the RTU installation even more reliable androbust.

The RTU is stackable : Up to four RTU units can be mounted effortlessly on top ofeach other by means of a simple stacking kit with spring pins, without any need fortools. See the image on the right below.

For demanding tasks like stress tests or lab tests, any RTU devices not in use can beswitched off remotely from the Operator Console to free up system resources andenhance performance.

Please refer to the Product Package Description for further details on configurationoptions and performance characteristics.

Top left : Remote Test Unit (RTU-5), fron t panel. Bo ttom left: RTU-5, rear panel. Right: Two RTUs(RTU-4Gs model) stacked using t he stacking k it. Note the spring pins , which make for easymounting. On t he RTU-5, all cables exit thr ough the rear panel, further simp lifying the mount ingprocedure.

4.4 Real-time Status Indicator (RSI): Local GUI

RTUs operate autonomously without requiring human interaction. Nonetheless, it maysometimes be desirable to monitor the status of RTUs more closely. For this purposeTEMS Automatic offers Real-time Status Indicator (RSI) as an option with RTU. This isan auxiliary application installed on a laptop PC which displays status information onthe RTUs connected to it. Such a setup enables the vehicle driver to effortlesslysupervise all data collecting units.

The RSI application is particularly useful during directed testing, such as benchmarkingsessions where the tester is assigned to perform a predetermined number of calls. It isthen easy to verify that the correct number of calls is in fact made.

RSI monitors RTU measurement activities (CS, PS, scanning), the status of eachinternal and external device, data uploads, GPS coverage, DSP status, memory usage,


18/31


and software upgrading. A set of line charts show important radio parameters. Finally,a map view is provided to allow inspection of RTU driving routes.

RSI can be connected to the RTUs either via a router or with a LAN cable using adaisy-chain configuration. Data can be displayed for up to 18 connected devices.

Screenshot of Real-time Status Indicator (RSI). The symbols along the time axis indicate eventssuch as voice calls, data service testing, and data uploads.

4.5 Quality Test Nodes

The quality test nodes in the TEMS Automatic system are used for end-to-end testingof customer-perceived voice and data service quality.

4.5.1 CallGenerator

The CallGenerator is a stationary component based on a commodity server platform. It

has processing power to concurrently calculate test scores for a whole fleet of RTUscalling in. The test calls, which can be both mobile-originated (MO) and mobile-terminated (MT), are carried by telephone lines connected to digital or PSTN (analog)voice boards.

The CallGenerator configuration very thoroughly supports CS voice testing, bothnarrowband and wideband, with a rich set of KPIs being computed which are alignedwith ETSI definitions. Among these are MOS scores calculated for PESQ and POLQA..

Additionally, the CallGenerator has the capability to measure things like echo delay andattenuation, speech path delay, voice jitter, volume level, as well as the TEMS-specificSQI quality index. It also detects silent calls.


19/31


To enable calculation of PESQ/POLQA, authentic speech sentences are played on thevoice channel during test calls. The CallGenerator computes the quality scores for theuplink, while the RTU handles the downlink calculation.

Recordings scoring sufficiently low on the PESQ or POLQA scale (the user sets thethreshold) are saved to a special directory, where they can be inspected and replayedusing suitable software. The recordings are A-law quantized with 8 bits and have 8 kHzsampling frequency.

The CallGenerator also has a facility for recognition of tone signals emitted by themobile station. Registered tone signals are recorded in the database.

PCI Express or PCI boards are used in the CallGenerator to allow greater flexibility inselecting PC hardware, either digital E1 (ISDN) boards or PSTN boards.

4.5.2 Mobile CallGenerator (MCG)

The Mobile CallGenerator is a mobile unit (a modified RTU-5) whose function is entirelyanalogous to the stationary CallGenerator. That is, test units dial the MCG givinginstructions for the voice test that is to follow, and the MCG responds by calling back. Itneeds to be noted that the call handling capacity of the MCG is limited by the numberof devices it has installed.

4.5.3 PS Data Test Nodes

Data test nodes can be located within the operators network or anywhere in theInternet. They consist of a computer running Microsoft IIS FTP server or Microsoft IISWeb server. Data test nodes for streaming are named streaming data nodes.

By deploying data test nodes both within their own cellular network and elsewhere inthe Internet, operators can determine whether communication problems reside in theirown infrastructure or have external causes.

Over a packet-switched connection, all supported data services can be tested.

When testing FTP, the data test node will be the RAS/FTP server in the TEMS Automatic system, or any Microsoft IIS FTP server that allows the test unit to readand write data.

When testing HTTP download, the data test node can be any Web site.

For HTTP file upload, the destination can be any HTTP server, which however

needs to have a special script installed. Iperf testing is done against a server running Iperf software.

Streaming using public servers is designed to work with most commonly usedstreaming sites.

Email has support for both POP3 and IMAP on the receiving side, while the senderuses SMTP.

For further details, please refer to the tables in section 5.2.


20/31


4.6 Post-processing with TEMS Discovery

TEMS Discovery is Ascoms state-of-the-art post-processing tool for wireless network

data, including data from TEMS Automatic. This product is covered in its own TechnicalProduct Description, to which we refer; here, we will only state a few highlights ofTEMS Discovery.

Unmatched range of processed data. No competing product can match thevariety of information elements that TEMS Discovery handles, allowing thoroughanalysis of the data collected.

Easy and extensive cust omization capabilities: The various views and dataexplorers can be arranged in countless combinations. Data can be presented inmultiple sub-views for easy side-by-side comparison, or in more conventional viewswith maps, time series, messages, tables, histograms, and reports the choice isyours. In addition, TEMS Discovery includes a fully customizable report template

builder, key information settings, analysis sets for specific tasks, and much more. Low total cost of ownership: The software can be deployed with minimal IT

system requirements and with minimal dependence on third-party software. Largevolumes of data are handled with low memory demand, and the intuitive, easy-to-learn interface speeds up analysis. There is also integrated online access to free orlow-cost GIS data sources.

Flexible deployment architecture: The network configuration is easy with minimalplatform requirements, allowing engineers to collaborate across functional roles andlocations. The processed data, refined into highly organized information with anunlimited number of composite data sets, is instantly accessible throughout theorganization.


21/31


5 Product Package, System Components

5.1 Product Package OverviewThe standard product package consists mainly of the following components:

TEMS Automatic system license (comprising licenses for all TEMS Automaticcomponents)

User documentation DVDs.

Please note that DVDs with TEMS Automatic software and requisite third-partyapplications are not included in the product package, since these applications areinstalled on-site for the customer by Ascom Network Testing staff.

Test units are likewise not part of the TEMS Automatic product package but are

ordered separately, along with the accessories required for in-vehicle installation. Atthe RTU level, too, a number of features are options which are ordered separately foreach RTU, including the data card and licenses for connecting various externaldevices, for mobile-to-mobile voice testing with RTUs, for PESQ/POLQA voice qualitymeasurement, and for testing various other services.

5.2 RTUs

5.2.1 Device Support

5.2.1.1 RTU-4 (Windows XP) with TEMS Automatic 9.0 RTU-4Gs with Windows XP, with dedicated upload device

o Sierra Wireless MC8700 UMTS/HSPA+

o Sierra Wireless MC8801 UMTS/HSPA+

o Sierra Wireless MC7700 LTE MIMO/UMTS HSPA+

o Sierra Wireless MC7710 LTE MIMO/UMTS HSPA+

o Ericsson F3607 EU/US UMTS HSDPA

o External scanning: PCTEL EX GSM/WCDMA/LTE

o Device scanning: Ericsson F3607 EU/US GSM/WCDMA

5.2.1.2 RTU-5 (Windows XP) with TEMS Automatic 9.0

RTU-5 with Windows XP, with or without dedicated upload device

o Sierra Wireless MC7700 LTE MIMO/UMTS HSPA+ (100 Mbit/s)

o Sierra Wireless MC7710 LTE MIMO/UMTS HSPA+ (100 Mbit/s)

o Ericsson F3607 EU/US UMTS HSDPA (DL 7.2 Mbit/s)


o Device scanning: Ericsson F3607 EU/US GSM/WCDMA


22/31


5.2.1.3 RTU-5 (Windows 7) with TEMS Automatic 9.2

RTU-5 with Windows 7, with or without dedicated upload device

o Sierra Wireless MC7700 LTE MIMO/UMTS HSPA+o Sierra Wireless MC7710 LTE MIMO/UMTS HSPA+

o Ericsson F3607 EU/US UMTS HSDPA


o External scanning: PCTEL EX Flex GSM/WCDMA/LTE

o External scanning: PCTEL MX GSM/WCDMA/LTE

5.2.2 Some Examples of Typical RTU Device Configurations

The table below gives some examples of device configurations for an RTU-5 runningWindows 7. These configurations are suitable for regular quality and coveragemonitoring as well as for demanding stress testing.

Please note that the overall performance of the RTU is dependent on its deviceconfiguration. For testing at very high throughputs, it is wise to disable any RTUdevices that are not needed for that particular test (see section 4.3.4) .

For further details about RTU configuration and dimensioning, refer to ProductPackage description.

RTU-5 DeviceConfiguration Slot 1 Slot 2 Slot 3 Slot 4

4 F3607 F3607 F3607 F3607 F3607

2 F3607 + 2 MC77x0 F3607 F3607 MC77x0 MC77x0

1 F3607 + 1 MC77x0 F3607 MC77x0

3 F3607 + 1 MC77x0 F3607 F3607 F3607 MC77x0

1 MC77x0 MC77x0

5.2.3 Device Capabili ties

The table below lists some important attributes and capabilities of RTU-5 devices.

DeviceCapability

EricssonF3607gw

Sierra WirelessMC8801



WCDMA band 850/1900/2100 or900/1900/2100

MHz

800/850/900/1900/2100 MHz

900/2100 MHz 800/850/1900/2100 MHz


23/31


DeviceCapability

EricssonF3607gw




GSM band 850/900/1800/1900 MHz

850/900/1800/1900 MHz

900/1800/1900MHz

850/900/1800/1900 MHz

LTE band DD800/1800/2100/2600 MHz

700/1700/2100MHz

GSM/WCDMAvoice

AMR-WB, AMR-FR, AMR-HR,EFR, FR, HR

N/A N/A N/A

GSM/GPRS/EDGE

Multislot class 10(GPRS, EDGE)




WCDMA R99/HSPA

HSDPACategories up to

7.2 Mbit/s(Category 18)

HSUPACategories up to

2.0 Mbit/s(Categories

1, 3, 5)



(Evolved HSPA),or up to 42.2

Mbit/s with DualCarrier

(Category 24)







(Category 24)







(Category 24)



LTE LTE Categoriesup to 100 Mbit/sDL and up to 50

Mbit/s UL, with 20MHz bandwidth

(Category 3,MIMO)

LTE Categoriesup to 100 Mbit/sDL and up to 50

Mbit/s UL, with 20MHz bandwidth

(Category 3,MIMO)

5.2.4 CS Voice Quality Testing

RTU-4Gs wi th TA 9.0 RTU-5 wi th TA 9.0 RTU-5 wi th TA 9.2

DeviceCapability

EricssonF3607gw

SierraWirelessMC8700/

8801


7710

EricssonF3607gw


7710

EricssonF3607gw


7710

Voice SQI N/A N/A N/A N/A

Voice PESQ N/A N/A N/A N/A


24/31


25/31



DeviceCapability

EricssonF3607gw


8801


7710

EricssonF3607gw


7710

EricssonF3607gw


7710

(UMTS) (UMTS) Planned Planned

WAP 1/2(UMTS) (UMTS)

Videostreaming(VSQI)

(UMTS) (UMTS)

Videostreaming overHTTP withVQmon

Email: SMTP,POP3/IMAP

Iperf 3.0(UDP/TCP)

5.2.6 Interference Measur ements


DeviceCapability

EricssonF3607gw


8801


7710

EricssonF3607gw


7710

EricssonF3607gw


7710

C/I (GSM)

C/A (GSM)

Ec/No(WCDMA)

SIR (WCDMA)

SIR Target(WCDMA)


26/31


27/31


5.2.8 Measurement Trigger Capabili ties


TriggerCapabilities

EricssonF3607gw


8801


7710

EricssonF3607gw


7710

EricssonF3607gw


7710

Date/time

Area

CGI (Cell Id)

Rx Level

RSCP

Distance

5.2.9 Data Upload Trigger Capabili ties


TriggerCapabilities

EricssonF3607gw


8801


7710

EricssonF3607gw


7710

EricssonF3607gw


7710

Interval

Startup

Shutdown

Fixed time per day

After action

Manual RSI

Manual OC


28/31


5.2.10 Scanning Capabili ties of RTU Devices/External Scanners

The PCTEL EX column is valid for both EX, EX mini and EX Flex scanners.

Capability/deviceEricssonF3607gw

PCTELSeeGull EX

(including miniand Flex)

PCTELSeeGull MX

GSM scanning capabilities

RSSI scanning static ARFCN set

RSSI scanning BSIC decoding

RSSI scanning C/I measurement

RSSI scanning system Info decoding

Spectrum analysis

WCDMA scanning capabilities

Pilot scanning static SC set

Pilot scanning Top N

Pilot scanning SIB decoding (continuous)

Pilot scanning SIB decoding (snapshot)

Pilot scanning high speed/high dynamic

P-SCH + S-SCH

Max number of UARFCNs 12 12 12

SCH time slot scanning

RSSI scanning

Spectrum analysis

Network analysis

LTE scanning capabilities

RSSI scanning N/A

Signal scanning N/A

Enhanced signal scanning N/A

Spectrum scanning N/A

Enhanced power scanning N/A


29/31


5.2.11 RTU Capabili ties

RTU Capabil it ies RTU-4Gs wi th TA 9.0 RTU-5 wi th TA 9.0 RTU-5 wi th TA 9.2

Upload device (SIM) DedicatedSIM slo t

Configurable(SIM slot 14)

Configurable(SIM slot 1 4)

Disable device remotely

Set as fixed test unit

Set low voltage limit

GPS Ethernet synch (setmaster/slave remotely)

GPS Ethernet synch-daisy-chain connected

Planned

GPS Ethernet synch-router connected

Set power-off delay

Set SBAS support for GPS

5.2.12 RTU-5 Technical Specif ications

Property Value/Description

Operating system Windows XP/XP Pro embedded

Windows Embedded Standard 7

Input voltage range 6.0 ... 32.0 V DC Max. 6A

Power consumption RTU with 2 internal measurement devices: 31.1 W

RTU with 3 internal measurement devices: 34.6 W

RTU with 3 internal + 2 external devices: Max. 60 W

RTU with 4 internal + 1 external device: Max. 60 W

Dimensions (h w d) 50 260 176 mm

Weight 2.6 kg

Operating temperature 30C ... +50C a

CPU Intel Core i7

Internal memory 2.0 GB

a. Maximum temperature may be affected by technology and measurement device used.


30/31


Property Value/Description

Non-volatile memory 8.0 GB

Number of GPS channels 16

Conformity CE, compliant with FCC rules, CFR 47, Part 15,Subpart C, Intentional radiator, Paragraph 15.209

5.2.13 RTU-5 Environmental Specifications

The RTU-5 is RoHS compliant, i.e., it satisfies the requirements in the Restriction ofHazardous Substances directive adopted by the EU.


31/31

6 TEMS Automatic System Configuration

6.1 Scalability Options A TEMS Automatic system can be configured in different ways to suit a wide variety ofcustomer needs. The dimensioning of the back-end part is dependent on manyparameters, most importantly the number of test units and the measurement tasks tobe performed. For small networks, a compact server that supports up to four test unitsis available; from this minimum size, the TEMS Automatic system can be expanded tosuit any network. Please contact us for further information on scaling and customizationof TEMS Automatic.

6.2 Hardware and Software Requi rements

The TEMS Automatic system components (Operator Console/ Call Generator/ RemoteStatus Indicator) run on Windows-based platforms. The requirements for the serversand PCs to be used to run TEMS Automatic are determined by the TEMS Automaticconfiguration selected. Processor speed, RAM, and disk space requirements willtherefore be identified by a customer-specific installation project in each case.

General OS requirements are as follows:

Server OS: Windows Server 2008/2008 R2

Client applications: Windows 7.

6.3 Intra-system Communication All components of the TEMS Automatic system communicate over standard datacommunication networks based on TCP/IP. This enables a wide variety of configurationsolutions.

The communication between the test units and the communication server is based onthe mobile data communication link.

Documents

TEMS Automatic 9.2 - Technical Product Description-1-1