TEMS Investigation April 2012 © Ascom 1
TEMS™ INVESTIGATION 13.x
TEMS Investigation April 2012 © Ascom 2
Mohd Nizam Mohamed Senior Technical Consultant
TEMS Support APAC
ASCOM Network Testing Sdn Bhd Tel: +603- 50215275
Office Suite No. 2, Level 10
Empire Tower 2, Empire Subang
Jalan SS16/1
47500 Subang Jaya
Selangor Darul Ehsan, Malaysia Hotline: +603-5021 5202 http://www.ascom.com/tems [email protected]
TEMS Support:
TEMS Investigation April 2012 © Ascom 3
AGENDA
Module 1: Introduction
Module 2: Software Installations and Recommended Settings
Module 3: TEMS Investigation User Interface
Module 4: Connecting Equipments
Module 5: Service Control Designer & Service Control Monitor
Module 6: Collecting & Analyzing Data
Module 7: Reports & Exports
Module 8: Use Cases
TEMS Investigation April 2012 © Ascom 4
TEMS INVESTIGATION 13.1
Module 1: Introduction
TEMS Investigation April 2012 © Ascom 5
Objectives
After completing this module you will be able to:
• Describe the general functionalities of TEMS Investigation
• Understand the different licensing solutions available
• Identify the different devices used in TEMS Investigation
[ INTRODUCTION]
TEMS Investigation April 2012 © Ascom 6
Data collection and real-time troubleshooting
On-screen post-processing
Reporting
WHAT IS TEMS INVESTIGATION?
[ INTRODUCTION ]
TEMS Investigation April 2012 © Ascom 7
SOURCES OF DATA (1/2)
TEMS Investigation receives information from a number
of different sources
Phones and UEs
Scanners and phone-based scanners
PC cards and USB modems
Embedded modules
Fixed Wireless Terminals
AQM module
In-building positioning
GPS receivers
Cell definition files
Logfiles
[ DATA COLLECTION ]
TEMS Investigation April 2012 © Ascom 8
SOURCES OF DATA (2/2)
Phones, Scanners, PC cards, USB
modems, and Fixed Wireless
Terminals provides TEMS Investigation
with information about the Radio Access
Network
Connected via USB, serial or Ethernet port*
Auto detection of devices
Data communication via RAS and NDIS*
There are differences between devices
from different vendors and between
models from the same vendor
Technologies and frequencies supported
Services supported
Information reported (measurement reports,
signaling etc.)
Features and measurement functionality
Device behavior control functionality
The correct device license is required on
the license key to connect a specific
device
*Dependent on device
[ DATA COLLECTION ]
TEMS Investigation April 2012 © Ascom 9
LICENSING
License type
Single license (only 1 phone/UE can be connected at one time).
Multiple license (more than 1 phones/UEs can be connected at one time).
Network License (shown already)
Remote upgrade of license is available in the utilities function
TEMS Investigation April 2012 © Ascom 10
LICENSING
How to obtain the device license
Send the .c2v file to [email protected]
Provide the serial no. of the USB dongle.
Provide the PO no. if possible for verification.
TEMS Support will provide the .v2c file
Activate it using the remote update license utilities.
Plug in the USB dongle into the USB port
Make sure that the LED light of the usb dongle is light up
Run the remote update license utilities from TEMS Investigation
Extract out the .c2v file
TEMS Investigation April 2012 © Ascom 11
AUTO DETECTION OF EQUIPMENT
Auto detection of equipment
Nearly all of the devices that are connectable in TEMS Investigation
are detected and enabled automatically
Some few devices have to be enabled manually
Non-verified equipment can be manually added to the auto detection
list via the manual UE configuration utility
Devices that have been detected by TEMS Investigation
appear in the Equipment Configuration window
[ DATA COLLECTION ]
Connect and GO!
TEMS Investigation April 2012 © Ascom 12
CONTROL OF DEVICE BEHAVIOUR
TEMS Investigation allows the user to
control the device to cause specific
behavior
Perform specific measurements
Create certain scenarios for testing purposes
Devices from Sony Ericsson have the
highest level of control functionality
Some examples of control functionality*
Lock to RAT
PLMN selection and Access class control
Speech codec selection
Control of Layer 3, Discard message
WCDMA Band and cell selection/Barred control
Modify BLER target (WCDMA)
WCDMA/HSPA Capability control
GSM Band and cell selection/Barred control
GSM Handover - Lock/Prevent/Disable
TX Power setup (GSM)
GSM/EDGE Capability control
GSM Cell selection/Barred control
TX Power setup (GSM)
[ DATA COLLECTION ]
Be in control!
*Differs between devices
TEMS Investigation April 2012 © Ascom 13
LOGFILE UPLOAD
Automatic transfer of logfiles to FTP server
Simplifies ways of working and reduces lead times
Quick access to logfiles for complete organization
FTP upload workflow
File transfer window
Specify or load FTP server settings
Automatic or manual file transfer
Logfiles compressed
Minimize amount of data to upload
[ DATA COLLECTION ]
Efficient handling of logfiles
TEMS Investigation April 2012 © Ascom 14
OFFERED VS. SUPPORTED DEVICES
TEMS Investigation supports more than 200
different measurement devices
Not all these devices are offered by TEMS
TEMS delivers devices from
Sony Ericsson
Nokia
Option
PCTEL
DRT
Many devices not supplied by TEMS are
verified with TEMS Investigation
Most of these are based on Qualcomm chipsets
[ DATA COLLECTION ]
TEMS Investigation April 2012 © Ascom 15
DEVICES AVAILABLE THROUGH ASCOM
Sony Ericsson
W995
W995a
W995 EDGE
Nokia
N96 EU
N96 US
Option
GlobeTrotter Express 441
[ DATA COLLECTION ]
TEMS Investigation April 2012 © Ascom 16
DEVICES AVAILABLE THROUGH ASCOM
PCTel
EX WCDMA 2100 GSM 900/1800
EX WCDMA 900/2100 GSM 900/1800
EX WCDMA 850/1900 GSM 850/1900
EX WCDMA 2100 AWS GSM 1900
EX WCDMA 2100 AWS GSM 850/1900
LX Dual Band WCDMA 850/2100
EX mini WCDMA 2100
EX mini WCDMA 900/2100
EX mini WCDMA 850/1900
EX mini WCDMA 2100 AWS
LX Dual band GSM 850/1900
LX Dual band GSM 900/1800
LX Single band 1x 450
LX Single band EV-DO 450
EX 1x 850/1900 EV-DO 850/1900 DL
EX mini LTE Upper 700-C/2100 AWS
EX LTE 2600/1800
EX mini LTE 2600
EX mini LTE Lower 700-A/B/C (UL/DL)
EX LTE Upper 700-C/Lower 700-A/B/C (UL/DL)
EX PCTEL EX mini TD 2000
EX PCTEL EX TD 2000 GSM 900/1800
Sony Ericsson
Scanner, W995 EDGE
Scanner, W995
Scanner, W995a
DRT
DRT 4301A LTE, 900/1800/2100/2600
DRT 4301A LTE, 700/850/1900/2100 AWS
DRT 4301A WiMAX, 2.5/3.5 GHz
DRT 4301A WiMAX, 2.3/2.5 GHz
[ DATA COLLECTION ]
TEMS Investigation April 2012 © Ascom 17
For latest information on supported devices, visit our technical support page
DEVICES SUPPORTED BY TEMS INVESTIGATION
Includes devices from:
Sony Ericsson
Nokia
Motorola
Qualcomm
Huawei
LG
Sierra Wireless
Option
Novatel
Toshiba
Samsung
Kyocera
C-motech
Axesstel
AnyData
PCTEL
DRT
Anritsu
[ DATA COLLECTION ]
Use the device that meets your requirements!
TEMS Investigation April 2012 © Ascom 18
GPS POSITIONING
A GPS receiver can be connected for geographical
positioning of the collected data
External GPS
GPS integrated in scanners
NMEA 0183
Garmin USB protocol
Plot information on a map
Verify, analyze, troubleshoot, etc.
A list of recommended GPS units can be found on
our technical support page
[ DATA COLLECTION ]
TEMS Investigation April 2012 © Ascom 19
IN-BUILDING POSITIONING
Portable data collection indoors and in pedestrian
areas where there is no GPS coverage
Positioning by “Walk and Click”
Manual positioning (pin-pointing)
TEMS Investigation reconstructs the route by joining
consecutive waypoints
Maps, blueprints, or user drawings as background
Geographical coordinates can be assigned to a blueprint in
bitmap or uncompressed TIF format
Indoor Backpack for easy handling
Use a laptop or a pen-tablet PC
[ DATA COLLECTION ]
Use TEMS Investigation for indoor measurements
TEMS Investigation April 2012 © Ascom 20
CELL DATA
TEMS Investigation can present information on
individual cells in cellular networks
Location, power settings, antenna configurations, etc.
Cell data can be provided in two ways
Plain-text XML file format
Plain-text, TEMS Investigation-specific format
Use cell data when collecting or analyzing data
Draw cells on maps
Display cell names in various windows
Utilize in logfile reports
[ DATA COLLECTION ]
Adds valuable information
TEMS Investigation April 2012 © Ascom 21
RECORDING OF DATA
Speedy access to the most central functions of TEMS Investigation
Most of these functions are mirrored in the menus and connected to keyboard shortcuts
Use the toolbar or keyboard shortcuts to perform recording-related tasks
Data can be viewed in real-time, in any presentation window, while recording
START/STOP
RECORDING
INSERT
FILEMARK
PAUSE
RECORDING
EQUIPMENT
PROPERTIES SWAP
LOGFILES
[ DATA COLLECTION ]
Intuitive graphical user interface
TEMS Investigation April 2012 © Ascom 22
SERVICE QUALITY TESTING
TEMS Investigation April 2012 © Ascom 23
INTRODUCTION
In addition to traditional RF data, L2/L3 messages, and IP
information collection, TEMS Investigation supports testing
of CS and PS services including
Voice and video telephony
WAP, MMS, SMS, FTP UL/DL, HTTP, and Ping
E-mail send/receive and Video streaming
UDP testing
Command sequence to support service testing
Simplifies the data collection, by prerecording all the
commands to be given to the UE
Advanced event controlled sequence functionality
Application layer information presented
The actual measurement on the end user’s perceived
data service performance
[ SERVICE QUALITY TESTING ]
TEMS Investigation April 2012 © Ascom 24
COMMAND SEQUENCE
Simplifies data collection, by prerecording
all the commands to be given to the UE
Automation of data collection
Repetition of test scenarios
Multiple command sequences
Supported data applications*
Video Streaming and E-mail
WAP, SMS, MMS, FTP, HTTP and Ping
UDP
Voice and video telephony*
Including AQM (PESQ)
Support for KPI measurements
Nested loops
Time or number of times
Other commands categories
General, recording and equipment control (AT)
commands
*Dependent on device and technology
[ SERVICE QUALITY TESTING ]
Saves time and guarantees consistent measurements
TEMS Investigation April 2012 © Ascom 25
VOICE, VIDEO TELEPHONY AND VIDEO STREAMING
Measuring speech quality (SQI)
Speech Quality Index (SQI) estimates the speech
quality as perceived by a human listener
Proprietary algorithm
Measuring speech quality (PESQ)
Reference speech quality measurements
ITU Recommendation P.862
Measuring video streaming quality
Video Streaming Quality Index (VSQI) estimates
the viewer-perceived video and audio quality
Proprietary algorithm
Measuring video telephony quality
Video Telephony Quality Index (VTQI) estimates
the viewer-perceived video and audio quality
BLER based
Proprietary algorithm
[ SERVICE QUALITY TESTING ]
Measure your service quality
TEMS Investigation April 2012 © Ascom 26
AUDIO QUALITY MEASUREMENTS
TEMS Investigation supports AQM/PESQ and SQI measurements
PESQ (ITU P.862.1) is an algorithm designed to mimic human speech perception. A speech
sentence is played on the voice channel, and PESQ is computed by comparing the transmitted
sentence with an undistorted reference.
SQI (Speech Quality Index) is a proprietary algorithm which uses radio link parameters to
calculate the perceived speech quality on a radio channel.
TEMS Investigation supports mobile-to-mobile and mobile-to-fixed
AQM/PESQ measurements
Use SQI as complement to AQM/PESQ measurements
[ SERVICE QUALITY TESTING ]
Flexible AQM/PESQ solution
TEMS Investigation April 2012 © Ascom 27
SPEECH QUALITY INDEX (SQI)
A proprietary algorithm which uses radio link parameters to calculate the
perceived speech quality on a radio channel
DL measurements
Computing SQI for GSM/WCDMA requires Sony Ericsson phones.
SQI for CDMA can be enabled by any CDMA phone that is supported by TEMS Investigation
No additional HW is required
Input to SQI-MOS algorithm
Frame error rate
Bit error rate*
Speech codec used
SQI output is presented in dBQ* or MOS scale
[ SERVICE QUALITY TESTING ]
Powerful speech quality estimation
*Valid for GSM and WCDMA
TEMS Investigation April 2012 © Ascom 28
AQM/PESQ MEASUREMENTS
TEMS Investigation supports AQM/PESQ measurements
Mobile-to-mobile and mobile-to-fixed
AQM is more than PESQ
TEMS Investigation’s AQM/PESQ solution
TEMS Investigation with AQM license option
UE that supports AQM measurements
- Sony Ericsson W995*, W995a* and W995 EDGE*
- Kyocera KX5
AQM module including cable kit
Call Generator and/or Mobile Receiving Unit (MRU)
Stand-alone or mounted in backpack or equipment case
[ SERVICE QUALITY TESTING ]
Full reference speech quality measurements
*Planned to be introduced in TEMS Investigation 10.1.x
TEMS Investigation April 2012 © Ascom 29
Call Generator
(with PESQ module)
TEMS Investigation Test terminal AQM Module
Command sequence
TEMS Investigation
Converter
Merged logfile containing both
PESQ DL and UL scores
Logfile containing
PESQ DL scores
Received degraded audio
(from Call Generator)
PESQ DL Score
Reference audio
MOBILE-TO-FIXED AQM/PESQ MEASUREMENTS
[ SERVICE QUALITY TESTING ]
PESQ UL scores in XML files (copy/download)
Voice call
PESQ UL score
Transmitted audio Reference audio
TEMS Investigation April 2012 © Ascom 30
AUDIO QUALITY MEASUREMENTS
Use TEMS Investigation to monitor end-to-end speech quality
Perform AQM/PESQ measurements with a Call Generator, mobile receiving
units, or a mix of both
Mobile-to-fixed and mobile-to-mobile
Note the difference between the two solutions, in areas like measurements,
dimensioning, troubleshooting, and workflow
PESQ UL and DL vs. PESQ DL
One radio link affecting each PESQ score vs. two radio links affecting each PESQ score
Impact of PSTN vs. impact of MRU location
Capacity of Call Generator vs. number of MRUs
Workflow and control
Use SQI measurements as a complement, when troubleshooting
[ SERVICE QUALITY TESTING ]
Create your own solution
TEMS Investigation April 2012 © Ascom 31
UDP TESTING
UDP measurements are executed via the command sequence
Built in UDP client supporting send, receive, or full duplex
User defined throughput or best throughput
Interacts with UDP server (created as a Windows service)
UDP measurements can be performed over RAS or NDIS
Independent of RAN technology
[ SERVICE QUALITY TESTING ]
UDP testing in Command Sequence
TEMS Investigation April 2012 © Ascom 32
ANALYSIS
TEMS Investigation April 2012 © Ascom 33
INTRODUCTION
TEMS Investigation can be used to process and analyze logfiles from
TEMS Investigation, TEMS™ Pocket, and TEMS™ Automatic
The flexibility allows users to change presentation windows to match specific
requirements and optimize the analysis view for different tasks
More than 1,000 information elements (IE) and 150 events available
TEMS Investigation supports replay of logfiles and simultaneous analysis of
multiple logfiles
The tool contains features and predefined tasks to filter data and perform daily
analysis of coverage, handover, calls, and user-defined event counters
[ ANALYSIS ]
Turn data into information
TEMS Investigation April 2012 © Ascom 34
MEANS OF PRESENTATION
Presentation views
Line and Bar charts
Map window
Status windows with data in tabular form
Event counters
Message windows listing messages, reports, and events
Full synchronization between windows
Flexible configuration
Pre-configured windows
User-configurable/Built on information elements and events
All settings are saved in workspaces that can be
reused or shared between users
[ ANALYSIS ]
TEMS Investigation April 2012 © Ascom 35
FLEXIBLE CONFIGURATION
Presentations
All windows are user-configurable and synchronized
Create specific windows presenting your own unique set of data
- Define information to be included
- Define how it should be presented (color, size, etc.)
More than 100 predefined presentation windows
Combine presentation windows in Worksheets
All presentations are built on information elements (IEs)
Derived from the different sources of data
- Air interface measurements
- Data service measurements
- Network configuration parameters and cell data
- Positioning data
[ ANALYSIS ]
Total flexibility – optimize the windows to match your needs
TEMS Investigation April 2012 © Ascom 36
EVENTS
Events signify interesting occurrences relating to the operation of the connected equipment Events are generated by the TEMS Investigation software based on
data received from these devices
Quick identification of trouble areas
Define own events by composing logical expressions Occurrence of other event
Appearance of Layer 3 message
Value change of information element
Value of information element meeting threshold condition
Allowed logical operators are AND, OR, XOR, and NOT
Events can be presented in the map window, line charts, and message windows Audio indications for events
[ ANALYSIS ]
Enables focus on critical data
TEMS Investigation April 2012 © Ascom 37
LINE AND BAR CHARTS
Line charts are used to visualize how information evolves over time Plot IEs and events
Additional information
Bar charts present successive snapshots in time of a selected set of IEs Multiple presentation modes
- Single IE with multiple components
- Components from multiple IEs
- Parallel coordinates presentation
Additional information
Useful when presenting frequency scanning information
Create your own charts or use predefined line and bar charts
Flexible configuration
[ ANALYSIS ]
TEMS Investigation April 2012 © Ascom 38
MAP – DATA COLLECTION MODULE
Displays collected data geographically
on map
Requires positioning data (GPS or pin-pointing)
Supports MapInfo, bitmap, or uncompressed
TIF map formats
Flexible configuration
Presentation of any measured information
element
Display of any event
Cell site indication
Antenna orientation visualized per sector/cell
Serving cell/Active Set/Best Server indication
Neighbor relations indications
Integrated information pane
Basic measurement statistics
Event counters
Detailed site information
CDF/PDF distribution graphs
[ ANALYSIS ]
Graphical presentation of data
TEMS Investigation April 2012 © Ascom 39
STATUS WINDOWS AND EVENT COUNTERS
Status windows present information elements in
tabular form for a specific point in time
Static or dynamic monitors
Flexible configuration (style and content)
Event counters keep track of the number of times a
set of events has occurred
Copy content to Windows clipboard
Data selector in Route analysis module
Create your own or use predefined windows
Flexible configuration (style and content)
Templates and wizards
[ ANALYSIS ]
TEMS Investigation April 2012 © Ascom 40
MESSAGE WINDOWS
Message windows are used to list
messages (message flow) and
reports received or transmitted by
external devices
Layer 2 messages, Layer 3 messages,
mode reports, data reports, events, error
reports, and IP analysis information
Detailed message decoding
Information that can be presented in
message windows
Equipment, mobile system, event and
message symbols, message info and name,
information element, and protocol
Create your own or use predefined
message windows
Flexible configuration
Mix messages, reports, and events in same
window or use individual windows
[ ANALYSIS ]
TEMS Investigation April 2012 © Ascom 41
REPORTING
TEMS Investigation April 2012 © Ascom 42
REPORT GENERATOR – LOGFILE REPORT
The Logfile (HTML) report summarizes the data in logfiles
The report includes:
Date and time of report generation
File names and used equipment
Detailed statistics on crossing of thresholds (by cell)
Event statistics
Distribution bar charts of quality parameter measurements,
and statistics on these measurements
The output involving cell data naturally requires a cell file
in order to be generated
[ REPORTING ]
TEMS Investigation April 2012 © Ascom 43
EXPORT OF LOGFILES
TEMS Investigation allows export of logfiles
Logfiles can be converted to plain-text (ASCII) files
with tab-separated columns
For further analysis in a spreadsheet program
Logfiles can also be exported in formats that are
compatible with
MapInfo
ArcView
Planet
Ethereal
MDM
Export to Google Earth is facilitated in the map window
[ REPORTING ]
TEMS Investigation April 2012 © Ascom 44
LOGFILE COMPATIBILITY WITHIN TEMS PORTFOLIO
TEMS Investigation
TEMS Pocket
[ REPORTING ]
TEMS Automatic
TEMS Discovery
TEMS Investigation logfiles
can be analyzed in:
TEMS Investigation
TEMS Presentation
TEMS Discovery
TEMS Investigation can be
used to analyze logfiles from:
TEMS Automatic
TEMS Pocket
TEMS Presentation
TEMS Investigation April 2012 © Ascom 45
SUMMARY
TEMS Investigation April 2012 © Ascom 46
SUMMARY
Data collection and real-time troubleshooting
Support for a variety of terminals and scanners
Multi-technology capabilities
Data collection as well as service testing
Drive testing and indoor data collection
On-screen post-processing
Multiple means of presentation and total flexibility
Single logfile replay as well as post-processing of multiple logfiles
Reporting
HTML based report generator
[ SUMMARY ]
All in one tool!
TEMS Investigation April 2012 © Ascom 47
LEGAL DISCLAIMER
This document contains specific forward-looking statements, e.g. statements including terms like
“believe”, “expect” or similar expressions. Such forward-looking statements are subject to known and
unknown risks, uncertainties and other factors which may result in a substantial divergence between
the actual results, financial situation, development or performance of Ascom and those explicitly
presumed in these statements.
Against the background of these uncertainties readers should not rely on forward-looking
statements. Ascom assumes no responsibility to update forward-looking statements or adapt them to
future events or developments.
TEMS Investigation April 2012 © Ascom 48
THANK YOU!
221 09-FAP 901 0950 Rev A
Recommended