ti13.1 training slides

48
TEMS Investigation April 2012 © Ascom 1 TEMS INVESTIGATION 13.x

Upload: dzung-tran-viet

Post on 18-Apr-2015

317 views

Category:

Documents


7 download

TRANSCRIPT

Page 1: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 1

TEMS™ INVESTIGATION 13.x

Page 2: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 2

Mohd Nizam Mohamed Senior Technical Consultant

TEMS Support APAC

ASCOM Network Testing Sdn Bhd Tel: +603- 50215275

Office Suite No. 2, Level 10

Empire Tower 2, Empire Subang

Jalan SS16/1

47500 Subang Jaya

Selangor Darul Ehsan, Malaysia Hotline: +603-5021 5202 http://www.ascom.com/tems [email protected]

TEMS Support:

[email protected]

Page 3: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 3

AGENDA

Module 1: Introduction

Module 2: Software Installations and Recommended Settings

Module 3: TEMS Investigation User Interface

Module 4: Connecting Equipments

Module 5: Service Control Designer & Service Control Monitor

Module 6: Collecting & Analyzing Data

Module 7: Reports & Exports

Module 8: Use Cases

Page 4: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 4

TEMS INVESTIGATION 13.1

Module 1: Introduction

Page 5: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 5

Objectives

After completing this module you will be able to:

• Describe the general functionalities of TEMS Investigation

• Understand the different licensing solutions available

• Identify the different devices used in TEMS Investigation

[ INTRODUCTION]

Page 6: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 6

Data collection and real-time troubleshooting

On-screen post-processing

Reporting

WHAT IS TEMS INVESTIGATION?

[ INTRODUCTION ]

Page 7: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 7

SOURCES OF DATA (1/2)

TEMS Investigation receives information from a number

of different sources

Phones and UEs

Scanners and phone-based scanners

PC cards and USB modems

Embedded modules

Fixed Wireless Terminals

AQM module

In-building positioning

GPS receivers

Cell definition files

Logfiles

[ DATA COLLECTION ]

Page 8: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 8

SOURCES OF DATA (2/2)

Phones, Scanners, PC cards, USB

modems, and Fixed Wireless

Terminals provides TEMS Investigation

with information about the Radio Access

Network

Connected via USB, serial or Ethernet port*

Auto detection of devices

Data communication via RAS and NDIS*

There are differences between devices

from different vendors and between

models from the same vendor

Technologies and frequencies supported

Services supported

Information reported (measurement reports,

signaling etc.)

Features and measurement functionality

Device behavior control functionality

The correct device license is required on

the license key to connect a specific

device

*Dependent on device

[ DATA COLLECTION ]

Page 9: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 9

LICENSING

License type

Single license (only 1 phone/UE can be connected at one time).

Multiple license (more than 1 phones/UEs can be connected at one time).

Network License (shown already)

Remote upgrade of license is available in the utilities function

Page 10: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 10

LICENSING

How to obtain the device license

Send the .c2v file to [email protected]

Provide the serial no. of the USB dongle.

Provide the PO no. if possible for verification.

TEMS Support will provide the .v2c file

Activate it using the remote update license utilities.

Plug in the USB dongle into the USB port

Make sure that the LED light of the usb dongle is light up

Run the remote update license utilities from TEMS Investigation

Extract out the .c2v file

Page 11: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 11

AUTO DETECTION OF EQUIPMENT

Auto detection of equipment

Nearly all of the devices that are connectable in TEMS Investigation

are detected and enabled automatically

Some few devices have to be enabled manually

Non-verified equipment can be manually added to the auto detection

list via the manual UE configuration utility

Devices that have been detected by TEMS Investigation

appear in the Equipment Configuration window

[ DATA COLLECTION ]

Connect and GO!

Page 12: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 12

CONTROL OF DEVICE BEHAVIOUR

TEMS Investigation allows the user to

control the device to cause specific

behavior

Perform specific measurements

Create certain scenarios for testing purposes

Devices from Sony Ericsson have the

highest level of control functionality

Some examples of control functionality*

Lock to RAT

PLMN selection and Access class control

Speech codec selection

Control of Layer 3, Discard message

WCDMA Band and cell selection/Barred control

Modify BLER target (WCDMA)

WCDMA/HSPA Capability control

GSM Band and cell selection/Barred control

GSM Handover - Lock/Prevent/Disable

TX Power setup (GSM)

GSM/EDGE Capability control

GSM Cell selection/Barred control

TX Power setup (GSM)

[ DATA COLLECTION ]

Be in control!

*Differs between devices

Page 13: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 13

LOGFILE UPLOAD

Automatic transfer of logfiles to FTP server

Simplifies ways of working and reduces lead times

Quick access to logfiles for complete organization

FTP upload workflow

File transfer window

Specify or load FTP server settings

Automatic or manual file transfer

Logfiles compressed

Minimize amount of data to upload

[ DATA COLLECTION ]

Efficient handling of logfiles

Page 14: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 14

OFFERED VS. SUPPORTED DEVICES

TEMS Investigation supports more than 200

different measurement devices

Not all these devices are offered by TEMS

TEMS delivers devices from

Sony Ericsson

Nokia

Option

PCTEL

DRT

Many devices not supplied by TEMS are

verified with TEMS Investigation

Most of these are based on Qualcomm chipsets

[ DATA COLLECTION ]

Page 15: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 15

DEVICES AVAILABLE THROUGH ASCOM

Sony Ericsson

W995

W995a

W995 EDGE

Nokia

N96 EU

N96 US

Option

GlobeTrotter Express 441

[ DATA COLLECTION ]

Page 16: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 16

DEVICES AVAILABLE THROUGH ASCOM

PCTel

EX WCDMA 2100 GSM 900/1800

EX WCDMA 900/2100 GSM 900/1800

EX WCDMA 850/1900 GSM 850/1900

EX WCDMA 2100 AWS GSM 1900

EX WCDMA 2100 AWS GSM 850/1900

LX Dual Band WCDMA 850/2100

EX mini WCDMA 2100

EX mini WCDMA 900/2100

EX mini WCDMA 850/1900

EX mini WCDMA 2100 AWS

LX Dual band GSM 850/1900

LX Dual band GSM 900/1800

LX Single band 1x 450

LX Single band EV-DO 450

EX 1x 850/1900 EV-DO 850/1900 DL

EX mini LTE Upper 700-C/2100 AWS

EX LTE 2600/1800

EX mini LTE 2600

EX mini LTE Lower 700-A/B/C (UL/DL)

EX LTE Upper 700-C/Lower 700-A/B/C (UL/DL)

EX PCTEL EX mini TD 2000

EX PCTEL EX TD 2000 GSM 900/1800

Sony Ericsson

Scanner, W995 EDGE

Scanner, W995

Scanner, W995a

DRT

DRT 4301A LTE, 900/1800/2100/2600

DRT 4301A LTE, 700/850/1900/2100 AWS

DRT 4301A WiMAX, 2.5/3.5 GHz

DRT 4301A WiMAX, 2.3/2.5 GHz

[ DATA COLLECTION ]

Page 17: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 17

For latest information on supported devices, visit our technical support page

DEVICES SUPPORTED BY TEMS INVESTIGATION

Includes devices from:

Sony Ericsson

Nokia

Motorola

Qualcomm

Huawei

LG

Sierra Wireless

Option

Novatel

Toshiba

Samsung

Kyocera

C-motech

Axesstel

AnyData

PCTEL

DRT

Anritsu

[ DATA COLLECTION ]

Use the device that meets your requirements!

Page 18: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 18

GPS POSITIONING

A GPS receiver can be connected for geographical

positioning of the collected data

External GPS

GPS integrated in scanners

NMEA 0183

Garmin USB protocol

Plot information on a map

Verify, analyze, troubleshoot, etc.

A list of recommended GPS units can be found on

our technical support page

[ DATA COLLECTION ]

Page 19: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 19

IN-BUILDING POSITIONING

Portable data collection indoors and in pedestrian

areas where there is no GPS coverage

Positioning by “Walk and Click”

Manual positioning (pin-pointing)

TEMS Investigation reconstructs the route by joining

consecutive waypoints

Maps, blueprints, or user drawings as background

Geographical coordinates can be assigned to a blueprint in

bitmap or uncompressed TIF format

Indoor Backpack for easy handling

Use a laptop or a pen-tablet PC

[ DATA COLLECTION ]

Use TEMS Investigation for indoor measurements

Page 20: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 20

CELL DATA

TEMS Investigation can present information on

individual cells in cellular networks

Location, power settings, antenna configurations, etc.

Cell data can be provided in two ways

Plain-text XML file format

Plain-text, TEMS Investigation-specific format

Use cell data when collecting or analyzing data

Draw cells on maps

Display cell names in various windows

Utilize in logfile reports

[ DATA COLLECTION ]

Adds valuable information

Page 21: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 21

RECORDING OF DATA

Speedy access to the most central functions of TEMS Investigation

Most of these functions are mirrored in the menus and connected to keyboard shortcuts

Use the toolbar or keyboard shortcuts to perform recording-related tasks

Data can be viewed in real-time, in any presentation window, while recording

START/STOP

RECORDING

INSERT

FILEMARK

PAUSE

RECORDING

EQUIPMENT

PROPERTIES SWAP

LOGFILES

[ DATA COLLECTION ]

Intuitive graphical user interface

Page 22: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 22

SERVICE QUALITY TESTING

Page 23: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 23

INTRODUCTION

In addition to traditional RF data, L2/L3 messages, and IP

information collection, TEMS Investigation supports testing

of CS and PS services including

Voice and video telephony

WAP, MMS, SMS, FTP UL/DL, HTTP, and Ping

E-mail send/receive and Video streaming

UDP testing

Command sequence to support service testing

Simplifies the data collection, by prerecording all the

commands to be given to the UE

Advanced event controlled sequence functionality

Application layer information presented

The actual measurement on the end user’s perceived

data service performance

[ SERVICE QUALITY TESTING ]

Page 24: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 24

COMMAND SEQUENCE

Simplifies data collection, by prerecording

all the commands to be given to the UE

Automation of data collection

Repetition of test scenarios

Multiple command sequences

Supported data applications*

Video Streaming and E-mail

WAP, SMS, MMS, FTP, HTTP and Ping

UDP

Voice and video telephony*

Including AQM (PESQ)

Support for KPI measurements

Nested loops

Time or number of times

Other commands categories

General, recording and equipment control (AT)

commands

*Dependent on device and technology

[ SERVICE QUALITY TESTING ]

Saves time and guarantees consistent measurements

Page 25: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 25

VOICE, VIDEO TELEPHONY AND VIDEO STREAMING

Measuring speech quality (SQI)

Speech Quality Index (SQI) estimates the speech

quality as perceived by a human listener

Proprietary algorithm

Measuring speech quality (PESQ)

Reference speech quality measurements

ITU Recommendation P.862

Measuring video streaming quality

Video Streaming Quality Index (VSQI) estimates

the viewer-perceived video and audio quality

Proprietary algorithm

Measuring video telephony quality

Video Telephony Quality Index (VTQI) estimates

the viewer-perceived video and audio quality

BLER based

Proprietary algorithm

[ SERVICE QUALITY TESTING ]

Measure your service quality

Page 26: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 26

AUDIO QUALITY MEASUREMENTS

TEMS Investigation supports AQM/PESQ and SQI measurements

PESQ (ITU P.862.1) is an algorithm designed to mimic human speech perception. A speech

sentence is played on the voice channel, and PESQ is computed by comparing the transmitted

sentence with an undistorted reference.

SQI (Speech Quality Index) is a proprietary algorithm which uses radio link parameters to

calculate the perceived speech quality on a radio channel.

TEMS Investigation supports mobile-to-mobile and mobile-to-fixed

AQM/PESQ measurements

Use SQI as complement to AQM/PESQ measurements

[ SERVICE QUALITY TESTING ]

Flexible AQM/PESQ solution

Page 27: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 27

SPEECH QUALITY INDEX (SQI)

A proprietary algorithm which uses radio link parameters to calculate the

perceived speech quality on a radio channel

DL measurements

Computing SQI for GSM/WCDMA requires Sony Ericsson phones.

SQI for CDMA can be enabled by any CDMA phone that is supported by TEMS Investigation

No additional HW is required

Input to SQI-MOS algorithm

Frame error rate

Bit error rate*

Speech codec used

SQI output is presented in dBQ* or MOS scale

[ SERVICE QUALITY TESTING ]

Powerful speech quality estimation

*Valid for GSM and WCDMA

Page 28: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 28

AQM/PESQ MEASUREMENTS

TEMS Investigation supports AQM/PESQ measurements

Mobile-to-mobile and mobile-to-fixed

AQM is more than PESQ

TEMS Investigation’s AQM/PESQ solution

TEMS Investigation with AQM license option

UE that supports AQM measurements

- Sony Ericsson W995*, W995a* and W995 EDGE*

- Kyocera KX5

AQM module including cable kit

Call Generator and/or Mobile Receiving Unit (MRU)

Stand-alone or mounted in backpack or equipment case

[ SERVICE QUALITY TESTING ]

Full reference speech quality measurements

*Planned to be introduced in TEMS Investigation 10.1.x

Page 29: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 29

Call Generator

(with PESQ module)

TEMS Investigation Test terminal AQM Module

Command sequence

TEMS Investigation

Converter

Merged logfile containing both

PESQ DL and UL scores

Logfile containing

PESQ DL scores

Received degraded audio

(from Call Generator)

PESQ DL Score

Reference audio

MOBILE-TO-FIXED AQM/PESQ MEASUREMENTS

[ SERVICE QUALITY TESTING ]

PESQ UL scores in XML files (copy/download)

Voice call

PESQ UL score

Transmitted audio Reference audio

Page 30: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 30

AUDIO QUALITY MEASUREMENTS

Use TEMS Investigation to monitor end-to-end speech quality

Perform AQM/PESQ measurements with a Call Generator, mobile receiving

units, or a mix of both

Mobile-to-fixed and mobile-to-mobile

Note the difference between the two solutions, in areas like measurements,

dimensioning, troubleshooting, and workflow

PESQ UL and DL vs. PESQ DL

One radio link affecting each PESQ score vs. two radio links affecting each PESQ score

Impact of PSTN vs. impact of MRU location

Capacity of Call Generator vs. number of MRUs

Workflow and control

Use SQI measurements as a complement, when troubleshooting

[ SERVICE QUALITY TESTING ]

Create your own solution

Page 31: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 31

UDP TESTING

UDP measurements are executed via the command sequence

Built in UDP client supporting send, receive, or full duplex

User defined throughput or best throughput

Interacts with UDP server (created as a Windows service)

UDP measurements can be performed over RAS or NDIS

Independent of RAN technology

[ SERVICE QUALITY TESTING ]

UDP testing in Command Sequence

Page 32: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 32

ANALYSIS

Page 33: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 33

INTRODUCTION

TEMS Investigation can be used to process and analyze logfiles from

TEMS Investigation, TEMS™ Pocket, and TEMS™ Automatic

The flexibility allows users to change presentation windows to match specific

requirements and optimize the analysis view for different tasks

More than 1,000 information elements (IE) and 150 events available

TEMS Investigation supports replay of logfiles and simultaneous analysis of

multiple logfiles

The tool contains features and predefined tasks to filter data and perform daily

analysis of coverage, handover, calls, and user-defined event counters

[ ANALYSIS ]

Turn data into information

Page 34: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 34

MEANS OF PRESENTATION

Presentation views

Line and Bar charts

Map window

Status windows with data in tabular form

Event counters

Message windows listing messages, reports, and events

Full synchronization between windows

Flexible configuration

Pre-configured windows

User-configurable/Built on information elements and events

All settings are saved in workspaces that can be

reused or shared between users

[ ANALYSIS ]

Page 35: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 35

FLEXIBLE CONFIGURATION

Presentations

All windows are user-configurable and synchronized

Create specific windows presenting your own unique set of data

- Define information to be included

- Define how it should be presented (color, size, etc.)

More than 100 predefined presentation windows

Combine presentation windows in Worksheets

All presentations are built on information elements (IEs)

Derived from the different sources of data

- Air interface measurements

- Data service measurements

- Network configuration parameters and cell data

- Positioning data

[ ANALYSIS ]

Total flexibility – optimize the windows to match your needs

Page 36: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 36

EVENTS

Events signify interesting occurrences relating to the operation of the connected equipment Events are generated by the TEMS Investigation software based on

data received from these devices

Quick identification of trouble areas

Define own events by composing logical expressions Occurrence of other event

Appearance of Layer 3 message

Value change of information element

Value of information element meeting threshold condition

Allowed logical operators are AND, OR, XOR, and NOT

Events can be presented in the map window, line charts, and message windows Audio indications for events

[ ANALYSIS ]

Enables focus on critical data

Page 37: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 37

LINE AND BAR CHARTS

Line charts are used to visualize how information evolves over time Plot IEs and events

Additional information

Bar charts present successive snapshots in time of a selected set of IEs Multiple presentation modes

- Single IE with multiple components

- Components from multiple IEs

- Parallel coordinates presentation

Additional information

Useful when presenting frequency scanning information

Create your own charts or use predefined line and bar charts

Flexible configuration

[ ANALYSIS ]

Page 38: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 38

MAP – DATA COLLECTION MODULE

Displays collected data geographically

on map

Requires positioning data (GPS or pin-pointing)

Supports MapInfo, bitmap, or uncompressed

TIF map formats

Flexible configuration

Presentation of any measured information

element

Display of any event

Cell site indication

Antenna orientation visualized per sector/cell

Serving cell/Active Set/Best Server indication

Neighbor relations indications

Integrated information pane

Basic measurement statistics

Event counters

Detailed site information

CDF/PDF distribution graphs

[ ANALYSIS ]

Graphical presentation of data

Page 39: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 39

STATUS WINDOWS AND EVENT COUNTERS

Status windows present information elements in

tabular form for a specific point in time

Static or dynamic monitors

Flexible configuration (style and content)

Event counters keep track of the number of times a

set of events has occurred

Copy content to Windows clipboard

Data selector in Route analysis module

Create your own or use predefined windows

Flexible configuration (style and content)

Templates and wizards

[ ANALYSIS ]

Page 40: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 40

MESSAGE WINDOWS

Message windows are used to list

messages (message flow) and

reports received or transmitted by

external devices

Layer 2 messages, Layer 3 messages,

mode reports, data reports, events, error

reports, and IP analysis information

Detailed message decoding

Information that can be presented in

message windows

Equipment, mobile system, event and

message symbols, message info and name,

information element, and protocol

Create your own or use predefined

message windows

Flexible configuration

Mix messages, reports, and events in same

window or use individual windows

[ ANALYSIS ]

Page 41: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 41

REPORTING

Page 42: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 42

REPORT GENERATOR – LOGFILE REPORT

The Logfile (HTML) report summarizes the data in logfiles

The report includes:

Date and time of report generation

File names and used equipment

Detailed statistics on crossing of thresholds (by cell)

Event statistics

Distribution bar charts of quality parameter measurements,

and statistics on these measurements

The output involving cell data naturally requires a cell file

in order to be generated

[ REPORTING ]

Page 43: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 43

EXPORT OF LOGFILES

TEMS Investigation allows export of logfiles

Logfiles can be converted to plain-text (ASCII) files

with tab-separated columns

For further analysis in a spreadsheet program

Logfiles can also be exported in formats that are

compatible with

MapInfo

ArcView

Planet

Ethereal

MDM

Export to Google Earth is facilitated in the map window

[ REPORTING ]

Page 44: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 44

LOGFILE COMPATIBILITY WITHIN TEMS PORTFOLIO

TEMS Investigation

TEMS Pocket

[ REPORTING ]

TEMS Automatic

TEMS Discovery

TEMS Investigation logfiles

can be analyzed in:

TEMS Investigation

TEMS Presentation

TEMS Discovery

TEMS Investigation can be

used to analyze logfiles from:

TEMS Automatic

TEMS Pocket

TEMS Presentation

Page 45: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 45

SUMMARY

Page 46: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 46

SUMMARY

Data collection and real-time troubleshooting

Support for a variety of terminals and scanners

Multi-technology capabilities

Data collection as well as service testing

Drive testing and indoor data collection

On-screen post-processing

Multiple means of presentation and total flexibility

Single logfile replay as well as post-processing of multiple logfiles

Reporting

HTML based report generator

[ SUMMARY ]

All in one tool!

Page 47: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 47

LEGAL DISCLAIMER

This document contains specific forward-looking statements, e.g. statements including terms like

“believe”, “expect” or similar expressions. Such forward-looking statements are subject to known and

unknown risks, uncertainties and other factors which may result in a substantial divergence between

the actual results, financial situation, development or performance of Ascom and those explicitly

presumed in these statements.

Against the background of these uncertainties readers should not rely on forward-looking

statements. Ascom assumes no responsibility to update forward-looking statements or adapt them to

future events or developments.

Page 48: TI13.1 Training Slides

TEMS Investigation April 2012 © Ascom 48

THANK YOU!

221 09-FAP 901 0950 Rev A