Alarm Instructions 20090720

Soc Classification level Alberto Calderon & Pekka Simila / 2009-07-201 © Nokia Siemens Networks

WCDMA Flexi BTSBTS Fault Trouble-shooting Instructions

• The listed documents have fault instructions – Nokia Siemens Networks WCDMA RAN, Rel. RU10, System Library, v. 2 / Flexi

WCDMA Base Station Faults DN70557975– Nokia Siemens Networks WCDMA RAN, Rel. RU10, System Library, v. 2 / RNC

Base Station Alarms (7000-7900)

• Also WCDMA BTS Site Manager Online Help has instructions for BTS faults


WCDMA Flexi BTSBTS Fault Trouble-shooting Instructions

• The Alarms listed below have trouble-shooting instructions– Antenna Line Device Failure– Antenna Line failure– RET antenna control failure– Licence missing, RET option– Licence missing, AISG MHA option– Fan failure– Rx signal level failure– VSWR alarm– Failure in optical RP3 interface– RF Module Failure– System Module Failure– Baseband Bus Failure– Failure In WCDMA WBTS O&M Connection– Customer specific alarms, EAC


WCDMA Flexi BTSQuality Of Service

• The Quality Service Alarms – Quality Of Service, WCDMA Cell Out Of Use, NBAP link failure

Trouble ticket created, LE correction in WN5.0CD2 Downloading WN5.0_4.12-172 and BTS re-commissioning might help to fix problem NBAP link failure can generate also Failure In WCDMA WBTS O&M Connection alarm and HSDPA and

HSUPA alarms

– Quality Of Service, HSDPA Configuration Failed, WBTS rejects the configuration A problem in transmission network between RNC and BTS BTS has rejected the configuration or reconfiguration of HSDPA channels RNC is unable to send the HSDPA configuration to BTS because of RNC internal problems (e.g.

congestion in Iub interface) 00 = Error in radio network configuration 01 = Error in transport layer 02 = Error in NBAP protocol layer 03 = Miscellaneous


WCDMA Flexi BTSQuality Of Service

• The Quality Service Alarms – Quality Of Service, HSDPA Failure In WCEL

This alarm is set when an HSDPA-capable BTS has sent a Resource Status Indication message via NBAP to RNC indicating that HSDPA state is changed to disabled. As a consequence of this alarm, HSDPA connections cannot be used in that particular cell.

Check the reason for the fault from the BTS WSP-related alarms.

– Quality Of Service, HSUPA Failure In WCEL A major fault (or faults) has occurred in the BTS. A unit (or units) taking care of HSUPA traffic in the WCEL

may be faulty or there is not enough capacity available on the BTS WSP cards for HSUPA service. This alarm is set when an HSUPA capable BTS has sent a Resource Status Indication message via NBAP to the RNC indicating that HSUPA state has been changed to disabled. As a consequence of this alarm, HSUPA connections cannot be used in that particular cell.

Check the reason for the fault from BTS WSP related alarms.


WCDMA Flexi BTSAntenna Line Device Failure

• Remote Trouble Shooting (done by RIC)– Update BTS SW to the latest level, WN5.0_4.12-172– Perform re-configuration commissioning without parameters modification, if settings

are OK– Click faulty RET unit in BTS Site mgr HW view to see more detailed information– To cancel AISG ALD fault alarm BTS or RF module reset is done

• Antel RET unit is not detected or SW state doesn’t change to configured state– Reason might be that serial number and product code of RET unit is not correct in

the memory of RET. Antel is request to update needed information• Andrew RET units are not calibrated, as calibration cause RET jammed alarm

– Reset BTS or RF Module to cancel RET alarm• If alarms stay active, site visit is done and all cabling is checked• If RET units and all cabling are OK, ALD failure alarm can be caused by faulty

filter module of RF module => replace RF module


WCDMA Flexi BTSAntenna Line Failure

• Radio Module (60W RRH) or Filter (all others) has detected over current on the antenna line. The antenna line may be damaged (short circuit) or some antenna line device is causing overload. All antenna line devices powered by the antenna line are out of order.

• Check the antenna line and antenna line devices. Fix or replace the faulty parts/ devices.

RET antenna control failure• Andrew and Kathrein RET units request correct antenna configuration file• Confirm antenna type and download file to RET unit• Do calibration for Kathrein antenna• Don’t calibrate Andrew antenna

– If calibration is done, reset BTS or RF-module


WCDMA Flexi BTSFan Failure Alarm

• Remote Trouble Shooting (done by RIC)– Update BTS SW to the latest level, WN5.0_4.12-172– Perform re-configuration commissioning without parameters modification– Confirm the site is alarm free after BTS reset– If alarm is still active, site visit is needed => send action information to NSN project managements

• On Site Trouble Shooting– Have spare fan module available– Check the fan and cabling rear site of module– Check that the Flexi rear cover strap doesn’t entangle with fan, see pictures below– Check fan unit’s connection of power cable connector is installed perfectly– Restart BTS after corrections and wait 5 minutes after reset that alarm is not activated anymore– If alarm is active again, replace the faulty fan module

Corrected strap installationAn entangled strap


WCDMA Flexi BTS Rx signal level failure (not combined CDMA800/WCDMA850 sites)

• Remote Trouble Shooting (done by RIC)– Update at first BTS SW to the latest SW level, WN5.0_4.12-172 and do

reconfiguration commissioning. Do not chance any parameters of BTS, if they are correct.

– Check the received signal levels from BTS Site Manager to find out which RX is causing the problem. Note: The RX value in BTS Site Manager is refreshed at one minute intervals

– If alarm is still active, site visit is needed => send action information to NSN project management

– If Prx noise level is high (also RX signal level in BTS view), check with Telus site configuration and possible extra transmitting equipment on site.

• On Site Trouble Shooting– Check the antenna cables. The radio module, antenna feeder, or antenna is

faulty on the antenna line which has the inadequate RX level. Check and replace the faulty equipment.

– Return Loss (RL) measurement confirm a performance of whole antenna system When antenna system has only antenna and RF jumper cable (2m – 5m), RL of whole

system is practically RL of antenna => system RL has to be as good or better than antenna’s RL (antenna data sheet)

RL of both antenna lines should be in same level

– Distance To Fault is used to indentify a point of fault if necessary– If antenna line and antenna are OK, replace the RF-module

Site Master

Adapter

Test Cable

XXX

Antenna

Jumper Cables


WCDMA Flexi BTSFailure in optical RP3 interface

• Remote Trouble Shooting (done by RIC)– Update at first BTS SW to the latest SW level, WN5.0_4.12-172 and do

reconfiguration commissioning. Do not chance any parameters of BTS, if they are correct.

– Depending on the alarm source, reset the RF Module, Extension System Module and/or System Module by blocking/unblocking it

– Check the other active BTS alarms and act accordingly– If alarm is still active, site visit is needed => send done action information to NSN

project management• On Site Trouble Shooting

– Have spare parts: System and RF module, Optical Transreceivers (SFP), Optical fibre cables, optical adapters

– Check the cables between the System Module and RF Module/Extension System Module. Note that dirty optical connectors may cause the signal level to drop too low => clean the optical connections by correct optical cleaning kits

– Replace the alarming module's Small Form Factor Pluggable (SFP). Check also the SFP in the other end and replace it, if needed.

– Replace the alarming RF Module/Extension System Module.– If the System Module is the only alarming source or replacing the RF

Module/Extension System Module does not clear the fault situation, replace the alarming System Module.


WCDMA Flexi BTSTelecom cell enabling or disabling failed

• The cell enabling (the setup of CPICH and BCH) failed, or the cell disabling (the release of common channels) failed. The reason could be a hardware or a bus problem, or a lack of DSP or ATM

• Check the other active alarms.• Check the number of FSP units.


WCDMA Flexi BTSCustomer Specific Alarms, EAC

• Confirm that all alarms are connected correctly• If alarms are not connected, un select alarm lines that they are not “In Use”


WCDMA Flexi BTSRF Module Failure

• Remote Trouble Shooting (done by RIC)– Update at first BTS SW to the latest SW level, WN5.0_4.12-172 and do reconfiguration

commissioning. Do not chance any parameters of BTS, if they are correct.– Check the other active BTS alarms (System Module failure, Baseband Bus failure, Failure in

optical RP3 interface and Antenna Line Device failure) and act accordingly.– Reset the alarming RF Module by blocking/unblocking it.– If alarm is still active, site visit is needed => send done action information to NSN project

managements

• On Site Trouble Shooting– Have spare parts: System and RF module, Optical Transreceivers (SFP), Optical fibre cables,

optical adapters– Note: Perform the steps below in the listed order until the alarm disappears– Check the cables between the System Module and RF Module.– If that does not help, replace the faulty RF Module.


WCDMA Flexi BTSSystem Module Failure

• Remote Trouble Shooting (done by RIC)– Reset the system module, if remote access is available– Update at first BTS SW to the latest SW level, WN5.0_4.12-172 and do reconfiguration

commissioning, if remote access is available. Do not chance any parameters of BTS, if they are correct.

– If alarm is still active, site visit is needed => send done action information to NSN project managements

• On Site Trouble Shooting– Have spare parts: System module– Reset the system module.– Replace the System Module.


WCDMA Flexi BTSBaseband Bus failure

• Remote Trouble Shooting (done by RIC)– The Flexi BTS has detected an abnormal operation or a failure in the BTS internal baseband

bus. The failure cannot be pointed to a specific module but there are several possible fault sources.

– Update at first BTS SW to the latest SW level, WN5.0_4.12-172 and do reconfiguration commissioning. Do not chance any parameters of BTS, if they are correct.

– Reset the RF Module and/or System Module, depending on the alarm source: a. Reset the RF Module by blocking/unblocking it. b. Reset the Extension System Module by blocking/unblocking it. c. Reset the master System Module.

– If alarm is still active, site visit is needed => send done action information to NSN project managements

• On Site Trouble Shooting• Note! Perform the steps below in the listed order until the alarm disappears.

– 1. Check the other active BTS alarms and act accordingly.– 2. Check the cables between the System Module and RF Module/Extension System Module.– 3. Reset the RF Module and/or System Module, depending on the alarm source:

a. Reset the RF Module by blocking/unblocking it. b. Reset the Extension System Module by blocking/unblocking it. c. Reset the master System Module.

– 4. Replace the alarming RF Module/Extension System Module.– 5. If the master System Module is the source or replacing the RF Module/Extension System

Module does not clear the fault situation, replace the alarming master System Module.


WCDMA Flexi BTSFailure In WCDMA WBTS O&M Connection

• WCDMA Cell out of use• NBAP link failure might be active also• Supplementary information fields

– 1 reason of the alarm– 1 = failure in the RNC-WBTS connection– 2 = WBTS id conflict– 2 error code is received from IUB O&M connection. This field is significant only if

the value of 1st field is 1– You can check its meaning with a command of the service terminal extension MRS

(see Service Terminal Essentials, Maintenance Manual) or from the document General Error Messages of System, Supplementary References

• Instructions– Error reason (field 1) indicates which part of the connection the problem is located.– Error code (field 2) indicates what caused the problem if the error reason (field 1)

value is 1.– Error reason = 1, failure in the WBTS connection– Error code:– 14005 = CONNECTION RESET BY PEER

WBTS has closed connection. Wait until WBTS opens new connection and system cancels the alarm. If connection does not recover in couple of minutes, check that WBTS is configured correctly to RNC and to Network.



• Instructions– Error codes:– 13960 = BAD FILE DESCRIPTOR– 13964 = PERMISSION DENIED– 13965 = BAD ADDRESS (EFAULT)– 13986 = RESOURCE TEMPORARILY UNAVAILABLE– 13989 = SOCKET OPERATION ON NON-SOCKET– 13991 = MESSAGE TOO LONG– 14006 = NO BUFFER SPACE AVAILABLE– 14008 = SOCKET IS NOT CONNECTED– 14016 = NO ROUTE TO HOST– 14608 = CONNECTION NOT EXIST

RNC attempted to send an O&M message towards the WBTS, but the connection does not exist in the RNC for the WBTS in question (code 14608) or some error occurred in TCP layer when message sending was attempted.

Check that WBTS is configured correctly to RNC and to Network. If configuration is ok, wait until WBTS opens new connection and system cancels the alarm.

– Error code: 154 = TIME LIMIT EXCEEDED IN MESSAGE WAITING WBTS supervision timer has expired. Connection is closed and RNC is waiting new O&M connection

opening from WBTS. Wait until system cancels the alarm.



• Instructions– Error codes:– 14001 = NETWORK IS DOWN– 14011 = OPERATION TIMED OUT– 14015 = HOST IS DOWN– There are problems in transmission network to WBTS. Check type of network problem with

following instructions:– Check that ATM-path is not locked.

MML commands ZLA for interface and ZLC for VP/VC link termination points. Locked ATM-path will break O&M connection or prevent new connection opening. Unlock ATM-path to allow O&M connection to be established.

– Check success of PING between RNC and WBTS: MML command: ZQRX If ping does not succeed, then the problem is in lower level of the transmission network. Check physical

connections in network. If ping does succeed, then the problem is in application level. In many cases there is also more info in OMU computer log. It can be studied with MML-command

ZDDE::"ZGSC";



• Instructions– Check the state of TCP connection to WBTS.– MML command: ZQRS

Active Internet connections listing should contain BS-O&M connection in ESTABLISHED state for each WBTS.

If the connection to WBTS does not exist, the problem is in application level with connection opening. If the connection is in other than ESTABLISHED state, the problem is in application level with connection

handling. In many cases there is also more info in OMU computer log. It can be studied with MML-command ZDDE::"ZGSC";

– Error code:– 14051 = POSIX ERROR 100

This error code is used in a situation where RNC has received connection establishment from a WBTS but there is already a connection open for the same WBTS ID but from different IP address.

This situation may occur e.g. if the WBTS sites have been improperly configured somewhere in the network so that two (or more) WBTSs have the same WBTS ID. In this case the RNC discards the new connection attempt and keeps the old connection open.

The Iub O&M traffic should be analysed to find out the cause for this behaviour.– Error code:– 10149 = SWITCHOVER

This error code is used if OMU unit switchover has occurred in the RNC and O&M connection to the WBTS has been closed because of that. The WBTS O&M connections are always handled by the OMU unit in WO-EX state so in switchover case the connections are closed. Wait until WBTS opens the O&M connection again and system cancels this alarm.

– Any other error code: Contact the local Nokia Siemens Networks representative.



• Instructions• Error reason = 2, WBTS id conflict

– More than one WBTS has been configured with the same id.• Error code:

– 255 = UNSUCCESSFUL An O&M connection for a WBTS id already exists in the RNC. This alarm was set because the same

WBTS id was used in new O&M connection establishment from a different IP address that already existing connection was established from. This happens if several WBTS have been configured with the same WBTS id under the same RNC. The supplementary text of alarm gives IP address of the conflicting WBTS.

Use BTS Manager to connect the conflicting WBTS with its IP, configure it with a different id. Depending on the WBTS release, the reconfiguration may need to be done using AXC Manager.

Cancel the alarm manually after resolving the WBTS id conflict.

• Cancelling– Do not cancel the alarm with error reason 1. The system cancels the alarm automatically when

the fault has been corrected. – The alarm with error reason 2 must be cancelled manually.– Error reason = 1: Alarm will be cancelled when BTS O&M connection is working again.– Error reason = 2: Alarm must be cancelled manually with MML command AAN or with Fault

Management application in RNC Element Manager after conflicting WBTS id situation is corrected.


WCDMA Flexi BTS: Fault Instructions

Documents

Alarm Instructions 20090720