01_CN60301EN16GLA2_Introduction to ATCA Platform_Marcelo.pdf

7/24/2019 01_CN60301EN16GLA2_Introduction to ATCA Platform_Marcelo.pdf

http://slidepdf.com/reader/full/01cn60301en16gla2introduction-to-atca-platformmarcelopdf 1/65

CN60301EN16GLA2 ©2014 Nokia Solutions and Networks. All rights reserved

Introduction to ATCA Platform

AB3 version Hardware



2 CN60301EN16GLA2 ©2014 Nokia Solutions and Networks. All rights reserved

Nokia Solutions and Networks Academy

Legal notice

Intellectual Property Rights

All copyrights and intellectual property rights for Nokia Solutions and Nedocumentation, product documentation and slide presentation material, alforthwith known as Nokia Solutions and Networks training material, areproperty of Nokia Solutions and Networks. Nokia Solutions and Networks owcopying, modification, translation, adaptation or derivatives including any imdevelopments. Nokia Solutions and Networks has the sole right to copy, distmodify, develop, license, sublicense, sell, transfer and assign the Nokia Networks training material. Individuals can use the Nokia Solutions and Nematerial for their own personal self-development only, those same indivsubsequently pass on that same Intellectual Property to others without thagreement of Nokia Solutions and Networks. The Nokia Solutions and Nematerial cannot be used outside of an agreed Nokia Solutions and Netsession for development of groups without the prior written agreement of Nand Networks.




Objective

At the end of this learning element part icipant will be able to:

Describe the NSN COTS ATCA concept

List ATCA Hardware Main Features (version AB3)

Building Blocks (Cabinet, Shelf, Blades etc.)

Connectivity

Power and Cooling

Hardware Management

Notes on abbreviations:

NSN: Nokia Solutions and Networks

COTS: Commercial off the Shelf

ATCA: Advanced Telecommunications Computing Architecture




ATCA Concept


http://slidepdf.com/reader/full/01cn60301en16gla2introduction-to-atca-platformmarcelopdf 5/656 CN60301EN16GLA2 ©2014 Nokia Solutions and Networks. All rights reserved

What is ATCA?

• Advanced Telecommunications Computing Architecture

• Standardized modular architecture for telecom equipment• Supports very wide set of carrier grade applications




What is COTS ATCA HW?

• COTS = Commercial Off The Shelf

• Software or Hardware products that are ready-made and available for sale to and open market.

• NSN works as an integrator, no own HW design

• ATCA® = Advanced Telecommunications Computing Architecture (or AdvancedT

• ATCA is the largest specification effort in PCI Industrial Computer Manufacture(PICMG) history. Specification regarding to ACTA used by Nokia Solution and

• PICMG 3.x (3.0 being the base specification)

• Advanced Mezzanine Card (AMC)• The specifications mainly concentrate on three things:

• Mechanics of building blocks

• Interconnections

• HW management




PICMG- PCI Industrial Computer Manufacturers

PICMG (PCI Industr ial Computer Manufacturers Group) is a consortium of overwho collaboratively develop open specifications for high performance telecommunica

industrial computing applications .

These series of specifications incorporates the latest trends in high speed interconn

technologies, next-generation processors, and improved Reliability , Availability and S

(RAS).

PICMG 3.x (3.0 being the base specification for ATCA NSN product).

NSN is Member of PICMG Group




PCI Industrial Computer Manufacturers Group (PICMG)




Reference: Heavy Reading, Vol.7, No.9, October 2009, “ATCA, AMC & MicroTCA Market Update & Forecast”Note: According to 2013 press release, Huawei is following COTS approach as well, Ericsson still stuck.

ATCA volumes ramping up

Al

H

Er

- N

O

-N

-M-T

N

Z




Cabinet

Shelf

DSP

blad

Hub

blade

HUB

RTM

CPUblade

CPURTM

NSN preferred COTS ATCA Suppliers

AMC carrier aninterface AMCs




Nokia Solutions and Networks ATCA HW Platform




ATCA Benefits

ATCA is Shelf Based Architecture




ATCA HW Platform Development

ATCA MSS is Implemented using HW Version AB3

AB1 AB2 AB3

Component Description

ACPI4-A CPU blade

CPRT4-A CPU blade RTMwith hard disk

AHUB3-A Hub blade

HBRT3-A Hub blade RTM

ADSP1-B DSP blade (MGW)

ACAR1-B AMC carrier blade (MGW)

HDS30-A 2.5” 300GB HDD


MPPAM-B Packet processo

MPPAM-C Packet processo

SCNAM-B SDH line card AM

CPRT4-B CPU blade RTMwithout hard disk

EXTHD-A External USB HD

AB3 Hardware In ATCA MSS and MGW

AB4




Platform Model ATCA Platform

AB1, AB2,Hardware

(COTS)

Software Platform

Application

eSW

Flexi ADX2

MSS, MME,

SGSN, FNS

MGW, S/PGW,

GGSN, FNG

adaptação doDX200 para ATCA

Th HW l tf f d iff t l t




The same HW platform for different core elements

MSS

Multimedia

Gateway

Common COTS ATCA HW platform

MSC Server family

MSS/NVS,

HLRGGSN SGSN

• NSN has selected COTS ATCA ecosystem to ensure lowest possible Total CosOwnership in building and operating current and next-generation networks

MSS & MGW can be placed in same cabinet.




ATCA Main Features




ATCA Building Blocks

• ATCA HW architecture allows network elements to be createdfrom a set of basic building blocks

• ATCA building blocks

- Cabinet- Shelf- Blades- Rear Transition Modules (RTM)- Advanced Mezzanine Cards (AMC)- Interface plugs (SFP)- Power Distribution Units (PDU)- Cabling panel

Cabinet

ShelfBlade

AMC

Various internal components showing in ATCA cabinet . These compo

irrespective of type of Node.




NSN ATCA Cabinet

• NSN ATCA cabinet (EC208-A)

includes cabinet mechanics

• Can be equipped with doors

• Provides enclosure to up

to three shelves

• Several cabinets can be

interconnected

• Dimensions: 800 x 600 x 2000mm• (with doors 800x700x2000mm)

• Weight (empty) ~140kg




ATCA Cabinet




NSN ATCA shelf overview

• Weight (empty) ~36kg

• EMI shielding• blades installed to front slots

• RTMs installed to rear slots

• Includes Air filter

Alarm display2 shelf managers

2 Power Entry Modules (PEM)

3 fan modules




NSN ATCA Shelf

• NSN ATCA shelf (ACH-16A) includes enclosure, cooling, po

HW management to blades and RTMs• One shelf accommodates 16 blades and 16 RTMs

Front view Back view




ATCA Shelf with Blades, AMCs and RTMs

The ATCA shelf houses blades

and RTMs




NSN ATCA shelf FRUs

PEM module Shelf manager

module

Fan mod




• In ATCA MSS two types of blades:

- Hub Blade (with RTM)

- CPU Blade (with or without RTM)

• Empty slots are filled with Filler Blade

Blades ATCA MSS




Hub Blades

• Hub blades implement internal switching

• Base Interface (BI) switches internal traffic

• Fabric Interface (FI) switches user traffic• Two hub blade types

AHUB2-A (Type 2)

AHUB3-A (Type 3)

• Clock distribution to shelf

• Each shelf requires two redundant Hub blades

AHUB2-A

(Type 2)




Hub blade + RTM

• 10 Gigabit Ethernet hub blade

• Internal connectivity

- Redundant 10GE (FI) for each slot- Redundant 1GE (BI) for each slot

• External connectivity

- 3x 10GE XFP to FI

• Additional 2x 10GE SFP+ to FI via RTM

module

- Local management interfaces- 2x BITS/SSU RJ45 for timing and

synchronization (not in use in MSS)




AHUB3-A (ATCA HUB Blade/Type 3/Variant A) 1/2

HBRT3 A (H b Bl d R T i i d l / T 3 / V i A




HBRT3-A (Hub Blade Rear Transi tion module / Type 3 / Variant A

CPU Bl d




CPU Blades

• CPU blades provide multipurpose

processing capability to the ATCA HW

Platform• CPU blade types

ACPI2-A

ACPI4-A

ACPI4-B

• Include AMC bays

Two bays in Type 2

One bay in Type 4

• May be equipped with

hard disks ACPI2-A

(Type 2)

AC

(

CPU Bl d RTM




CPU Blade + RTM

- Nehalem-EP based CPU blade

Single socket

Quad cores @ 2.13Ghz (6 cores in ACPI4-B)

2 threads per core

3 channels DDR3

6 DIMM sockets

- Update path to Westmere (6 cores)

- AMC slot

- RTM

2x1GbE SFP ports

2 x USB 2.0

1 x Serial port (RJ-45)

SAS controller with 4 ports

1 x SAS interface

1 x 2.5” SAS HDD (currently 300GB)RTM poderá ser usada neste cas(CHU) (OMU).Tb usamos RTM para obtenção delétrico ou ótico na traseira do sh

ACPI4 A (ATCA C t l P i it / I t l / T 4 / V i t A




ACPI4-A (ATCA Central Processing unit / Intel / Type 4 / Variant A

CPRT4 A (CPU RTM / Type 4 / Variant A)




CPRT4-A (CPU RTM / Type 4 / Variant A)

• The CRTM4-A is a RTM for a Type 4

CPU blade Cannot be used with

Type 2 CPU blade

• 2.5” 300GB hard disk drive

and SAS controller

• 1 * SAS disk cross-sharing interfaces

• 1 * Serial port

• 2 * USB ports

• 2 * 1GbE SFP ports• CPU blade and RTM Ethernet ports

cannot be used simultaneously

CPRT4 B (CPU RTM / Type 4 / Variant B)




CPRT4-B (CPU RTM / Type 4 / Variant B)

• Identical to variant A except it does not

have a hard disk / SAS controller

• Can only be used with Type 4 CPU

blade

B

Rear Transi tion Module (RTM)




Rear Transi tion Module (RTM)

Based on PICMG 3.0 specification

• RTMs are also single-wide boards

• RTM is equipped into the backside of the shelf

extension modules for the blades

Hard disks implemented with CPU RTM module

HUB blade has external connection uplinks from RTM

• RTM provides input and output connectivity to the companion

Front Board from the rear

Rear Transit ion Modules




Rear Transit ion Modules

• Rear Transition Module (RTM)

• Provide additional connectivity for blades

• Connects to the blade through the back of the shelf

CPU blade

type 4-A RTM

CPU blade

type 4-B RTM

ESTE RTM TEM HDNAO TEM HD

HDD (Hard Disk Drive) units• For functional unitsrequirements SAS H




HDD (Hard Disk Drive) units requirements SAS H

deployed on the RTM

Transition Module) o

CPU blade

• RTM can be equipp

node blade RTM slotCPU blade is located

need own slot)

• A blade can operat

RTM, but a RTM alw

front blade

Disks in ATCA MSS/HLR




Disks in ATCA MSS/HLR

- There are several units with hard disks in ADX2 like OMU, DBDU, ACU,

- Functionality and visibility from system or MML point of view is still the s

Classic HW- HW implementation totally different

In classic we have independent WDU and CPU (Can be in same cart

In ATCA disk is attached to CPU RTM (CPRT4-A)

SAS disks used (2.5”)

Same disks used in Classic HW in case of DCAR1-A

Current sizes: 73GB, 146GB and 300GB (AB3)

Even disk is on blade RTM, it’s seen on redundant unit even when unstate

Disks in ATCA MSS/HLR cont




Disks in ATCA MSS/HLR cont.

- Changing CPU will affect also to disk states

Removing CPU will disable also disk on RTM, so it won't be a

redundant unit.

CPU

CPU

RTMSAS

DISK

RTMSAS

DISK

uP

uP

SAS diskcross-sharingcable

Removable Media




Removable Media

- In ATCA only option for removable media are USB connected de

No SCSI attached devices like in Classic DX

- Supported devicesUSB sticks

- There has seen also some incompliant types

- Preferred to use Kingston USB’s without any extra features

- FAT32 and FAT16 file formats supported, FAT16 only in boo

case.

USB disk drive (EXTDH-A)

Interface Plugs (SFP/SFP+/XFP)





SFPCS Copper 10/100/1000 Mbps SFPtransceiver

SFPF2L Optical 1Gbps SFP transceiver(short range)

SFPSM-A Optical 1Gbps SFP transceiver(long range)

SFPS1L Optical 10Gbps SFP+ transceiver(long range)

SFPPSM Optical 10Gbps SFP+ transceiver(short range)

SFPPMM Optical STM-1 SFP transceiver(long range)

XFPMM-A Optical 10Gbps XFP transceiver(short range)

XFPMM-A

SFPSM-A

VIDE ITEM 11 DO PDF: Installation Site Requirements for ATCA Hardware

Filler units




• All empty slots must always be equipped with filler units

• Ensure proper airflow through the shelf

• Provide EMI shielding• Blade filler (ASFF6-A)

• RTM filler (ASFR6-A)

• AMC filler (AMCSF-A)

AMC filler RTM filler

Não podemos ter buracos abertos no shelfdevido a radiações eletromagnéticas (altafrequência) e de dispersão de temperatura.

Interconnection




• Base interface (BI) 1 Gb dual-star Ethernet

Each node blade has one BI to both hub blades Hub blades have one BI between them

Both hub blades have one 100 Mb BI to the shelf managers

• Fabric interface (FI) 10 Gb or 1 Gb dual-star Ethernet

Each node blade has one FI to both hub bladesWhen configured as 1 GbE, selected slots have additional

FI connections (2 x 1GbE to slots 4-6, 1 x 1GbE to 11-14)

FI is for external message transfer & BI is for internal message tra

Blade connectivity 1/2




y

• Blades connect to shelf backplane

• Shelf backplane divided into three zones

ZONE 1

ZONE 2

ZONE 3

Power feed

ManagemeBase interfaFabric inter

Zone 3 is used

for connecting

RTMs to blade

Test bus

Update cha

sync. clock

Blade connectivity 2/2




y

AMC

slot

AMC

slot

Front blade

Zone 1

Zone 2

Zone 3 RearTransition

Module

Backplane

Shelf side view

Thumb screwssecure blades

to the shelf

Ts

t

Shelf Backplane (front view)




P20

P21

P22

P23

P24

J10

External connectivity options 1/2

Core de dados




External connectivity options 2/2 Core de voz



48CN60301EN16GLA2 ©2014 Nokia Solutions and Networks. All rights reserved

Toda a conexão do user-plane éfeita por aqui (IP/STM-1).

Power feeding




- Separate power feeding for each shelf

- Provided by a redundant pair of Power Entry Modules (PEM)

- PEMs located on the lower rear side of the shelf- PEMs connect to Power Distribution Units (PDUs)

PDU overview




- Each shelf requires two Power Distribution Units (PDU)

- PDU provides protection against surges

- PDUs provide redundant power to the PEMs

- PDUs are installed in the rear of cabinet on both sides of shelf

- One PDU has two inputs from site power supply• A single input powers up half of the shelf

- PDU has four output feeds for a single PEM• Each feed powers up certain units in the shelf

Power distribution within a shelf




Cooling - 1/2

Each shelf is cooled by three Fan modules




Each shelf is cooled by three Fan modules

• Fan Modules are in 2 + 1 redundancy

• Fan Located on the upper rear side of the shelf

• Fan modules hot swappable

• Fan also provide forced air coolingFan modules

Back view

•The ATCA 2-slot shelf provides a cooling capacity of 320 W for

each front blade and 35 W for each RTM. In a NEBS

environment the shelf can manage a heat dissipation of 230 W

for a front blade and 25 W for an RTM. The shelf is cooled with

two redundant fan modules that are located at the front and

rear sides of the shelf.

•Air is drawn from the front of the shelf through the air filters.

•The air is conducted over the front blades and RTMs before

exiting through the rear fan module.

•Empty slots must be equipped with filler units to ensure

normal air cooling for adjacent slots.

Cooling - 2/2 Fan speed controlled by the shelf manager




Front view

p y g- Based on temperature sensor readings

Maximum power dissipation• 200W per front node slot

- 25W per RTM slot

Air inlet via NEBS air filters

The PICMG 3.0 specification calls for a conventional forced-air cooling system in the shelf. The Ashelf and blade form factors support 210 W, 220 W or 230 W of power dissipation for each singl

depending on the configuration, and 25 W for each RTM. The ATCA Hardware Platform meets threquirements by employing 3 fan modules with 2 impellers each. Redundancy is also provided

each fan module to both power entry modules. The shelf manager monitors and controls the coominimising audible levels and dealing with failure situations.

Air is drawn through the bottom front of the shelf through an air filter that meets NEBS requiremconducted over front blades and rear transition modules before exiting through the rear at the to

FRU Types and cooling in shelf




FRU types

- Front board (blade)

- Power entry module- Shelf manager ( Dedicated )

- Fan tray, Fan filter tray

- Advanced mezzanine card, AMC

- Rear transition module, RTM

Zone 1

Zone 2

Zone 3

Air Filter

Front Cable Tray Blade

This is showing the motherboard architecture of ATCAshelf.

Hardware management




• Shelf Manager perform FRU (Field Replaceable Unit) managemen

level

• A redundant pair of Shelf Managers in each shelf• Shelf managers located on the lower front side of the shelf

Shelf managers

HW Management (1/2)

ATCA HW i d i th i t lli t l tf t i t f (IPM




ATCA HW is managed via the intelligent platform management interface (IPM

• Each independent component has IPMI Controller which controls the com

enables connection to system level

• ATCA Building blocks are called as Field Replaceable Unit (FRU)

The ATCA shelf management system consists of redundant shelf managers

shelf and their connections to the FRUs and the system manager software c

shelf managers

The shelf managers are controlled by thesystem manager which is a higher

management application which consists of software running on a CPU blade

resides in OMU.

IPMI: interface specification that provides inventory management, monitoring, l

control for the elements of a computer system

Note: For example: In ATCA ,The hardware management is implemented with

platform management interface.

HW Management (2/2)




• The hardware management system watches over the basic

• health of the system

Reports anomaliesTakes corrective actions if needed

• The highest management entity is the System Manager

• The Shelf Manager is responsible for all FRUs in a single shelf

• Each blade has an IPMI controller (IPMC)

• Each AMC has a Module Management Controller (MMC)

• RTMs are managed over I2C bus through front blade IPMC• Packet processing blade RTM has it’s own MMC

OMU

Hardware Management System




HW Management key tasks




• Redundant system event Log (SEL) for logging important platfor

• Platform auto cooling and temperature control

• Hot Swap Management• Platform power-on, power-off, shutdown management (handled

manager software)

• FRU Information Storage

• Wired alarms supervision

• Local sensor monitoring (voltages and temperatures)

• Support for fault locating• wired alarms health diagnostics and line loop back diagnostics

IPMB Addressing




- Shelf IPMB addressing conventions

• Each of the 16 blades and the two shelf managers within each

a unique IPMB address. For example, blade in the physical sloIPMB address 92h and the left shelf manager an IPMB addres

• The two shelf managers have a unique IPMB address: left she

10h and right 12h. If a blade needs to communicate with eithe

physical shelf managers they use these addresses. In that cas

not communicating with the shelf manager, but just a normal f

replaceable unit. However, all communication from blades to tmanager entity is directed to address 20h, the address of the

manager.

IPMB Address Conversion TablePhysical slot IPMB address (hexadecimal) Slot type




y ( ) yp

1 9E node blade

2 9A node blade

3 96 node blade

4 92 node blade

5 8E node blade

6 8A node blade

7 86 node blade

8 82 hub blade

9 84 hub blade

10 88 node blade

11 8C node blade

12 90 node blade

13 94 node blade

14 98 node blade

15 9C node blade

16 A0 node blade

left shelf manager 10 shelf manager

right shelf manager 12 shelf manager

active shelf manager 20 shelf manager

Timing and Synchronization 1/2




- Synchronization is used by various

units:

Blade units

DSP units Line interface units

- CPU units need accurate timing

for:

Timing of CDRs

100 Hz timing signal for DX

Timing and Synchronization 2/2




- Sync clock can be derivedfrom various sources• SDH/Sonet line input• External reference

(BITS/SSU)• MCG internal oscillator

- Master Clock Generator(MCG) located in the Type 3hub blade

- MCG re-generates and

distributes the clock signalwithin a NE

Cabinet level synchronizationExt

Outputs tootherequipment

Rack #1 Rack #n

Between racks- 19.44 MHz distribution- Line references




- Each shelf has 2 MCGs One in each hub blade

- MCGs work in a primary /

secondary configuration Primary MCG negotiated over the

update channel

- Clock input / output ports in hub

blade RTM

- 2.048 MHz or 1.544 MHz clock

signal distributed between

shelves

references equipment

Shelf #1

Shelf #2

Shelf #1

Shelf #2

Shelf #3 Shelf #3

MCG1 MCG1MCG

MCG2 MCG2 MCG2

MCG2 MCG2 MCG

Shelf level synchronization




- MCG distributes clock signals within a shelf to all blades

- Distribution through the backplane synchronization interface

Two clock signalsCLK1 = 8 kHz

CLK2 = 19.44 MHz

Summary




The ATCA Blade provides a full hardware platform including e.g. ca

blade, RTM, AMC module, power supply, cooling system and hard

management solution The ATCA Blade HW offers flexible and scalable storage solution.

Dual-star Gigabit Ethernet backplane connectivity provides reliable

proof interconnection solution

ATCA specifications is based on PICMG 3.0

MSS and MGW use ATCA based node in CS core.

Documents

01_CN60301EN16GLA2_Introduction to ATCA Platform_Marcelo.pdf