IECEP-BICOL

Structured Cabling Systems

Design 101

Casablanca Hotel, Legaspi City

March 26, 2011

• Copper Cabling 101

• Standards

• Critical Parameters

• Cables

• Cabling Design Considerations

• TCO-ROI

• Fiber Optics 101

• Cabling System Testing

• Data Center Design 101

Agenda: Prelude to Data Center Design

BUILDING

MANGEMENTPABX

FIRE

DATA

PC TERMINAL

PC

TELEPHONE

FAX

CCTV

VIDEO

FIRE SENSORS

& ALARMSTelecommunications

Room

Telecommunications

Room

Main Distribution Frame

LIGHTING

CONTROLS

Temperature

Sensor

FIRE

ANSI/TIA/EIA-568-B ISO/IEC 11801

Commercial Bldg

Telecommunications Standard

IT-Generic Cabling for

Customer Premises

The Cabling

Standards

Work Area

Horizontal

Telecoms Room

Backbone

Equipment Room

Entrance Facility

CriticalCabling Parameters

Lucent Technologies

Proprietary

• Insertion Loss is measured in dB (decibels)

• Loss (attenuation) worsens with increases in length & frequency

• The lower the value (dB) = Better

Tx

Rx

Rx

Tx

Insertion Loss (formerly Attenuation)

dB

0 50 100

Frequency (MHz)

Insertion Loss

Crosstalk - “Get off my line!”

Tx

Rx

Rx

Tx

Near End Crosstalk (NEXT)

• NEXT is a measure of the unwanted signal

coupling from a transmitter at the near-end into

an adjacent pair measured at the near-end.

• The higher the value (dB) = Better

NEXT

dB

0 50 100

Frequency (MHz)

NEXT

• PSNEXT for Pair 1

• 10 log 10 (P1-P2)/10

• 10 log 10 (P1-P3)/10

• 10 log 10 (P1-P4)/10

PowerSUM NEXT (PSNEXT)

Mug of Beer Please

Mug of Beer Please!!!

„Did he just

call me Dear?”

Attenuation-to-Crosstalk Ratio (ACR)

dB

0 155

Frequency (MHz)

25 75 12510050

NEXT

INSERTION LOSS

Guaranteed Channel

Performance

ACR

Transmission

Margin

Performance

degrades when

Channel NEXT

“Crosses the Line”

ACR-N = NEXT – Insertion Loss

FEXT & ACR-F (formerly) ELFEXT

Tx

Rx

Rx

Tx

FEXT ACR-F

• Far-end crosstalk is a measure of the unwanted signal coupling

from a transmitter at the near-end into an adjacent pair

measured at the far-end. The higher the value (dB) = Better

• ACR-F is expressed in db as the difference between the

measured FEXT loss and the insertion loss of the disturbed

pair. The higher the value (dB) = Better

Bundle

Cable Sheath

6-around-1

Configuration

• Alien crosstalk loss is the measure of unwanted signal coupling from one balanced twisted-pair component, channel or permanent link to another.

AXT is only caused by differential (or

balanced) signal coupling and is not

adversely impacted by common mode

noise (e.g. noise from motors,

transformers, or florescent lights) that is

present in the environment.

EFFECTS: Reduced SNR (Bandwidth),

re-transmissions or auto-negotiations of

the switch to a lower Ethernet speed

Alien Crosstalk

0

200

400

600

800

1000

Cat 3 Cat 5e Cat 6 Cat 6A Cat 7 Cat 7A

16100

250

500

600

1000

Usable Bandwidth (MHz)

Cat 3

Cat 5e

Cat 6

Cat 6A

Cat 7

Cat 7A

Evolution of Cabling Standards

20022008 2008

Cat 5e, 6, 6A

Cat 5e, 6, 6A

Cat 7, 7A

Cable Terminology

Category 3

• Bandwidth: 16 MHz

• Size: 4, 25, 50, 100, 200, 300 pairs

• Construction: 24 AWG, UTP

• Application: Voice

• Distance: 2,000 meters (Class A applications up to

100 KHz)

• Location: Backbone

• Critical Parameters: Insertion Loss & NEXT

• Testing: Continuity

• Bandwidth: 100 MHz

• Size: 4 pairs

• Bandwidth: 24 AWG, UTP & F/UTP

• Application: Data (up to 1 Gbps Half Duplex)

• Distance: 100 meters

• Location: Horizontal & Backbone

• Critical Parameters: Insertion Loss, NEXT & PS NEXT

• Testing: Parameters

Category 5• Bandwidth: 100 MHz

• Size: 25 pairs

• Bandwidth: 24 AWG, UTP

• Application: Voice

• Distance: 2,000 meters (up to 100 KHz)

• Location: Backbone

• Critical Parameters: Insertion Loss & NEXT

• Testing: Continuity

Category 5e

Category 6

• Bandwidth: 250 MHz

• Size: 4 pairs

• Construction: 24 AWG, UTP

• Application & Distance: Data

• 1 Gbps Full Duplex – 100 meters

• 10 Gbps – 26 meters

• Location: Horizontal & Backbone

• Critical Parameters: Insertion Loss, NEXT, PSNEXT,

FEXT, AXT

• Testing: Parameters +AXT

Category 6A

• Bandwidth: 500 MHz

• Size: 4 pairs

• Construction: 23 AWG, UTP & F/UTP

• Application: Data (up to 10 Gbps)

• Distance: 100 meters

• Location: Horizontal & Backbone

• Critical Parameters: Insertion Loss, NEXT, PSNEXT,

FEXT, AXT

• Testing: Parameters +AXT (no AXT for F/UTP)

Category 7 & 7A• Bandwidth: 600-1200 MHz

• Size: 4 pairs

• Construction: 23-22 AWG, UTP & F/UTP

• Application: Data (up to 10 Gbps & beyond)

• Distance: 100 meters

• Location: Horizontal & Backbone

• Critical Parameters: Insertion Loss, NEXT, PSNEXT, FEXT, AXT

• Testing: Parameters (no AXT)

10/100 LAN

Video

Voice

Voice

Voice

Voice

Voice

CablingDesign

Considerations

Cable Sizes7.4 mm 6.4 mm5.5 mm

8.9 mm 7.4 mm 8.4 mm

5e UTP 6 UTP5e F/UTP

6A UTP 6/6A F/UTP 7/7A S/FTP

– 6A F/UTP is

more space

efficient than

6A UTP

365

420

5456A F/UTP

6A UTP

7 S/FTP

• Maximum cable tray/wireway pathway capacity must

not exceed a calculated fill ratio of 50% up to 150 mm

(6 in) inside depth

• Cat 6A UTP must not be mixed with Cat 6 UTP cables

inside the same pathway

• Shielded cables (F/UTP & S/FTP) have no restrictions

in sharing the same pathways with other types of

cables

• Telecommunications pathway must not be shared with

other systems such as power cables (EMI source)

• UTP cables must be separated by 3m

from power cables (>6 KVA); shielded

cables, 1m

365

420

5456A F/UTP

6A UTP

7 S/FTP

Pathway Fill

• Planned furniture pathway fill

ratios are 40% to account for

growth

• Unplanned additions, max.

pathway fill is 60%

• Cable diameter & 90o bends can

drastically affect

pathway/conduit cable count

• less 15% on cable count

per 90o bend

• No more than two 90o

bends between pull points

*Maximum allowable diameter, based on standard

Sam ple # of cables at 60% Fill

Conduit

trade size Cat 6A F/UTP

7.4m m (.290”)

Cat 7 S /FTP

8.4m m (.330”)

Cat 6A UTP

9.0m m (.354”)*

16 (½ ) 2 1 1

21 (¾ ) 4 3 3

27 (1) 7 6 5

35 (1 ¼ ) 13 10 9

41 (1 ½ ) 18 14 12

53 (2) 30 23 20

63 (2 ½ ) 44 34 29

78 (3) 66 51 45

103 (4) 116 90 78

Sam ple # of cables at 60% Fill

Conduit

trade size Cat 6A F/UTP

7.4m m (.290”)

Cat 7 S /FTP

8.4m m (.330”)

Cat 6A UTP

9.0m m (.354”)*

16 (½ ) 2 1 1

21 (¾ ) 4 3 3

27 (1) 7 6 5

35 (1 ¼ ) 13 10 9

41 (1 ½ ) 18 14 12

53 (2) 30 23 20

63 (2 ½ ) 44 34 29

78 (3) 66 51 45

103 (4) 116 90 78

Sam ple # of cables at 60% Fill

Conduit

trade size Cat 6A F/UTP

7.4m m (.290”)

Cat 7 S /FTP

8.4m m (.330”)

Cat 6A UTP

9.0m m (.354”)*

16 (½ ) 2 1 1

21 (¾ ) 4 3 3

27 (1) 7 6 5

35 (1 ¼ ) 13 10 9

41 (1 ½ ) 18 14 12

53 (2) 30 23 20

63 (2 ½ ) 44 34 29

78 (3) 66 51 45

103 (4) 116 90 78

Conduit Fill

• UTP (Augmented Cat 6)

• Increased cable diameter minimizes alien crosstalk

• F/UTP (Augmented Cat 6)

• Foil screen virtually

eliminates alien crosstalk

• S/FTP (Cat 7A/Class FA)

• Full shielding eliminates

internal and external alien

crosstalk

How AXT is address by cabling?

• Category 6A UTP must not be mixed/shared in the same bundle with other types of cables (ex. Cat 5e or Cat 6). UTP cables minimize alien crosstalk (AXT).

•

All Cat 6A UTP

Cat 6A UTP

Mixed with Cat 6 UTP

Cable bundling – Cat 6A UTP

• Category 6A F/UTP can be mixed/shared in the same bundle with other types of cables (ex. Cat 5e or Cat 6). Shielded cables eliminate AXT.

All Cat 6A F/UTP

Cat 6A F/UTP

Mixed with Cat 6 UTP

AXT Eliminated

Cable bundling – Cat 6A F/UTP

• Perfect for data center applications

• No restrictions on the use

of cable ties*

• “Combed” cables are

allowed*

* Provided that cables are not

cinched, crushed or deformed

Maximum Density with

Shielded Systems

CABLING Cat 5e Cat 6 Cat 6A Cat 7A

SYSTEM LIFE

CYCLE5 yrs 7 yrs 10 yrs 15 yrs

• Initial cost of network cabling

• Sample TCO

CablingInstalled

Cost

Lifecycle

of System

Annualized

Cost

Cat 5e $1,213,700 5 $242,700

Cat 6 $1,608,400 7 $229,800

Cat 6A $2,628,100 10 $262,800

Cat 7A $3,220,500 15 $214,700 • Upgrading to 1Gbps

• Re-test existing Cat 5e

• 1G min. cabling is Cat 6

• Upgrading to 10Gbps

• Cat 5e is not supported

• Total replacement!

• Re-install new cabling

• Cat 6 – up to 26m cable length

• Replace longer cables with Cat 6A or Cat 7A

Network Cabling TCO-ROI

Shielded Systems vs. UTP

• Increased 10 Gbps performance headroom with 23

Gbps Shannon capacity at 500 MHz vs. 18 Gbps for

UTP

• Longer projected lifecycle – superior 10 Gbps

headroom means it will support growing network

performance needs longer reducing TCO

• Superior AXT performance providing 20 dB margin

vs. standards limits, nearly 20 dB better than UTP

• No need for AXT testing – beware of waving field

testing for 6A UTP

• Excellent noise immunity against EMI

• Smaller cable diameter than 6A UTP

• Share pathways with 5e & 6 cables

• Less restrictive installation practices Shielded Systems are back with

vengeance

Let‟s Get Optical !

…going beyond 10G

32

Fiber Standards / Bandwidth (MHz•km)

• TIA-568-B.3

– 62.5/125µm Multimode

• OFL: 160 MHz•km @ 850nm

• OFL: 500 MHz•km @ 1300nm

– 50/125 µm MMF

• OFL: 500 MHz•km @ 850nm

• OFL: 500 MHz•km @ 1300nm

• TIA-568-B.3-1

– 50/125 µm Laser Optimized MMF

• OFL: 1500 MHz•km @ 850nm

• OFL: 500 MHz•km @ 1300nm

• RML: 2000 MHz•km @ 850nm

• ISO/IEC 11801:2002

– OM1 (62.5/125 µm)

• OFL: 200 MHz•km @ 850nm

• OFL: 500 MHz•km @ 1300nm

– OM2 (50/125 µm)

• OFL: 500 MHz•km @ 850nm

• OFL: 500 MHz•km @ 1300nm

– OM3 (50/125 µm)

• OFL: 1500 MHz•km @ 850nm

• OFL: 500 MHz•km @ 1300nm

• RML: 2000 MHz•km @ 850nm

OFL – Overfilled Launch (LED Bandwidth)

RML – Restricted Mode Launch (LASER Bandwidth)

Primary Optical Fiber Applications- Singlemode

- Multimode

34

Application Wavelength

62.5

160/500

FDDI

62.5

200/500

(OM1)

50

500/500

(OM2)

50

2000/500

(OM3)

SMF

100BASE-SX 850nm 300m 300m 300m 300m

1000BASE-SX 850nm 220m 275m 550m 550m

1000BASE-LX 1300nm 5km

10GBASE-SX 850nm 26m 33m 82m 300m

10GBASE-LX 1310nm 10km

Fiber Accessories (100 MbE)

100MbE 100BASE-SX

MMF

Supported Interfaces

ST, SC, LC, MT-RJ

Cable

Multimode fiber only

62.5/125 m (OM1) or 50/125 m (OM2) orange jacket

- Singlemode

- Multimode

35

Fiber Accessories (1 GbE)

1GbE MMF

1GbE SMF

Supported Interfaces

SC, LC, MT-RJ SC, LC

Cable 50/125 m (OM2)

orange jacket

Low water peak singlemode (OS1)

yellow jacket

- Singlemode

- Multimode

36

Fiber Accessories (10 GbE)

10GbE MMF

10GbE SMF

Supported Interfaces

SC, LC SC, LC

Cable 50/125 m laser-optimized

(OM3) aqua jacket

Low water peak singlemode (OS1)

yellow jacket

- Singlemode

- Multimode

37

10 GbE Application Considerations

10GBASE-SR

MMF

10GBASE-LX 10GBASE-EX

SMF

Distance 300m 10 km or 40km

Electronics ($) Lower Higher

Connectivity ($) Lower 2x Higher

Cable ($) 3x Higher Lower

Application LAN, Data

Center WAN, CAN,

MAN

- Singlemode

- Multimode

38

Beyond 10 Gbps

• 40 GbE and 100 GbE fiber

applications under

development

• IEEE HSSG – 802.3ba

• Current draft is 1.1

• Expected publication date:

July 2011

39

Why 2 application speeds?

• 40 GbE – Server and computing needs

– Servers, high performance computing

clusters, blade servers, SANs and network

attached storage

• 100 GbE – Core networking

applications

– Switching, routing, and aggregation in data

centers, internet exchanges and service

provider peering points, and high bandwidth

applications, video on demand, and other

high performance computing environments

40

Server Market Evolution

41

Data Rate

Fiber Implementation No. of Fibers

Length

40GBASE-SR4 40Gb/s OM3 4 * 10Gb/s (parallel) 8 100m

40GBASE-LR4 40Gb/s OS1 4 * 10Gb/s (WDM) 2 10km

100GBASE-SR10 100Gb/s OM3 10 * 10Gb/s (parallel) 20 100m

100GBASE-LR4 100Gb/s OS1 4 * 25Gb/s (WDM) 2 10km

100GBASE-ER4 100Gb/s OS1 4 * 25Gb/s (WDM) 2 40km

40 GbE and 100 GbE Capability

42

40GbE and 100GbE Multimode Migration Path

• Use existing plug & play MTP solution

as a foundation

• Two 12-fiber MTP trunks support:

– 12x 2-fiber 10GbE channels

– 2x 8-fiber 40GbE channels

– 1x 20-fiber 100GbE channel

• During upgrade, duplex patch cords

and plug & play modules are removed

and replaced with MTP adapter plates

and MTP jumpers

43

40GbE and 100GbE multimode upgrade

• Current solution

44

• Remove plug & play modules

• Remove duplex patch cords

40GbE and 100GbE multimode upgrade

45

• Introduce MTP adapter plates

40GbE and 100GbE multimode upgrade

46

• Introduce 4 MTP jumpers

• This configuration supports two 40GbE

channels or one 100GbE channel

Cost Comparison – 2010 Projections- Equipment

- Cabling

0

5

10

15

20

25

30

35

40

45

10GBASE-S

X

40GBASE-S

R4

40GBASE-L

R4

100G

BASE -SR10

100G

BASE -LR

4

100G

BASE -ER4

7.5x

3x

47

New Standards Buzzwords

• TEMPEST– refers to a US government classified set of emissions limits and test

procedures

– Electromagnetic compatibility EMC

– The ability to minimize radiated emissions

– The ability to resist interference from radiation

– Screens and shields inherently protect against radiation and emissions

– It is a counter-intelligence measure to prevent electronic espionage

– Class F/FA systems are the only cabling solutions that can be TEMPEST

approvedTelecommunications Electronics Material Protected from Emanating Spurious Transmissions

Transient ElectroMagnetic Pulse Emanation STandard

• RoHS

• Green

• LEED

QualifiedCablingTesting

Cabling TestingWire Map, Insertion Loss, NEXT, PSNEXT, ACR-N,

FEXT, PSFEXT, ACR-F, Return Loss

Ave.Testing Time per link = 15 seconds

AXT Testing

Estimate Testing Time for 24-Port Patch Panel = 3 hours, 45 minutes

or

9 minutes, 22.5 seconds per link

Uses 2 instruments, special test modules, communication link,

terminators & PC/Laptop running control software

Method A: ANEXT Testing

Must move remote to far-end & use the communication link, relocate

terminations. To test ANEXT & AFEXT at Panel 2, the entire setup

must be swapped. Everything 2x from both ends.

Method A: AFEXT Testing

- Uses 2 instruments & AXT stimulators

- No PC, no communication link, no extra terminators

- Same setup for ANEXT & AFEXT

- All interaction at near-end

Method B: ANEXT/AFEXT Testing

Method B: ANEXT/AFEXT Testing

- Use more stimulators to reduce human error & test time

- Same test time for one or more disturbers

up next….

Data Center Design 101

Questions?