White Boxes for the BNG Use Case
Carsten Michel, Senior Expert NGN, Deutsche TelekomWinnie Lin, Senior R&D Director, Delta Electronics
NETWORKING
DT Access 4.0 Mission StatementNETWORKING
“We develop a cost-efficient, lean-to-operate and scalable access platform to deliver Gigabit products”
What is Access 4.0/A4?NETWORKINGSCOPE OF ACCESS 4.0
• Extensive D2C (Design-To-Cost) project for FTTH/B• Everything monitored in a comprehensive Cost Model• Design and engineering using bare metal / OCP hardware, lots of
open-source software as well as merchant silicon• Application of data center principles, leaf/spine fabric, CI/CD, …• Clean IT architecture (Las Vegas principle)
OBJECTIVES OF ACCESS 4.0• Save CapEx and OpEx• Reduce vendor lock; bring in new players• Drive automation• Time-to-Market for services (keep business logic SW in house)• Increase flexibility for capacity mgmt, change-over, migration, …
BNG in a Nutshell
• Broadband Network Gateway (BNG) is an edge device of the IP network
• BNG aggregates user sessions, e.g. PPP sessions, from the access network
• Responsible for authentication, authorization and accounting enforcement
• Manages subscribers IP addresses
• Forwards packet to the IP core network
NETWORKING
BNG on Whitebox Switches
Motivation• Lot of work has been done for data center environment which addresses key points like openness,
automation, programmability• Not very well suited for subscriber edge functionality
Technical Requirement• Termination of Q-in-Q tagged Ethernet frames (S-VLAN, C-VLAN)• Termination of PPPoE session (including LCP, IPCP, IPv6CP)• Authentication, Authorization and Accounting (RADIUS) (control plane only)• Subscriber IP address management (control plane only)• Customer specific IP packet filter, for instance anti-spoofing filters• Hierarchical (aka per subscriber) Quality of Service for various services (e.g. VoIP, IPTV, etc.)• Multicast Replication• Termination of L2TP tunnel for wholesale• Subscriber-aware counting and statistics for both operation as well as billing
NETWORKING
ACCESS 4.0 Core Beliefs and DriversNETWORKING
HomogeneitySame Platforms for
a few Use-Cases for Single or
Multiple Operators
ManageabilityHelp Reducing
Operational Team’s
Efforts in Installation and
Maintenance
FlexibilityModular Design
for Various Application and
Operator
Efficiency
Space, Power, MTBF, Life-
cycle and etc.
Same ASIC withSPINE and LEAF Configurations
Standardizationwith 2RU Chassis, Same PSU and
Fan-Tray, 80mm Fan-tray for longer MTBF; BMC Supported
Modular CPU Boardwith Compatibility of CPU options
and System Memory/Storage
Compact Designwith High Power Efficiency
and Longer Life-Cycle
New Hardware Design - ConsiderationsNETWORKING
AGCVA48S4*SFP+, 48*SFP28 and 10*QSFP28
AGCX422S22*QSFP28 and 4*QSFP-DD
DNXQumran 2C (2.4Tbps)HQoS TM, Scalability, Deep Buffer, Programmability
Xeon D1500/D1600High Performance with QAT
Ex. TCAMKBP for Larger Table (IPv4/IPv6), ACLs and Statistics
SyncE/1588v2*ToD, BITS, 1PPS, 10MHz and etc.*Time Synchronization supported on all ingress and egress ports
On-Chip Buffer4GB HBM for Elastic Pipeline
StatisticsTAP as Optional Module
What’s inside? HLD - Leaf Platform
•DNX Qumran 2C(2.4Tbps, ILKN and OTN Supported)
•Choose between KBP (TCAM) orTAP (Statistics)
•SFP+ and SFP28 for smaller accessinterfaces
•Time Synchronization (1588v2)
•BMC/OpenBMC Support
NETWORKINGCPU 150pin Connector
1588,SyncE Circuit
BroadcomDNX Qumran 2C
PM25
PM25 PCIeBroadSync
LPC
BMCAST2520
CPLD
I2C
I2C
Flash
Flash
DDR4
I210
PCIe x1
NCSI
UART
MGMT
USB
PCIex4
10G KRx4
10G Serdes
25G Serdes
25GSerdes
KBPor
TAP
48 x SFP28 25G 10 x QSFP28 100G4 x SFP+ 10G
Statistic4 x 50G
Search 8 x 50G
MGMTConsole
USB
Mux
UART
Mux
BCM82758
SFI
1pps_outBITS
What’s inside? Inside of LEAF Platform
Modular CPU Board
Broadcom ASICand T-CAM
BMC
Timing Injection Interface
4*SFP+
Management Port and Console
Oscillator
NETWORKING
What’s inside? HLD - Spine Platform
•DNX Qumran 2C(2.4Tbps, ILKN and OTN Supported)
•Non-KBP/TAP Design
•QSFP28 and QSFP-DD for larger backbone interfaces
•Time Synchronization (1588v2)
•BMC/OpenBMC Support
NETWORKINGCPU 150pin Connector
14 x QSFP28 100G
1588,SyncE Circuit
BroadcomDNX Qumran 2C
PM25 / PM50
PM25 PCIeBroadSync
LPC
BMCAST2520
CPLD
I2C
I2C
Flash
Flash
DDR4
I210
PCIe x1
NCSI
UART
MGMT
USB
PCIex4
10G KRx4
10G Serdes 25G
Serdes
50GSerdes
4 x QSFP-DD 400G4 x SFP+ 10GMGMTConsole
Mux
UART
BCM82758
1pps_outBITS
25G Serdes
8 x QSFP28 100G
What’s inside? Inside of SPINE Platform
DRAM-Module
400G Connectivity
Timing Injection Interface
22*QSFP28
Mounting Post of Sliding Rail
SSD Storage
NETWORKING
What’s inside? HLD - CPU Module
• Modular CPU Board Design
• Upgradable CPU Module
• Dual FLASH for BIOS Backup
• Upgradable RAM Module
• Dual Storage (SATA3 and PCIe) forSwitch OS Backup
• TPM supported
NETWORKING
Bo
ard
to B
oa
rd C
on
ne
ctor
Intel Xeon Processor D-1500Product FamilySO-DIMM DDR4
PCIe Gen3 X4
SATA Gen3
M.2 PCIe Gen3 2280 SSD
M.2 SATA3 2242 SSD
TPM
Flash
SPI
SPI
J-Tag chain
UARTUART
LPC/eSPI
PCIe Gen1 X1
PCIe Gen3 X4PCIe Gen3 X2PCIe Gen3 X1PCIe Gen3 X1
10G KR10G KR
USB 3.0
1PPS
I2C I2C
PCIe Clock
TMP
Misc.
I2C
12V & 3V3
POWER MONITOR
BackupFlash
Flash
Improving Operation Efficiency
•Design is intended to be compatible with any optical transceivers
•Standard chassis for Central Office requirements
•ETSI* and NEBS* compliant(*in-progress)
NETWORKING
•80mm fan-tray to extend switch life cycle
•Modular design of fan-tray for easy maintenance
•High efficiency PSU, achieving 98%+ efficiency
•AC/DC and OCP PTM (Pass-Through Module) Compatible
How Do We Proceed• We are seeking for active feedback from the
community
• Feedback on the proposed design• Interest in having / using such a box?• Interest in collaborating?
• In case of common interest, DT and Delta plan tocontribute specification of BNG-capable switch design to OCP
To be OCP Accepted(in-progress)
NETWORKING