Wireless InterOp Architecture and Design Robert Burchard

Wireless InterOp Architecture and DesignRobert Burchard

2 © 2007 Arcadian Networks. All rights reserved.

Agenda

Smart Grid Concepts

Use Cases

Architectural & Design Overview & Considerations Network Overview (BH, WWAN,

WLAN, WHAN) Coverage and Capacity Equipment Specifications Indicative Build-outs

Application Solutions & Profiles

Equipment Mapping to Applications

Solution Components Overview Service Delivery

Design & Implementation Network Management

Industrial Radios & Carrier-grade Equipment

Smart Grid Communications

The U.S. Department of Energy assigns the following characteristics to smart grid: Self-healing from power disturbance events Enabling active participation by consumers in demand response Operating resiliently against physical and cyber attack Providing power quality for 21st century needs Accommodating all generation and storage options Enabling new products, services, and markets Optimizing assets and operating efficiently

Communications to accomplish Secure Two-way High-speed communications


Smart Grid Solutions

Grid Virtualization AMI/AMR Distribution Automation Substation Automation (Last Mile) Secure SCADA / DCS / Telemetry

Demand Response / Management Condition-Based Maintenance Physical Security and Access Management Workforce Empowerment & Mobility

VOIP / Internet TMR / AVL / GIS

Governance & Compliance NERC, FERC, 2005 EPA, DHS-NIMS, CPNI

Increased throughput, resiliency and response* Source Chartwell


Focus on Performance

Design goals Flexibility

Today's needs Growth Standards applied

Visibility Network ‘At a glance’ Performance ‘At a glance’ M2M, M2P

Interoperability Legacy needs Industry trends Enable emerging applications


Use Cases

Connexus EnergyCrow Wing Power

Connexus Energy Challenge

Converted from 900MHz substation communications due to reliability and interference challenges. Moved 900MHz resources to point applications in the field.

Approach Began installation of Arcadian 700MHz for distribution substation communications in Q1

2007. Deployment ongoing.

Application Supporting SCADA/RTU comms and critical peak load control voltage management

program with GRE. Expanded use for 2-way advanced metering back-haul. Deployed remote control capability for utility managed generators on customer

premises. Enabled VOIP connectivity in substations.

Results 20 substations live with ongoing roll out underway as substation data concentrator and

SCADA upgrades occur across system. Communication reliability improved from mid 80’s to 99.9%.

Content approved by Connexus Energy

© 2007 Arcadian Networks. All rights reserved.

Crow Wing Power Challenge

Install a cost-effective broadband network connectivity to substations across a wide geographic service territory.

Support reliable and dedicated connectivity for two-way advanced metering power line carrier communication backhaul and load control applications.

Approach Began installation of Arcadian 700MHz modems for distribution substation communications

in Q3 2007. Deployment ongoing.

Application Supporting high speed comms for critical peak load control voltage management program

with GRE. Expanded capability and reliability for 2-way advanced metering back-haul and Landis+Gyr

PLC AMI application.

Results Zero weather related outages: Improved reliability and connectivity even during Winter 2008

blizzard snow storm conditions. Communications foundation for additional smart grid applications planned.

Content Approved By Crow Wing Power



Architectural & Design Overview & ConsiderationsNetwork Overview (BH, WWAN, WLAN, WHAN)

GenerationStation

TransmissionLines

TransmissionSubstation

LocalDistribution

DirectCustomer

DistributionStation

Corporate HQ

Arcadian Networks

Operations Center (NOC)

Fiber or 700MHz

MicrowaveBackhaul

700 MHzPt-Multi-Pt CPE

700 MHzPt-Multi-Pt Mesh

700 MHzPt-Multi-Pt Basestation

700 MHzPt-Multi-Pt CPE

WBH WWANWLAN WHAN

SubstationAutomation

DistributionAutomation

AMITransmissionAutomation

Energy Management

System

VOIP AVL / GIS TMRWorkorder

Management


Smart Grid Interoperability Advantages

Headquarters

Oil Platforms

700 MHzPt-Multi-Pt Repeater/

Mesh CPEs

Transmission /DistributionAutomation

Oil Well AMR

700 MHzPt-Multi-Pt

CPE

WLAN

WLAN

WiFi equivalent Mesh

700 MHz Broadband

StorageTerminals

VSAT Backhaul

Fiber or MicrowaveBackhaul

700 MHzPt-Multi-Pt Basestation

WWAN

Arcadian Networks

Operations Center (NOC)

?

?

?

End–to-end interoperability


Spectrum Management Supports

Standards Based PtMP (Point-to-Multipoint)

Broadband IP/SCADA Serial SCADA Dedicated Channels Shared Channels Mesh/Repeater Data privacy Layered security

12.5

kH

z

757 – 758 MHz

25

kHz

50

kHz

50

kHz

100

to

330

kH

z

100

to

330

kH

z

25

kHz

25

kHz

50

kHz

50

kHz

100

to

330

kH

z

12.5

kH

z

25

kHz

25

kHz

12.5

kH

z12

.5 k

Hz

25

kHz

AMR / Asset Management

PTT Voice / Mobile Data

AMI / SCADA Mesh / Nomadic

M2M Broadband Fixed / Nomadic

•Broadband IP - Up to 2.4 Mbs•Serial •Seria

l

•Mesh •Mesh

IP Foundation

IP Enables Flat Network

Intranet end-to-end IT and Communications – now same language Standards now deployable

Collected Data Payload - Use/needs specific delivery Network statistics - Use/needs specific delivery Backup duplication in Real-Time

Interoperability Legacy needs Industry trends Enable emerging applications Seamless delivery of Company-Wide Security policies


Smart Grid Zoned Security – IP Addressing & VLANs

GenerationStation

TransmissionLines

Customer OwnedTransmission

LocalDistribution

DirectCustomer

TransformerStation

MunicipalStation

LocalDistribution Center

Customer Service

EngineeringIT / Admin / Security Transmission

Distribution

Corporate HQ

AN Network Management

•Options: logical IP segregation by Region or Technology:VLAN segregation by “network”: security, users, network management



Security Advantages

Typical, Weak Network Security

Arcadian Networks End-to-End Network Security

WWANWireless

Encryption

BackhaulVPN Tunnel / VLAN /

Leased Line

3-foot ProblemUn-encrypted

WWAN to Backhaul

Link

CPE Modem

VPN ServerHQ / Operations

CPE Modem

VPN ServerHQ / Operations

WWAN

BackhaulEnd-to-End Security End-to-End: - VPN - VLAN - Encryption

14

Application Solutions & Profiles

Integrated IP Network Consolidation Consolidation leads to:

Lower total cost of ownership Reduced complexity


Increased service level availability Grouping by application types/use Greater reliance on individual systems

Customer Requirements

Data Integration Example SCADA RTUs

Meters MV90 and real time

SEL 2030 interface to relays

VoIP Phone

WiFi Access Point

Load management transmitters (where the transmitter is not on the communications backbone)

AMR/AMI Backhaul – PLC, wireless

Remote Generators (customer premises)

Security (video, card key access – future)

•Courtesy of Great River Energy17 © 2007 Arcadian Networks. All rights reserved.


Architectural & Design Overview & Considerations Indicative Build-outs


Architectural & Design Overview & ConsiderationsIndicative Build-outs






Application Solutions – Electric Utilities Corporate, Industrial & Agricultural AMI for Load and Outage Management

Meter can be connected directly to radio or via a concentrator for bi-directional communications Equipment can be placed in NEMA enclosure if it requires

protection from the elements

Radio or concentrator connects to broadband network

Data is routed via private 700MHz backhaul WWAN

1 432

12

3

4

Estimating & Planning


Project Management:Four-Phase Iterative Methodology

Conception

Definition

Operations

Execution


Architectural & Design Overview & ConsiderationsCoverage & Capacity

Coverage Base station Antenna Height Coverage Area

ROM Coverage Simulation Site Visits

CPE End-point Antenna Height Frequency

700MHz, 2.4GHz, 3.65GHz, 5.8GHz

Noise-floor dB, determines power CPE end-

point radio needs to “hear” a base station at the given base station power and antenna height

Capacity Application Requirements

# of Intelligent End Devices Reading intervals # of Bytes per read Maximum Latency Tolerable

Equipment Capabilities # of Base stations / Sectors

Payload Duty Cycle Bits/hertz Serial / Ethernet

Maximum radios per channel

ROM Decision Points

Coverage and capacity concepts are relevant for all technologies

Bandwidth, range, channel size, data rate

Private Consumer IP or Serial

Attributes/symptoms differ by technology

Consumer networks are more difficult to model due to limited visibility and control over components and inputs



Architectural & Design Overview & ConsiderationsEquipment Specifications Specifications

Channel Bandwidth (kHz): spectrum available & frequency planning Modulation: defines bit/hz, data rate potential, and performance thresholds

Data rate / channel (kb/s) Combined with bandwidth defines receiver (Tx) sensitivity

Duplex: Frequency division: Tx and Rx simultaneously – requires more spectrum for data rate Time Division: Tx and RX share time – use caution when co-locating devices

Power: combined with Rx sensitivity gives link budget and range potential Data Interface: serial, Ethernet, OEM, etc. Radios/BTS architecture:

Point-to-point, Point-to-multipoint, Mesh/Repeater

Transaction / time Influences latency


RF Design – CelPlan ExampleRadio Frequency Design Antenna Height Optimization

•High Resolution Terrain•Multi-factor Clutter•Signal Testing & Model Tuning

•High Resolution Terrain•Multi-factor Clutter•Signal Testing & Model Tuning

Diagnostics & Lessons Learned Asset location information

Actual vs. location of record Continual feedback to the design team

Integrity of as-built information

Aptitude of design support personnel Future training needs

Integrity of deployment closeout packages Existing processes may be insufficient for current projects Methods, thresholds and scope

Network touch versus performance failures

Measurement granularity aligned with application profiles

RF environmental factors

A positive mindset approach to deployment New technology deployment identifies improvement opportunities for related business and technology

systems Benefits and opportunities transcend technologies

Project Management Areas Impacted:1. Project planning and network design2. Asset information and logistics3. Spectrum integrity4. Core network deployment and testing5. Application cutover6. Ongoing Operations



Managed Services

Network Awareness Tailor NMS for individual customer

needs and SLA performance requirements

Alarm notification and correlation SMS eMail Visual Map with News and Weather

feed NMS Alarm Summary Page Auto-Generated Incident Ticket

Troubleshooting Methodical, NERC-CIP

troubleshooting techniques and methodology

Converged realtime and historical, performance & RF, statistics

Incident Resolution Tailored for customer needs based

on SLA MTTR requirements with custom escalation policies

Technician oriented and proactive Root cause Steps to be taken Site access information and location

Network and HelpDesk Reporting Fully customizable reports Customer site performance Customer SLA reporting

MTTR Availability

RF statistical reports for proactive optimization

Informative customer ticket summaries

Network Operations Center (NOC) Capabilities

3rd Party Network Management System Integration


Network Awareness

Network awareness continues with the actual alarm notifications SMS Email Geographical Asset Map Hierarchical Network Dependencies NMS Alarm Summary Page Auto-Generated Incident Ticket

Basestation Router

Basestation Switch

WMTS

UPS

MMU

Modems

We keep an eye on the weather too!






Documents

Wireless InterOp Architecture and Design Robert Burchard