Embed Size (px)
Citation preview
IEE and Microsoft SQL
Amit Grover, IT Business Solution Manager
Daniel Lizano, IT Business Solution Group Manager
Ray King, Microsoft Industry Solutions Organization
Business Value for Power & Utility
Companies
WW Power & Utilities industry vision and value proposition
Working with our product teams to meet
industry needs Industry Managers and Directors, Account Teams, Solutions Specialists and Partner Managers
Support for Industry
Standards
Hydro Power
Solar
Wind
Biomass
Tidal Buoys
Control
Center
Low Emission
Power Plant
Microgrid
Photovoltaic's
Electricity
Micro StorageThermal
StorageSMES
Fuel Cells
Compressed
H2 Storage
H2 Filling Station
Manufacturing Plant
(High Consumption)
Nuclear &
Desalinization
PlantOffshore Wind
Microgrid
Microgrid
Commercial Offices &
Storefronts
Parking Facility with
PHEV Recharge Outlets
Power Substation
CO2
Storage
Pulling It Together:
Real-World Benchmark
Replicate 5- and 10-million meter utility
– Mix of residential and C&I meters
– “Day-in-the-Life” test scenarios
Import, validation, calculation, export
Time-of-Use pricing
Summation and aggregation for new
applications and programs
– Demand response
– Customer presentment
– Analytics
Standard commodity hardware
The Numbers….
Meter-to-cash process in under 4 hours
A “best run” imported and validated of 10-
million meters in under 2 hours
Billing determinant calculation and export in
less than 2 hours
Determinant calculations averaged 70
customers/sec
Peak import speed of 47,500 readings/sec
Average import speed of 37,466 reads/sec
The results of the testing overwhelmingly confirmed that IEE MDM is a
highly scalable system, capable of supporting over 10-million meters on a
SQL Server database.
The Results….
Itron Enterprise Edition PlatformDatabase and Shared Tools
IEE Meter DataManagement
IEE Meter DataManagement
IEECustomer
CareSuite
IEECurtailment
Manager
IEERevenueProtection
Suite
Handheld / AMRSolutions
C&I Meter andCollection Systems
AMI
Utility Operational and Back-Office Systems
AMI
Data Collection Systems
Microsoft SQL Server
Itron & Microsoft in Smart Metering
Customer Business Challenge
SolutionCustomer
Results/Benefits
• 4.6m electric customers
• 120m interval reads and
5m billing register reads
daily
• On-line data retention
requirement for 13 months
• Theft analysis and lead
generation based on 5m
end points
• Web access to 50k
concurrent users
• FP&L has implemented
Itron’s IEE MDM on
Windows & SQL Server
• Currently executing plan to
deploy 4.6 m smart meters
(~ 1m meters are being
supported on the MDM
system)
• Highly scalable - manage large data volumes
• Large scale disaster recovery capabilities
• High availability - minimize downtime
Smart Metering – Meter Data Management
• Support advanced &
dynamic metering & billing
objectives
• More reliable electric
service
• Improved power restoration
efforts
• Upgraded system will:
• Lower TCO
• Decrease complexity
and support
requirements-
minimal tuning
www.microsoft.com/utilities
http://blogs.msdn.com/mspowerutilities
© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or
trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft,
and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS,
IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Visit us on the internet at: www.microsoft.com/utilities
Visit our Blog at: http://blogs.msdn.com/mspowerutilities
12
FPL is the largest utility in Florida
Jacksonville
Tampa
Miami
Ft. Lauderdale
• 4.6 million electric customers
• ~27,000 sq. miles of service territory
• Reliability much better than national average
• Investing to maintain reliability and meet growth
• Committed to meeting the growing power needs of our current and future customers
• 80% of customers are residential consuming ~50% of electricity
13
FPL
Back-
office
Systems
AMI / IEE Business Benefits
• Utilizing previous day reads for billing
• Utilizing AMI read for non certified AMI routes / PWQ
• Utilizing AMI reads for Service Order SA/LS
• Accurate estimation utilizing current month reads outside billing range
• Ease of integration - Addition of new functionality
• New customer types (e.g. Demand meters, Net Meters)
• Reduced impact to CIS (Build intelligence on IEE)
• Experimental Rates
• Utilizing AMI reads for high bill and customer self service
• Use of AMI data for Storm estimation
• Future use of AMI data for RCS and HAN
• Currently reviewing AMI BPD efforts for future Business Case opportunities
14
• Selected MDM vendor and platform in 2005, Implemented 1Q 2006
• Upgraded to IEE 7.0 SP3 in April 2011, current platform sized for 3M Meters
• Currently configured ~2.4 M AMI premises
• Web service integration to mainframe CIS and AMI Network for Billing and meter installs.
• Accommodates off cycle and monthly billing.
MDM at FPL today
Customer
Billing
Meter Data
Management
Add / Change / Remove Premise
Add / Change / Remove Routes
Set / Correct Meter
Cycle Day Management Functions
Interval Reads
Billing Reads
Off cycle / Adhoc Reads
15
Current State – Logical Diagram
16
MDM Production Landscape using Microsoft SQL Server
IEE Application Servers(PROD)SAN(GO) IEE Database Servers(GO)
IEE Database Servers(JB)
LOG SHIPPING
SAN(GO)
SAN(JB)
IEE Application Servers
Specifications
CPU CORES: 4
Clock Speed: +3.0 GHz
RAM: 16 GB
Local Storage: 40GB
OS: Windows Server 2003
Enterprise Edition(32 Bit)
ItronEE
(Primary)
ItronEE
(Backup)
AMI
Silver Springs
Network
Load Management
System
IEE Database Server
Specifications
CPU CORES: 16
Clock Speed: 3.0 GHz
RAM: 64 GB
Local Storage: 140GB
OS: Windows Server 2003
Datacenter Edition(64 Bit)
CPU CORES: 16
Clock Speed: 3.0 GHz
RAM: 64 GB
Local Storage: 140GB
OS: Windows Server 2003
Datacenter Edition(64 Bit)
Storage Requirements
SQL Partitioning-YES
Reading Table
Partitioned 4 times per
month(8 days per
partition)
2TB Per Year
Storage Requirements
SQL Partitioning-YES
Reading Table
Partitioned 4 times per
month(8 days per
partition)
2TB GB Per Year
Production Environment
Network Load Balancer
@GOWeb Service Clients
IEE Data Folders
IEE Application Server4
w/ Web ServicesEAI
Customer Pages
Network Load Balancer
IEE Application Server3
w/ Web Services
IEE Application Server2
w/ Web Services
IEE Application Server1
w/ Web Services
SQL CLUSTER
(ACTIVE/PASSIVE)
Active
Passive
SQL CLUSTER
(ACTIVE/PASSIVE)
Active
Passive
SAN
Specifications
Storage: 200GB
17
• Process and Deliver AMI reads for on-cycle billing
• 225,000 daily billing reads expected in the near term (2013)
• Off cycle reads – order completion nightly
• 120m interval reads daily
• Data Retention for 13 months
• Daily read, hourly intervals, flags for 5 million endpoints
• Theft analysis and lead generation based on 5m end points
• Web access to 50k concurrent users
Near Term MDM Functionality
• VEE – fill the gaps (dependent on AMI) – Planned for 2012
• Determinants to support TOU/CPP using formula channels
• Implemented DPR
• Interface to Data Warehouse for billing analytics
MDM Volumetrics
18
• MS SQL Server 2008 R2 Enterprise Edition
Implemented May 2011
2 node Cluster Server – 4 Quad Cores (16 Logical CPUs)
128 GB RAM on each
DR environment is same as Production
Current DB size – 1.4 TB with 31 months of Readings (Total storage allocation is 3 TB)
• Performance
– Temp DB has now been moved to EMC FAST (Fully automated storage Tier) – 200GB allocation, 100 GB in use
– Database is split into 4 RAID 10 Volumes
– Transaction logs on a separate Volume
– 4 RAID 5 Volumes to host aging data
– Table Partitioning implemented in 1Q 2011
Weekly partitions for Reading table
Current SQL Server Environment at FPL
19
• Data Replication using Recover Point
– EMC Solution for data replication and disaster recovery
– RAID’s are kept in sync
FPL is using Async methodology
DR environment is approx. 1 Min behind Prod
– Volumes are kept in un-mounted state on DR
– Recover point front end used to mount and maintain volumes
– Options to failover to older image or point in time
– Current Journal size is 1 TB – 1 day of roll back
Solution is storage intensive and not cheap
Current SQL Environment and Recover Point
20
Critical tasks - Current Processing times
Current SQL Server Environment at FPL
Task
Approx. time of
execution
Average
Duration
ARI Import (Interval / Register Reads 3:00 PM 4 Hours
Integrator Billing Import Early AM 6 Mins
ABE Import Early AM 23 Mins
Service Order 10:00 PM 10 Mins
Reconciliation Report Midnight 1 hour
SRI Import 1:15 PM 21 Mins
AMI Billing Rate Calculation 2:00 PM 14 Mins
AMI Billing Export 2:20 PM 11 Mins
Integrator ABE Export 2:35 PM 2 Mins
21
• Future Plan
– Plan to move all DB files to EMC FAST
– Working with Itron to better manage the data growth
Partitioning of additional tables
Routine purging
– 4 Hourly Interval / Register reading export from UIQ to IEE
– Solution to process EAI messages with 4 application servers
Current SQL Environment and Recover Point
22
Contact Information:
Daniel Lizano
Florida Power and Light
IT Business Solutions Group Manager
Phone: 305-552-3207
Email: [email protected]
Amit Grover
Florida Power and Light
IT Business Solutions Manager
Phone: 305-552-3464
Email: [email protected]
Ray King
Utility Industry Solutions
Microsoft Corporation
Phone: 813-639-4013
Email: [email protected]
