Upload
tasc-inc
View
3.228
Download
0
Tags:
Embed Size (px)
Citation preview
Adapting Cloud Computing for
www.appistry.comThe Fabric of Business
Adapting Cloud Computing for Intelligence and Defense
Scaling Performance, Managing Power
September 2008
Defense, Intelligence Community Mission Drivers
The DoD vision for net-centric operations and warfare:
• Scalable Net-Centric Computing
• Establish processes and an online mechanism for customers to directly
provision a virtual operating environment on demand within minutes
to meet ad hoc, real time warfighter needs.
• Establish a capability for applications to dynamically scale computing
www.appistry.comThe Fabric of Business
• Establish a capability for applications to dynamically scale computing
resources up and down on demand to meet traffic loads.
• Enterprise Computing
• Move toward the concept of virtual or grid computing in which
applications will utilize available computing capacity irrespective of
geographic location.
http://www.disa.mil/strategy/
2
DoD Information Sharing Strategy
This DoD Strategy establishes the vision for the future:
Deliver the power of information to ensure mission success through an
agile enterprise with freedom of maneuverability across the
information environment.
To achieve the vision, this Strategy describes four goals that form the
necessary environment across the DoD. These goals are: (1) promote,
www.appistry.comThe Fabric of Business
necessary environment across the DoD. These goals are: (1) promote,
encourage, and incentivize sharing; (2) achieve an extended enterprise; (3)
strengthen agility in order to accommodate unanticipated partners and
events; and (4) ensure trust across organizations.
John Grimes, DoD CIOhttp://www.defenselink.mil/cio-nii/docs/InfoSharingStrategy.pdf
3
Appistry EAF: Technology Infrastructure To Enable Sharing
DoD Information Sharing Strategy:
Goals3) Strengthen agility, in order to accommodate
unanticipated partners and events (scale, surge,
adaptive technologies)
Approaches
www.appistry.comThe Fabric of Business 4
2) Forge information mobility (processing of
information)
3) Make information a force multiplier through
sharing (volume, velocity)
http://www.defenselink.mil/cio-nii/docs/InfoSharingStrategy.pdf
Appistry: Enhancing the Information Sharing Value Chain QOS
www.appistry.comThe Fabric of Business 5
http://www.defenselink.mil/cio-nii/docs/InfoSharingStrategy.pdf
Meeting the need
• On-demand infrastructure
• Virtualization
• Cloud computing
• Enabling Scale - Application and Power
www.appistry.comThe Fabric of Business
• Enabling Scale - Application and Power
• Enabling Mission Resilience and Reliability
• Hiding Development and Operational Complexity
• Minimal Infrastructure Impact
6
Cloud offers an emerging commercial best
practice for application/service delivery
based on the Google/Amazon model:
• Incrementally scalable
• Agile & adaptive
Cloud as Platform: Characteristics
www.appistry.comThe Fabric of Business
• Agile & adaptive
• Reliable and fault-tolerant
• Programmable
• Virtualized
• Self-managing
• Commodity infrastructure
A “Google-Like” Platform for Applications
7
Adapting commercial best practices to Federal
Public
Cloud
Public Clouds
E.g.
• GoGrid
• Google AppEngine
• Amazon EC2
www.appistry.comThe Fabric of Business
Enterprise
8
• Amazon EC2
Public
Cloud
Adapting commercial best practices to Federal
Private (Internal) Clouds
• Cloud characteristics
• Behind the firewall
• Secure networks
• Data, applications don’t
leave the enterprise
www.appistry.comThe Fabric of Business
Enterprise
Private Cloud Private Cloud
External
Internal
9
leave the enterprise
• Leverages existing
investment in blades,
virtualization
Seamless piece of the puzzle
Services and Applications
?
www.appistry.comThe Fabric of Business 10
Commodity
Infrastructure
Virtual Machines
Commodity
Infrastructure
Commodity
Infrastructure
…
Virtual
Machines
Virtual
Machines… Virtual
Machines
Virtual
Machines…
?
Cloud Technology Stack
Appistry EAF: Cloud Application Platform
Services and Applications
www.appistry.comThe Fabric of Business 11
Commodity
Infrastructure
Virtual Machines
Appistry EAF: Cloud Application Platform
Commodity
Infrastructure
Commodity
Infrastructure
…
Virtual
Machines
Virtual
Machines… Virtual
Machines
Virtual
Machines…
No disruption of your existing server and virtualization investments
Cloud Computing In Your Operational
Environment
• Logical extension to your existing, heterogeneous
computing infrastructure
• A quality of service supplement to your existing
heterogeneous infrastructure
• Reduce risk, improve mission availability
www.appistry.comThe Fabric of Business
• Scale without fail
• Compute within pre-defined time windows
• Correlate power consumption to application workload
• When to deploy to the Cloud Application Framework?
• When applications, key algorithms or SOA services require
the processing power of multiple CPU’s in order to meet
surges in demand and other SLA parameters.
12
Seamlessly Integrating the Technology
• Appistry Quick Start - 5 well defined steps
• Assign infrastructure to cloud application framework
• Identify services and capabilities that require scale and
reliability quality of service provided by the fabric.
• Add meta data to place services in the cloud
www.appistry.comThe Fabric of Business
• Add meta data to place services in the cloud
• Use the Appistry libraries to call the services within the
cloud
• Measure performance, adjust infrastructure as required to
meet service level agreements
13
Appistry Quick Start Enables:
• People
• Train your operations staff to create, deploy and support the cloud
infrastructure; deploy energy management policy
• Train your developers to cloud-enable their applications and call them
• Process
www.appistry.comThe Fabric of Business
• Adopt procedures for, adding and subtracting infrastructure from the
fabric, determining which applications benefit from the QOS benefits of
the cloud
• Technology
• Retain your current heterogeneous, virtual and physical architecture
• Add meta data to your applications, services or algorithms
• Use Appistry libraries to call cloud enabled Applications and Services
14
Appistry EAF ArchitectureM
an
ag
em
en
t & M
on
itorin
g
De
plo
ym
en
t & P
rov
ision
ing
Po
licy D
efin
ition
& E
nfo
rcem
en
t
Dynamic / Distributed Load BalancingCloud
Application
Middleware
Application
Components
Java
POJO
.NET
PONO
Legacy External
(Web)
Service
Process Orchestration Batch Scheduling
…
www.appistry.comThe Fabric of Business
Any Cloud
15
Ma
na
ge
me
nt &
Mo
nito
ring
Self-Organization (Discovery, Availability)
De
plo
ym
en
t & P
rov
ision
ing
Po
licy D
efin
ition
& E
nfo
rcem
en
t
Tomcat
Cloud
Package
Management
Apache IIS JBoss Mule …
FAMCloud Services
FAM
Queues…
Solution Value• Scale Application Performance
• Scale SOA services and existing applications
• Scale applications across multiple CPUs (2-1000’s)
• Logically isolate processing without creating physical stove pipes
• Create Operational Efficiencies
• Achieve QOS of HA (High Availability) solutions on existing commodity infrastructure
• Monitor and control license distribution within the fabric
• Use fabric metadata to dynamically restore high-value capabilities under cyber-attack
www.appistry.comThe Fabric of Business
• Isolate and pre-provision dynamic COI’s (Communities of interest)
• Hot plug-in of server resources
• Reduce Operational And Program Risk
• Distribute transparently
• Reduce application IOC (Initial Operational Capability) to FOC (Full Operational Capability),
development time , scaling for FOC usually gets in the way
• No need to re-perform security accreditation; applications are cloud-enabled via meta data
• Reduce Power Consumption (Scale Power Utilization)
• Performance based power management, defined by user policy
• Correlate power consumption to data center workload
16
Scaling SOA
• Improve Mission Availability
• Reducing application down time due to hardware failure
• Completing processing within pre-defined time windows
• Maintain Required Service Availability And Performance
Objectives
• During high demand
www.appistry.comThe Fabric of Business
• During peak demand
• Unanticipated demand
• Reduce Costs
• Utilizing existing commodity hardware infrastructure
• Streamlining operational processes to deploy based on performance
17
Leading-edge enterprises looking for advanced platforms to support XTP requirements should consider grid-based application platforms when their major concern is scale-out scalability, and nearly 100% availability for transactional and analytical applications- Gartner -
Compute Intensive Activities
• Image, data compression/decompression
• Encryption/decryption
• Image processing
• Scheduling, logistics planning
• Search
www.appistry.comThe Fabric of Business
• Search
• Matching (data mining, business intelligence)
• Simulation
• Parallel computations (matrix calculations, Fourier transforms, spectral and signal analysis)
• Pattern recognition
18
Case Study:Decreasing development complexity for a high-volume image processing application
Challenges:
• Multi-core / SMP development complexity
Appistry EAF at GeoEye
Data Process Result
The leading provider of satellite imagery for
government and commercial applications, GeoEye is building its next-generation image processing applications on Appistry EAF.
www.appistry.comThe Fabric of Business
• Multi-core / SMP development complexity• Risk, cost and agility of traditional platforms• Meeting customer SLAs
Results:
• Imaging applications now able to process in excess of 5 TB of satellite imagery per day
• Developers able to focus on core competencies• Capital savings greater than $1.2 million• Easily meet customer requirements for
maximum processing time
“ By relying on the application fabric to provide scalability, reliability and manageability, we can leave our infrastructure concerns behind and focus on providing maximum value to our customers. ”
– Ray Helmering,
VP Photogrammetric Engineering at GeoEye
Case Study:Cloud-Enabled Logistics Solution
Data Process Result
Customer: Leading Transportation Services Provider Worldwide
• 2+ Million Stops• 60,000 Employees• 2,000 Developers
Application:
www.appistry.comThe Fabric of Business
Challenges:
• Bringing strategic application to market quickly• Supporting existing application code• Ensuring predictable request execution
Results:
• Application deployed in one day• Predictably processes all shipments in
required timeframe• Application to save tens of millions of dollars
per year
Application:Mission-critical logistics planning application
20
Gartner Says
• Appistry in the visionary Magic
Quadrant for Enterprise Application
Servers, 2Q08 - Strengths
• Leading-edge, grid-based application Platform
(Appistry Enterprise Application Fabric (EAF))
targeting transactional and analytical
applications
www.appistry.comThe Fabric of Business
• High-profile, large scale (more than 400 CPU
cores in one case) and business-critical
deployments in large, Global 2000 class
companies
• Support for .NET and Java environments
• Aggressive “razor and blade” strategy (Appistry
Open distribution) based on free Appistry EAF
use (development, testing and production) and
sales of add-ons for managing large scale
deployments and infrastructure energy savings
21
Energy Consumption Projections
“50 Percent of Data Centers
Will Have Insufficient Power and Cooling Capacity by
2008”
www.appistry.comThe Fabric of Business 22
“The energy use of the nation’s servers and
data centers in 2006 is estimated to be more
than double the electricity that was consumed
for this purpose in 2000… Under current
efficiency trends, national energy
consumption could nearly double again in
another five years”
Google’s U.S. Data Center Locations and Placement Criteria
Operating costs drive
Google data centers to the
center of country
www.appistry.comThe Fabric of Business
• Large volumes of cheap electricity.
• Green energy. Focuses on renewable power sources.
• Proximity to rivers and lakes. They use a large amount of water for cooling
purposes.
• Large areas of land. Allows for more privacy and security.
• The distance to other Google data centers (for fast connections between data
centers).
23
Power Transmission Geography Constrains and Dictates Choices
www.appistry.comThe Fabric of Business 24
The National Security Agency plans
to put a data center in San Antonio,
Texas - 3rd in the nation for
operational cost efficiency -
U.S. Rep. Charlie Gonzalez
March 2007
Power and Cooling: Mission Critical Constraint For Intelligence and DoD
NSA electricity crisis gets Senate scrutiny - Baltimore Sun, January, 2007
• NSA expects its power demands to exceed its supply within the next two
years - an issue it has been aware of since the late 1990s. NSA Director Lt.
Gen. Keith B. Alexander has acknowledged the problem
• The NSA’s impending electricity shortfall is "sort of a national
catastrophe," Sen. John D. Rockefeller IV, the chairman of the Senate
www.appistry.comThe Fabric of Business
catastrophe," Sen. John D. Rockefeller IV, the chairman of the Senate
Intelligence Committee
Power supply still a vexation for the NSA - Baltimore Sun, June, 2007
• Referring to the NSA's power shortage. "It got to a point where it became
a serious problem. We're attempting to deal with it now.” Rep. C.A.
Dutch Ruppersberger, Maryland Democrat, House Intelligence
Committee
Trend: BRAC (Base Realignment and Closure) consolidations and physical
security considerations condense data centers into burdened power grids;
NGA, DISA, etc.
25
Security Need: Disrupt The TrendRelocating Data Centers Is Not a Sustainable Model
www.appistry.comThe Fabric of Business 26
State-of-the- art All measures in “Best practice” scenario, plus: • Aggressively consolidate servers • Aggressively consolidate storage • Enable power management at data center level of applications, servers, and equipment for networking and storagehttp://www.energystar.gov/ia/partners/prod_development/downloads/EPA_Datacenter_Report_Congress_Final1.pdf
Appistry: Scaling Power Without Fail
Performance-Based Power Management
A user policy based, application-aware approach to
power management ensuring the highest levels of
application performance while minimizing
infrastructure power consumption.
www.appistry.comThe Fabric of Business
infrastructure power consumption.
27
“In a typical data center, electricity usage hardly varies at all, but application load varies by a factor of 3x or more.”
-Rocky Mountain Institutehttp://www.govtech.com/gt/312792
Appistry Energy Saver
Correlates power
consumption to
data center workload
Fabric Technology Enables Performance-Based Power Mgmt
Appistry Energy Saver:
Decoupling applications
from infrastructure:� Application performance,
reliability ensured by fabric
“The chief performance attributes of data
centers - availability, reliability and sheer
horsepower (performance) - are at odds with
the conservation-based assumptions of
sustainability”
Suggestion 9: When not in use, turn it off
How to Cut Data Center Energy Consumption, May 2008
www.appistry.comThe Fabric of Business
reliability ensured by fabric
� Utilizes your existing
infrastructure – does not require
a complete hardware refresh
� Within user defined policy,
Appistry knows what to turn on
and off, and when
28
How to Cut Data Center Energy Consumption, May 2008
3. EnergySaver dynamically
2. EnergySaver compares current
system performance to policy
targets set by administrator
Appistry Energy Saver Scales Power
1. EnergySaver constantly
monitors system
workload
www.appistry.comThe Fabric of Business
3. EnergySaver dynamically
adjusts number of active
computers
Appistry EAF + EnergySaverAppistry EAF + EnergySaver
Application AApplication A Application BApplication B Application CApplication C
29
Result: data center power
consumption correlates to
application workload
Customer Scenario: GeoEye
The leading provider of satellite imagery
for government and commercial use.
Input Process Output
• New satellite, GeoEye-1, with
unprecedented resolution
• Image importance, processing
varies based on tasking,
coverage
www.appistry.comThe Fabric of Business
coverage
• Appistry EnergySaver will
reduce number of “on” CPUs
when satellite is looking at
ocean!
Appistry EAF at GeoEye
30
Customer Scenario: Clearent
Fast-growing credit-card payment
processor.
Input Process Output
• Fabric-based applications for
authorization (online) and
settlement (batch)
• Batch settlements have
stringent completion-time
www.appistry.comThe Fabric of Business
stringent completion-time
SLAs requiring additional
compute power
• Appistry EnergySaver will
automatically bring on
additional capacity, when
needed
Appistry EAF at Clearent
31
For More
Sam Charrington <[email protected]>
VP Product Management & Marketing
http://www.appistry.com/blogs/sam
http://twitter.com/samcharrington
www.appistry.comThe Fabric of Business
Dan Wilbricht <[email protected]>
Director of Federal Programs
direct: 703-318-0930
33
The Green Grid OpportunityDECREASING DATACENTER AND OTHER IT ENERGYUSAGE PATTERNS
Gartner analysts advise
enterprises to make the
most efficient use of
existing systems with
technologies such as
workload balancing and
www.appistry.comThe Fabric of Business
workload balancing and
virtualization, and to plan
for greener datacenter
designs in the years ahead.
35
http://www.thegreengrid.org/gg_content/Green_Grid_Position_WP.pdf