Upload
justin-wright
View
212
Download
0
Embed Size (px)
Citation preview
IBM Software Group
®
Performability and Gridin an On Demand World
Robert Berry,IBM Corporation
IBM Software Group
Good morning and thank you
IBM Software Group
Outline
Performance and Reliability are important
The Grid is an important component of business computing, today, and for the future
On Demand – the drive for ultimate flexibility and integration
• Leads us to Grid
The Grid in business
• Typical Examples of commercial Grid applications
• A different kind of example
Trends, Consequences, Questions for Performability
IBM Software Group
Performance, Reliability are important
Reliability, Quality A growing part of software development budget is spent on performance, test and service
Problem rates on new technologies (e.g., J2EE) are high and climbing
New solutions are required.
Typical development profile
41%
47%
5%7%
Development
Performance, test andservice
Build
Other
IBM Software Group
An on demand business is an enterprise whose
business processes—integrated
end-to-end across the company and with key
partners, suppliers and customers—can
respond with speed to any customer demand,
market opportunity or external threat.
On Demand Business – The “ Why”
IBM Software Group
Present Reality: Functional Automation
Limitations of Tight Vertical Integration:
• Monolithic applications can’t be reused economically, efficiently
• Ad hoc integration creates connections that are difficult to change/maintain
• Lack of standards limits ability to deliver meaningful interoperability
Marketing
Partners
Web
Partners
Sales
Partners
IBM Software Group
Marketing
Partners
Web
Partners
Sales
Partners
What Business needs: Horizontal Process Integration
Advances that make it possible:
• Standards for creating services and enabling them to communicate are agreed upon by major vendors
• Infrastructure that supports self-defined, loosely coupled services has emerged
• Tools to incorporate existing assets are available
• Automation and virtualization of systems resources readily available
Need to Integrate
IBM Software Group
Marketing
Partners
Web
Partners
Sales
Partners
What Business needs: Horizontal Process Integration
Need toIntegrate
Business Flexibility
IT Simplification
Increased focus on business flexibility
• Relentless use of open standards to enable communication and integration across the value net
• Partner to sharpen focus and respond to opportunities and threats
Requires an on demand IT environment
• Ability to repurpose application functionality in order to support horizontal processes
• Automation and virtualization of resources
IBM Software Group
Business process decision-making
Rigid organizational structure
Slow and steady economic growth
Long-term product lifecycles
Passive operational risk management
Fixed costs
Proprietary systems
Labor-intensive
Users adapt to technology
Collaborative, integrated value nets
Dynamic, adaptive, learning
Unpredictable fluctuations
Shortening product lifecycles
Proactive risk management; increased focus on privacy and security
Variable costs
Open, integrated systems
Self-healing, self-managing systems
Technology adapts to users
Bu
sin
ess
Tec
hn
olo
gy
Static On Demand
IBM’s On Demand model is a fundamental shift in the business model and technology
IBM Software Group
Focus on Virtualization and Grids
On Demand Operating Environment
Transactional Processes
Application Development, Deployment & Maintenance
Collaboration Information Management
Integration: People – Process – Information “Anywhere, any time, from any device”
Security Optimization Provisioning
Policy-based Orchestration
Availability
Business Objectives
and Policies
Virtualization Engine
StorageServersDistributed
Systems Network
Op
en S
tan
dar
ds-
bas
ed
Business Objectives
and Policies Grids
IBM Software Group
Grid – is it commercially real?
Several commercial examples Charles Schwab
Hewitt Associates
A somewhat different example Games
IBM Software Group
Charles Schwab
• Reduce the processing time on an existing wealth-management application to improve customer service.
• IBM • Linux • Globus Toolkit• IBM Infrastructure Technology Services • IBM Research
Challenge
SolutionTechnology Benefits:
Business Benefits:• Increased customer satisfaction by
responding to inquiries in real time• Enabling Schwab to move from a low-cost
transactional broker to an advice-based wealth manager
“We believe that Grid computing … has the potential to greatly improve our quality of service and be a truly disruptive technology.” Oren Leiman, Managing Director, Charles Schwab
“We believe that Grid computing … has the potential to greatly improve our quality of service and be a truly disruptive technology.” Oren Leiman, Managing Director, Charles Schwab
Technology Benefits:• Reduced processing time from four
minutes to 15 seconds• Leverages existing infrastructure• Grid-enabling many more applications
Business AnalyticsBusiness Analytics
IBM Software Group
Hewitt Associates LLCChallengeCreate Grid Computing environment to:
Contain expenses for CalcEngine valuations
Maintain or improve availability, response time & scalability
Insure personal-data security
Capitalize on existing application code
Cooperate with z/OS Sysplex CICS Calling Environment
Enable smooth and orderly migration to changeSolutionGrid Computing environment includes:
IBM zSeries® server
IBM eServer BladeCenterTM servers
Linux Red Hat v8.0
Business Partner: DataSynapse GridServer
Business Analytics
Benefits: Efficiently uses of the combined
processing power of their heterogeneous environment
Experienced an immediate 10% faster response time with the first application deployment
Open architecture enables Hewitt to easily deploy additional applications
Increased processing speed reduced cost per transaction
Reduced operational costs improves competitiveness in their industry segment
IBM Software Group
HR Outsourcer Business Background
Real time policy calculation Valuate participant scenario with respect to employer constructs
Policies defined by corporate plans and governmental rules
Custom interpretive language worksheet creation
Valuations are an expensive business COBOL CICS applications serialize person data through VSAM
Smalltalk Operations can take 1-50 seconds of zSeries computing
Arrival rate is erratic, causing divergent response time
Grid cost is justified by the flexibility for new deployment
zSeries Model 900
CICSAAA
COBOLBA0111COBOL
CaIcEngineSmalltalk
zSeries Sysplex16000 Mips71 CPs4 CPs for CalcEngineMore CPs for development
IBM Software Group
Integrating Smalltalk Into A Grid Grid Servers(xSeries)
Linux
VMWare or Blades
Binding App.
Linux
Smalltalk
CaIcEngineSmalltalk
zSeries Model 900
CICSAAA
COBOL Bin
din
g
Ap
p.
IBM VisualAge Smalltalk Connectors Support for APPC, CICS, CPI-C, MQI and
TCP/IP (sockets and RPC)
Version 6.0.1 became a ‘pre-req’
• Required DB2 access from Engines Prototype Selection
Tried OGSA v3 in February, but…
Keep it simple!
Use Java socket code
Provide enough ‘middle points’ to be able to ‘watch/debug’ request flow
IBM Software Group
OptimalGrid
A Research project at IBM Almaden Researcher Center
Makes developing and running grid application easy by hiding the complexity of using the grid
A different approach from the API or Toolkit application development environments – no need to educate developers on complicated grid technologies
Application code, Management Infrastructure, and Manager written in Java so it runs anywhere Java runs
Non-Java application integration possible via JNI and MathShell
IBM Software Group
What if….? You could create a NEW GENRE of massive player online game…
Where you can FLY through a huge game world
Where you can SEE objects in the other server
Where you can INTERACT with the entities on the other servers
Range of sight For player #1 Range of sight
For player #2
Server 1
Server 2
Server 3
Server 4
Server 6
Server 7
Server 8
“Interacting” withEntities in other servers
IBM Software Group
What if….? You could create a MASSIVE multi-player online game
Where the number of players are NOT LIMITED by the server hardware
Where everybody is in ONE WORLD, not several different “shards”
Where massive battles with over 10,000 PLAYERS are possible
#1 Game world server( 2000 players )
#2 Game world server( 1000 players )
#3 Game world server(MAX: 3000 players)Outage due to sudden increase in players
In the other game world.
ONE Gridified Game World
Game environment not limited by server hardware
HelloPlayer ABC
Hello player
XYZ
Three separate Parallel Game Worlds
Come join the big battle!
I got disconnected!
Where are you?
IBM Software Group
What if….? Your game servers could load balance the game DYNAMICALLY
Where the servers will allocate resources AUTOMATICALLY
Where the servers will partition the game for OPTIMAL PERFORMANCE
Game map zone : Blue Game map zone : Red Game map zone : Yellow
Huge User Movement From Map Zone BLUETo Map Zone RED
Grid Resource DynamicallyRe-allocated withOptimal configuration
IBM Software Group
• 870 unique total client code downloads • 67 IBM domains worldwide• 18% Linux clients 82% windows
Massively Multiplayer Online Game (mmog) Demonstration Based on Quake2
IBM Software Group
For Game Developers, Hosts, and Aggregators of MMOG
OptimalGrid can:
- Automatically partitions and distributes any game world
- Seamlessly moves players and objects between servers
- Game migration is easy
- Original game design is preserved
OptimalGrid’s Autonomic feature hides the complexity of Grid from the Application Developer, while resolving pain points
Player now in GameGrid
Server A’s Zone
Player now in GameGrid
Server B’s Zone
IBM Software Group
Performability in an on demand world
Performance
Reliability
IBM Software Group
Flexibility and Responsiveness drive On Demand
Flexibility
Componentisation
Reuse
Simplification
Virtualisation at all levels of Resources
Autonomic control
Reliability (predictability)
Finer modularity
Security
Responsiveness
Open Stds
Performance
And they, in turn, drive Virtualisation (Grid) And also have consequences for Performability
IBM Software Group
Trends, their Consequences, and Questions
SecurityA classic antithesis for performance
A critical and growing requirement for business
But a growing problem we all face, e.g.,
• Viruses−6.5M in 2003
• Antivirus scans - 3 hours of “downtime”
• Overhead for J2EE security managers ---------------------------------
This will continue to grow
• 6M Viruses so far in 2004
0
20
40
60
80
100
120
HTTP
req/s
ec.
No Sec.
Java2 Sec.
Java2 + J2EE Sec.
Trade3JVM: cn1411-20030915
IBM Software Group
Performance
Reliability
Security
- Typically drives performance down - pathlength goes up - scalability is constrained
-Typically enhances reliability-Availability also goes down with virus scans, etc.
• Security
Open, Grid environments scale up security issues, and mandate more attention.
Do we need to model these interactions explicitly?
Are present techniques adequate? Appropriate?e.g., to capture viral spreading patterns, containment
Trends, their Consequences, and Questions
IBM Software Group
Trends, their Consequences, and Questions
Scalability Whatever we think is large and complex now, won’t be in the future.
We see this in some of the grid examples we are familiar with
Games motivates another jump in scale
• 10,000 users at a time
• Communities of 500,000’s of users
• Wireless gaming will drive server demand, and strain adaptive capabilities even harder
• Security issues will multiply profoundly− Gaming is real commerce
− People buy virtual things – e.g., castles, etc., on ebay!
IBM Software Group
Trends, their Consequences, and Questions
Complexity A growing concern for software in general
New technologies/disciplines – e.g., componentisation, Aspect Oriented Software Development - must help, but for now, we are faced with:
1 5 9 13 17 21 25 29 33 37 41
Call Depth
0
100
200
300
400
500
600
700
800
900
Fre
qu
en
cy
Call Depth Frequency for simple J2EE application
• One factor that contributes to growing security overhead
• Also to resulting models of reliability and overall fragility
IBM Software Group
Trends, their Consequences, and Questions
Componentisation and Reuse Demands modularity and reuse in models
Demands incremental, scalable, composable models
Autonomic Systems What is a failure in a self-healing system?
What are the reliability characteristics of a system that is adaptive?
How is this to be characterised, measured, modelled?LotusWebSphere DB2Tivoli
Re-factor to SWG Product Offerings
Componentization
LotusTivoli WebSphere DB2New or
EnhancedCapabilities
New or EnhancedCapabilities
New or EnhancedCapabilities
New or EnhancedCapabilities
New or EnhancedCapabilities
SharedComponents
Product OfferingsProduct Specific
Investment
SharedCapabilities
InitialBase
Product
IBM Software Group
Trends, their Consequences, and Questions
Autonomic Systems What is a failure in a self-healing system?
What are the reliability characteristics of a system that is adaptive?
How is this to be characterised, measured, modelled?
IBM Software Group
Trends, their Consequences, and Questions Business focus is needed
Growing Recognition of the importance to IT of Business Events, Business Processes
For deeply technical people this is a hard concept
• But, technology exists to solve business problems
There are some interesting opportunities for performability as well. E.g.,
• Reliability as a factor in service level objectives, agreements
• Dynamic, operational performability
• Measuring and Characterising Business Performance; Business Reliability. The Reliability of Services.
Business Performance Management monitors and visualizes the behaviour of business processes by correlating IT events and business activities, thus enabling performance optimization according to business goals
IBM Software Group
Summary
Performance, Reliability are growing business concerns
The Grid solves real business problems and is part of the overall solution in delivering increasing flexibility and responsiveness.
Dependency on Software is growing in all levels of IT solutions
Complexity is growing
Security is a growing requirement, and the tradeoffs between security and performance need to be better understood
The IT focus is moving increasingly higher up the software stack; indeed, beyond the software into the business domain.
Reliability, Performance and Availability are more complex with dynamic provisioning and autonomic control
IBM Software Group
Thank You!
Questions?
IBM Software Group
Getting OptimalGridAvailable for download on Alphaworks
www.alphaworks.ibm.com/tech/optimalgrid
Project pageswww.almaden.ibm.com/software/ds/OptimalGrid
E-week: http://www.eweek.com/article2/0,3959,1227299,00.aspSlashdot: http://games.slashdot.org/article.pl?sid=03/08/22/0351229&mode=thread&tid=112&tid=127&tid=136&tid=186&tid=187&tid=206
)
MIT Technology Review
Researchers
James Kaufman [email protected] Lehman [email protected] Deen [email protected]
IBM Software Group
Trademarks
Hewitt is a trademark of Hewitt Associates, LLC
Charles Schwab is a trademark of The Charles Schwab Corporation.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, BizTalk, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Gartner is a registered trademark of Gartner, inc., or its Affiliates
Solaris is a trademark of Sun Microsystems, Inc. in the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Intel, Pentium, Pentium Pro, Pentium II, Pentium III are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the US and other countries.
HP-UX is a registered trademark of Hewlett Packard Company.
Linux is a registered trademark of William R. Della Croce, Jr. (last listed previous owner was Linus Torvalds)
"SAP is the trademark of SAP AG in Germany and in several other countries.
AIX, AS/400, Blue Gene, BlueDrekar, Lotus, Tivoli, Rational, XDE, Z/OS, DB2, Deep Blue, Deskstar, Discoverylink, IBM, Microdrive, OS/390, Scrollpoint, ServeRAID, Thinkpad, TransNote, Travelstar, Ultrastar, Websphere, Workpad, are all trademarks and registered trademarks of International Business Machines Corporation in the United States and/or other countries.