Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
© 2006 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice
Utilification reduxMiddleware 2006
John WilkesHP Labs, Palo Alto, California
7 November 2006 Utilification redux - Middleware 2006
UtilificationEuropean SIGOPS workshop 2004
John Wilkes, Jeff Mogul, Jaap SuermondtHP Labs, Palo Alto, California
Some images adapted from the original paper, which is Copyright © ACM.
8 November 2006 Utilification redux - Middleware 2006
Lessrisk
Higherbusiness returns
More agility
Q: what does enterprise IT need?
Better performance
9 November 2006 Utilification redux - Middleware 2006
Q: what does enterprise IT need?A: utility computing!
Flexible, scalable provisioning of computer-based services−on demand: as and when needed−agile: in response to events
−without all the hassle
10 November 2006 Utilification redux - Middleware 2006
“Utility computing” is not enough
utility computing
getting to utility computing
11 November 2006 Utilification redux - Middleware 2006
Q: what does enterprise IT need?A: utility computing!OK then. How do you get there?
Transform applications from their standalone version into a utility-computing one
Utilification
“I’m all for progress. It’s change I don’t like.”
– Mark Twain
13 November 2006 Utilification redux - Middleware 2006
Utilification: the processIsn’t it simple?
14 November 2006 Utilification redux - Middleware 2006
Utilification: the processIsn’t it simple?
15 November 2006 Utilification redux - Middleware 2006
Utilification: the processIsn’t it simple?• Pick the application to migrate• [Shut it down]• Bring it up in the new environment −pick throughput and response times−work out how many resources the app needs− tune things a bit
• Maybe wrap some resource-management stuff around it
• Basically straightforward, even if effort-intensive• Right?
16 November 2006 Utilification redux - Middleware 2006
Utilification: the processIsn’t it simple? Sample enterprise IT plan
Call Event Management Training Services
eDelivery
Sales & Marketing
eDelivery
Project Management HW & SW Supply ChainIM & Reporting
FinanceReference Systems
Bluestone App Server
.NET App Environment
CustomerConnectivity
CISL, CPRS, HAO,Predictive, ISEE
Shared Appse.g. Siebel
App Servers(NT)
HP-UXWeblogicJ2EE AppServers
SiteminderSiebel
eChannelPortal (OOTB)
JavaScript/JSP/NTIIS/ ASP.NET, Apache/Javascript, Weblogic/JSP
Uniform Portal/Web Application Framework (One or More Instances)
B2B &Fulfil lment
Partner Major Account SMB Consumer
SoftwareManagementPatches
Other Clients
W2K.NET AppServers
SRS(VendorMaster)
PPCProduct Pricing Central
(Material MasterPurchasing Info Records
PartPricingCost
Consulting ProductsService Master)
CRS(Customer
MasterAP/Japan/
Europe/LA/NA)
Skillpack
PartnersBPS
(CSN & CPN)
Upfront Service Order(pre-paid). For service delivery
& future renewal
IndirectRegistration
ServiceEntitlement
B2BiBulk Rosettanet
eClaims
Entitlement Service
eSupport
eSellingStoresSMB
Major AccountConsumer
Sales CallCenter
InternetMarketplaces
Claim WebService
EDISupportpackRegistration
EDITrans-
formationOrderPacks
OrderePacks
ServiceEntitlement
ServiceEntitlement
ePackRegistration
Obligation Feedfrom HPS SAP
SCA
PostalServiceTeams
Consumer
J2EE App Environment
RegisterConsumer
Packs
OrderPacks
OrderPacks
WWEO
WWSNRS
IntegratedWarranty
Terms Mgmt.& Entitlement
Solution
Obligation/Entitlement ODS
Service Bites,PrintAdvantage,
University, Profiler,PIN
Parts ServicesReportingExcaliburUnit Config
.NET App Environment
XML Cannonicals
PRSPricing
Reference
PMGProduct Master
Armor Aware WMS
WWPACK
SBW
University
Web BasedExams
Training on theWeb
(Enrolement)
E-Testing(CAT)
ExternalCompanies
CA(Compaq Accreditation)
Accredited EngineerWeb Access
Exam UpdatesGeneral UserAccess
LearningUtility
ESB Learning
SAP ODS
WESInterface
(SIS)
GSEMInterface
(SIS)
RosettanetCase
Exchange
DocumentumMinimal KM
Management
ConcentraExtended KMManagement
OperationalData Store
HPCSManagment
ProvisionerXML Extract Heavy UI
SAW Portal
Light UI(xMeTaL)
SearchOffline Server
AnalyticsUI
Spider
Third PartyAcquisition
LegacySources
Legacy UIs
From OpenviewService Desk
CATSW - DeliveryLabor Tracking
EQUATEIC Bill ing
Business Intelligence -TBD
Project Management
Manual
Manual
From MPC
Serv
ice
Laye
r - M
essa
ging
Bac
kbon
e (E
IA) o
r ETL
(Inf
orm
atic
a)
Serv
ice
Laye
r - E
TL (I
nfor
mat
ica)
Serv
ice
Laye
r - E
TL (I
nfor
mat
ica)
iGSO BWFrom HPS SAP
WFM IMODSFrom WFM
OperationalMartsWFM-IMSmart
iGSO (BW)Part Page?
MPC
OdessaODS
Odessa DataSources:
3PL, Tabula, PIPE,etc
WW HPS WarehouseConstellation
StrategicMartsICEMANCalistoWMS
MagnetoAuroraSVR
ExcaliburERGOPSDM
iGSO Mgmt
Other DataSources:
Qspeak, ISEE,Oscar, Kahuna,
Passkey 2000 etc
Master Data: Customer,Product, Supplier, Organ isation,Geography, BOM, Employee,Chart of Accounts, Material
Event Repositories:Service Delivery, Orders &Contracts, Supply Chain, Finance,Engagement Mgmt, Sales &Market ing
ExcaliburExternal
WebReporting
Ad-HocReporting
Operation.Excellence
Tables
BalancedScorecard
Parts Service: CSN Global Business Services
PortableRepair EDI
SONICEDI
Orders / Shipments
VOYAGER/iHUB
XelusPlan / Extend
ProductionRequisitions
Inventory / Costs
UniversityOrdersGAP?
Financial Postings
Tech/Training Orders
Taxware
SAPAPO
PEPs E-Stores
Vendor EDIS-Plus
UPSLG (NA)
APO active but not usedfor Order Routing in Step 1
CWS /Keychain
To iGSO BW
PowerInterface
OrderSupportpackWeb Service
QuoteManagement
QuotePricing
SupportpackRegister Web
Service
Watson
ContractAdmin
QL
GSEM SDK
EIA
WFMClarify
WES InterfaceReference DataLoad (CDO)
IM Extract
University BulkLoad
Technician Info
Skillpack BulkLoad
ScoreHPS SAP "A"Future State
ACI/WTI
Prod DivEscalations
Paging(Case Update)
WFM Copy
Click Schedule
Case - WES+
PGUReferenceAuthoring
Call CenterAuthoring
Agent
eTouch
KM LightAuthoring
Parts Update
OpenView
- Service Level Mgmt- Help Desk Mgmt- Incident Mgmt- Configuration Mgmt- Change Mgmt- Problem Mgmt- Application Monitoring- EvSPlent Detection- Capacity Mgmt- Work Order Mgmt- Reporting- Network Fault Mgmt
To CATSW(Labor Tracking)
eVictor(Request Mgmt)
EASI, ATM, eVictor(Provisioning)
Ruleware(Process Guides,Escalation Mgmt)
JETRouting, Notification,
Work Force Mgmt
RadiaInformation Mgmt
Two-way HPCECase Exchange(WebMethods)
WFM ClientCall Center
Workflow Agent
CustomerSystemConnect
eMaileResponse Mgr
eMailDelano
WFM MobileClient
(Untethered)
WFM ICAClient (Citrix)
Citrix
CWAeSupport
KCSIntegration
CSNBusinessServices
Hotlinks
Entitlement
OM InterfacePer incident
quote
Credit Card(Corporate)
SageTo ServiceNotes ODS
ITRC
ConsumptionUpdates (5.0)GEMS
ProductDivision CHS's
To SAP &WWPack
Bulk Load
Bulk Load
SearchEngine
Analytics
Search UI
Onsite Agents
IntranetPortal
MobileFormats
ServiceNotes
Linkage
HPS SAPEnterprise
Instance "A"
FinanceFI/CO/SPLFuture:SCORE
HPFO SAPEnterprise
Instance "B"
ARAPGL
AP, AR, GL
AP, AR,AP/AR Clearing
Lighthouse GL
HPFO BusinessWarehouse
To SAPODS
EQUATEICO Audit Detail
From SalesSAP Systems
Hyperion
HPFOMaster Data
WWCLASS(Foreign Trade)
HarmonizedCodes
Sprint/007
iGSO CentralHPS SAP
EnterpriseInstance "A"
VISTAPSG "O"
IPG "N"
ESG "M"Sales SAPEnterprise
ARAPGL
HPS SAPEnterprise
Instance "A"
ContractsPartsPacksQuotes
Prophecy [email protected]
Siebel (+MS/C&I)Prophecy
(Sales Funnel)
DirectRegistration
SWATFinW
OMEGASales Comp
IPC
OM
SUMWISDOMIMAGING
Translation
Managed Services eDelivery
Ruleware(Customer
Data)
EMS(Escalation
Mgmt)
Openview(Portal)
JET(Notification)
Support Software, ePro,eCase, Instant Software
(eSupport Portal)
eProKnowledge
Telephone
UDDI
To SageToEntitlement
CDOQuoteObject
Subscribe
ServiceEntitlement
Contract &Quote Lookup
PackObject(CCP?)
PackObject(CCP?)
WarrantyRegistrations
?
CCDB overFAI Warranty Registrations
MS Resource Management
PeoplesoftHR
PORGY(HR Data andOrg Hierarchy
Practices)
Skillpack(Skil ls)
RMMP(Resource Market
Place)
To MPC IM DW
ED(EnpterpriseDirectory)
Consulting //PursuitKnowledge Managementt
Livelink(K-net and KMS)
SPS(Sharepoint Portal
Services)
STS(Sharepoint Team
Services)
Groove(External
Colloboration)
Procurement SAP "A"
VendorTransmission of POs
(Purchase Order)
DTT(Goods Receipt)
DTT(Goods
Movement)
MPC SAP EnterpriseInstance "A"
SD, MM,FI/CO/SPLPS, HR, CATSWCapture OrdersManage OrdersBill / InvoiceProcurementProcess Fin. Trans.Plan / Manage BudgetsManage Cash & LiquidityAnalyze & Report Results
Local DB(Oracle/Unix)
ContractManage
QuoteConfig
Novient(Resource
Management)
HR
ERGO(Consultant Effort
& HR)
Omega(MS Expenses)
MS Project(Small - MIddle
Projects)
Large Projects(TBD)
Sales Omega(Sales Comp)
CRO(Order
Recognition)
VCP(Credit
Management)
DDT(Italy only)
WISDOM(Bill ing Output
Imagiing)COPE/BETBids/Quotes
New Tax?(Worldwide Tax)
ESSEC(Foreign Trade)
Invoice Printing(Offline Printingand Distribution)
RPL(Restricted Parties
List)
FusionHP Products
WatsonHP Products
Config and Quote
Order
From MM
SWSCHPS SAP
EnterpriseInstance "C"
Labs, Mkt,Prod Groups
ISSW(EntitlementGenration)
FTP toShippers
GLiS
eRendezvous
SW Mastering
To HPFO
To CalistoIM
From PPC
SUM(Address Update)
OM
ContractCDO
Internal Portal
SLM(Ext Portal)
IOM/HPOM
GSOIAInterface
iGSOInterface
Central UNASTNT (EMEA)
iGSO CentralHPS SAP 4.6Instance "D"
ESSEC
WWClassFS-SPOC DSPS/
FS50I-COST/CCS/
GPSy
ORION
PPC RIFLESFT98
OMNI
Trade
EMEA Reference
RPL
Eiffel/Heart OREquate
Sub Financials
SAPHPFO
"Tsquared"Taxware
SRS
FinanceKahuna/
3D Comet/Tabular
Sokrates
Returns
HPS Application LandscapeFuture State 2005 - DRAFT
November 12, 2002
MPC ODS
SAPCOPA
WebReports
@IM PMMSPortal
Returns
Multi-domainThin Clients
OrchestrationSales [email protected]
PackCPP
ContractCDO
EventObject Price Product
ConsumptionUpdate
Pub/Sub
WarrantyRegist
SubscribePublish
PackObject(CCP?)
Elf-pack QL
PackObject(CCP?)
CREST
To WES+
PWA
17 November 2006 Utilification redux - Middleware 2006
Utilification: the processAssessment
18 November 2006 Utilification redux - Middleware 2006
Utilification: the processAssessment (aka blueprinting)
19 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS-based sizing
22 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS-based sizing• Requires mappings from: −offered load + QoS needs resource needs−offered load + resources predicted QoS needs
• This is hard!!−even for the single-element application
• typically lots of knobs and settings
−now add many moving parts• multiple control parameters, which interact
−now add operating in a new environment
23 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS-based sizing• Sample question: what’s the “QoS budget” for
each component?−How should a 100ms response-time be split between
two components?−What if the resource demands of these two alternatives
lead to very different costs? −What if the cheapest solution is the most susceptible to
mis-estimations of the load?
24 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS: resiliency• Maybe now is the time to increase this?−add redundancy and replication−add better predicting, detecting, recovering from failures
• How much application-level resiliency is needed?−availability (percentage uptime)− reliability (resistance to data loss or corruption)−performability (probability of achieving a given
performance level)
26 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS: security• Utility computing shared platform−across mutually-distrusting customers?−not on my watch!!
• How to write a security QoS specification?−probably not just: “time to apply virus patches”
• How to pick the right mechanisms?−predicted efficacy? cost? ROI?
27 November 2006 Utilification redux - Middleware 2006
Utilification: the processallocating/assigning resources
• what if there arecompeting needs?
• what if there arecompeting needs?
28 November 2006 Utilification redux - Middleware 2006
Utilification: the processtest + deploy
• automated• repeatable• on near-live data
• automated• repeatable• on near-live data
29 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS enforcement
start herestart here
30 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS enforcement
31 November 2006 Utilification redux - Middleware 2006
Utilification: the processQoS enforcement
expect control loopsto be nested!expect control loopsto be nested!
how do you specify these?how do you specify these?
32 November 2006 Utilification redux - Middleware 2006
Utilification: the processFlexing
33 November 2006 Utilification redux - Middleware 2006
Utilification: the processFlexing: scale out
• Add resources (servers, storage, …)−natural choice for “embarrassingly parallel” applications
• Reduce resources−how do you force the app to consume fewer resources?
34 November 2006 Utilification redux - Middleware 2006
UtilificationFlexing: scale up• necessary if application
can’t scale out
• Migrate application to faster system(s) −what if the app is still
running?−what if the target
configuration needs to be different?
35 November 2006 Utilification redux - Middleware 2006
Utilification: the processTrust• Requires belief in performance, resiliency, and
security properties + the systems that provide them− technical solutions exist: these are not the hard part
• Opportunity: methods to build trust −will the proposed design work? design audit−has the design been deployed? deployment audit−has the design been altered? runtime audit−was it adequate? runtime audit
36 November 2006 Utilification redux - Middleware 2006
Call to action: utilification needs you!• Utility computing is coming
• The process of getting there is harder than the end point
• Help make it possible!
2004version!
2004version!
What do I think now?
What do I think now?
much the same, only more so …
What’s changed?
SOA is becoming real
40 November 2006 Utilification redux - Middleware 2006
Source: Gartner's Hype Cycle Special Report for 2005,Aug 2005, ID Number: G00130115
What’s changed?SOA is becoming real By 2008, “SOA will provide the
basis for 80 percent of new development projects”
— S. Hayward, Positions 2005: Service-Oriented Architecture Adds Flexibility to Business Processes
Gartner, Inc. Feb. 2005.
By 2008, “SOA will provide the basis for 80 percent of new development projects”
— S. Hayward, Positions 2005: Service-Oriented Architecture Adds Flexibility to Business Processes
Gartner, Inc. Feb. 2005.
41 November 2006 Utilification redux - Middleware 2006
Utilification: the processdon’t stop at the “utility” stage
Servification
42 November 2006 Utilification redux - Middleware 2006
Utilification: the processturn applications into services
• Utilification allows resource sharing− flexibility in scale and placement−decisions about resource priorities and allocations
• Service equivalent− focuses on service/client relationships, not resources
43 November 2006 Utilification redux - Middleware 2006
Utilification: the processturn applications into services
• Software as a service (SaaS):− reuse, multiple customers,
asynchronous development, dynamic invocation, … ☺
• Running a service as a business (service provider)− forces decisions about service/client priorities and
allocationseconomy-based approaches
What’s changed?
IT economics are becoming more important
45 November 2006 Utilification redux - Middleware 2006
0
50
100
150
200
250
'02 '03 '04 '05 '06 '07 '08
Storage Servers Management and operations
IT spending: OPEX growing 3x faster than compute capacity spend
Tota
l spe
nd
$B
Sources: IDC, “On-Demand Enterprises and Utility Computing: A Current Market Assessment and Outlook,” July 2004; HP analysis.Storage spend includes storage management SW.
46 November 2006 Utilification redux - Middleware 2006
65%
10%
25%
Operations –managementand maintenance
Innovationand newfunctions
Migrationand
upgrades
IT spending: where does all the money go?
Only 10% of the IT budget is left for innovation
Only 10% of the IT budget is left for innovation
47 November 2006 Utilification redux - Middleware 2006
IT spending:hardware vs administrator costs
Total cost per terabyte of storage(source: IDC 2005)
48 November 2006 Utilification redux - Middleware 2006
IT spending:hardware vs administrator costs• Storage costs are
dropping−1995: ~$5000/GB raw−2005: $0.5/GB raw
• People costs are not:−2004–5 admin salary:
US$68k −growing ~0–6%/year
[SAGE-USA survey]
Total cost per terabyte of storage(source: IDC 2005)
50 November 2006 Utilification redux - Middleware 2006
IT spending:Solution: automation
For this to work:• we need to delegate authority
to the system• what do we want it to do?• what may it not do?
For this to work:• we need to delegate authority
to the system• what do we want it to do?• what may it not do?
What’s changed?
running IT like a business
53 November 2006 Utilification redux - Middleware 2006
Initiate
Running IT like a businessOptimizing the outcome of SOA
Providers
Build
Can other groups develop against my
services?
Operate
How do I manage changes without disrupting my consumers?
Will others see valuein my services?
CTO office
Can I establish a repeatable
implementation process?
Can I control services in
production?
Does the enterprise work on the right
services?
How do I develop/test against services out of my
control?
Do I get the expected quality of service?
Can I find and trustservices?
Consumers
SOA governance
Case studyTuscany:economy-based service-oriented computing
55 November 2006 Utilification redux - Middleware 2006
Tuscanykey ideas• Self-interested service providers
SOA + economic rewards to steer behavior
• Automated self-managementcost-effective, lights-out, agile operation
56 November 2006 Utilification redux - Middleware 2006
Physical-resource farmscontrol + management
CPU & storage nodesVLANspower cooling
Trust assurance
analysis
auditing
Job executionservice stack
cust. 2customer 1
Job-execution
run-batch
portal data transfer
Data mining
analysis techniques
customer A
portal data transfer
Data miningservice stack
DBMS servicescalable dbms
SOA economyCosimo bank
Tuscany ecosystem
Virtual-resource farmsXen/VMwareTycoon
57 November 2006 Utilification redux - Middleware 2006
Trust assurance
analysis
auditing
Physical-resource farmscontrol + management
CPU & storage nodesVLANspower cooling
Virtual-resource farmsXen/VMwareTycoon
Data mining
analysis techniques
portal data transfer
Job executionservice stack
cust. 2
Data miningservice stack
customer 1
DBMS servicescalable dbms
Job-execution
run-batch
portal data transfer
SOA economyCosimo bank
Tuscany ecosystemPrato: dbms-on-demand service
Customer A
58 November 2006 Utilification redux - Middleware 2006
Tuscany ecosystemPrato: dbms-on-demand service• a self-managing service provider
• that offers a dbms-on-demand service−2x capacity for 3 days!
• by providing each client with their ownvirtual dbms appliance−hiding the complexity of:
• setting up the service• managing the service (e.g., if it breaks)
59 November 2006 Utilification redux - Middleware 2006
Pratoresearch focus1. representing customer needs
• expressing what they need without dictating the solution
2. translating needs into implementation choices• automatically selecting between different designs
3. automating service provider management• lights-out self-management is the end goal
4. composing service providers• Prato is just one service provider: how does it integrate with
others?
60 November 2006 Utilification redux - Middleware 2006
Prato research focusautomatic QoS spec service design
QoS specification(request)for how longproblem scaleavailability, reliability, security
service resourcesavailable resourcesdesign choicescostsfailure rates
contract priceflorins/hr
designsystem configurationdata protection schemes
Prato designer
62 November 2006 Utilification redux - Middleware 2006
Recovery Point(go back to when?)
Designing data protectionAnatomy of a failure
updates
time
normal operation
100%
availability
time
operationcontinues
(e.g., at 2nd site)
0%outage
crash!
Recovery Time(duration of outage)
RPO = max allowedrecovery-point time (data loss) RTO = max
outage timeallowed
better idea: use penalty rates instead of hard bounds
better idea: use penalty rates instead of hard bounds
63 November 2006 Utilification redux - Middleware 2006
Prato research focusautomatic QoS spec service designClient specifies:• dbms size
− RAM (GB), disk (GB)− “in-memory”
high-performance
• outage and data-loss penalty rates− florins/hour
• contract start-date + duration− date, hours
• data-isolation breach penalty− florins/occurrence
Prato chooses:• capacity + speed
− number of nodes, amount of disk, amount of RAM
• data-protection approach− mirrored disk/dbms RAID-5− reload from remote/local copy− snapshot frequency− dedicated/hot spare nodes− cold/hot standby dbms
• contract price
• security-isolation approach− air-gap; VLANs− virtual machines; dbms-protection
64 November 2006 Utilification redux - Middleware 2006
Prato servicedesign driven by use cases
Prato Virtual filesystem
(WX2) DBMSInstance
Virtual DBMS-appliance
Contract pricing
Service manager
Design to spec.
Fault diagnosis
Fault recovery
Self management File system Nodes
Physical infrastructure
Cus
tom
erServiceprovider
Manager
Web service
Requestcontract
Web service
Uploaddata
DBA
ODBC
Query &report
Analyst
Web
ser
vice
Add
nod
es
Ope
rato
r
Web
ser
vice
Nod
eut
ilizat
ion
Man
ager
65 November 2006 Utilification redux - Middleware 2006
Prato servicehardware and software
Prato Virtual filesystem
(WX2) DBMSInstance
Virtual DBMS-appliance
Contract pricing
Service manager
Design to spec.
Fault diagnosis
Fault recovery
Self management File system Nodes
Physical infrastructure
Cus
tom
erServiceprovider
Manager
Web service
Requestcontract
Web service
Uploaddata
DBA
ODBC
Query &report
Analyst
Web
ser
vice
Add
nod
es
Ope
rato
r
Web
ser
vice
Nod
eut
ilizat
ion
Man
ager
66 November 2006 Utilification redux - Middleware 2006
Prato serviceDBMS = Kognitio WX2
Prato Virtual filesystem
(WX2) DBMSInstance
Virtual DBMS-appliance
Contract pricing
Service manager
Design to spec.
Fault diagnosis
Fault recovery
Self management File system Nodes
Physical infrastructure
Cus
tom
erServiceprovider
Manager
Web service
Requestcontract
Web service
Uploaddata
DBA
ODBC
Query &report
Analyst
Web
ser
vice
Add
nod
es
Ope
rato
r
Web
ser
vice
Nod
eut
ilizat
ion
Man
ager
67 November 2006 Utilification redux - Middleware 2006
Prato serviceEnigmatec EMS service manager
Prato Virtual filesystem
(WX2) DBMSInstance
Virtual DBMS-appliance
Contract pricing
Service manager
Design to spec.
Fault diagnosis
Fault recovery
Self management File system Nodes
Physical infrastructure
Cus
tom
erServiceprovider
Manager
Web service
Requestcontract
Web service
Uploaddata
DBA
ODBC
Query &report
Analyst
Web
ser
vice
Add
nod
es
Ope
rato
r
Web
ser
vice
Nod
eut
ilizat
ion
Man
ager
What’s changed?
need Quality of information (Qoi), not just Quality of Service (QoS)
69 November 2006 Utilification redux - Middleware 2006
Quality of informationIn-the-middle services
Information consumers
DiscoverTransform
Search/query
Index
CacheCorrelate
Presentation, views
CatalogAnalyze
Compose, aggregateInformation servicesTag
Broker
information-sourcemetadata(Qoi)
information-needsmetadata
Businessservices
Informationservices Applications
info
rmat
ion
flow
Information sources
End users
70 November 2006 Utilification redux - Middleware 2006
information-sourcemetadata(Qoi)
information-needsmetadata
Quality of informationIn-the-middle services
Information consumers
info
rmat
ion
flow
DiscoverTransform
Index
Correlate
Catalog
Information services
Broker
Businessservices
Informationservices Applications
Information sources
End users
Search/query
Cache
Presentation, views
Analyze
Compose, aggregateTag
71 November 2006 Utilification redux - Middleware 2006
Quality of informationKey observation
• QoS is great – but only addresses half the problem− is the service available? fast? cost-effective?
• Qoi = quality of information− is the information fresh? complete? accurate? clean?−what was its provenance? is it original?− is it believable? why?
key idea: ask for the Qoi you need …and get the information system to deliver it … automatically
72 November 2006 Utilification redux - Middleware 2006
Quality of informationA few research opportunities
• how to build the processing DAG?• how to express Qoi?−what metrics to use? how to measure them?− suppose you had the metrics – what would you do?
• how do processing steps affect Qoi?−can we predict their effects?−can we design processing DAGs to meet Qoi goals?
• how much Qoi is needed?−who decides? how?
© 2006 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice
Summary
74 November 2006 Utilification redux - Middleware 2006
Summary• Utilification + SOA: still a good idea!−but: many “opportunities” remain
• Trust, trust, trust−automation requires delegation−vital to understand what QoS is wanted−predictability, reassurance
• Going beyond QoS QoiThis is all middleware’s turf!