12
Neal Sample VP Architecture, Platform Products, Developers Program

Openstack and eBay

Embed Size (px)

Citation preview

Page 1: Openstack and eBay

Neal SampleVP Architecture, Platform Products, Developers Program

Page 2: Openstack and eBay

eBay’s global commerce platform

Page 3: Openstack and eBay

eBay marketplace = economy of scale

200200M live listings9494M active users

99 Petabytes of data storage22B page views/day

7575B database calls/day6,0006,000 application servers

$62$62B 2010 gross merchandise volume2323M lines of code

Commercial data warehouse 100x larger than Library of Congress

Page 4: Openstack and eBay

Excess Capacity

Cloud bursting: ↓ costs by ↑ efficiency

Current Traffic

Datacenter efficiency

Energy-proportional computing

Timeline

text text text text text text text text

Fixed Cost

Req

uest

for

Dat

a

2000

1800

1600

1400

1200

1000

800

600

400

200

0

IdealRemove the peaks

Cloud Burst

Page 5: Openstack and eBay

TIER IV TIER II2(N+1) N+1

Datacenter efficiency

• Blend of Tier IV & Tier II– Minimum 30% reduction in OpEx cost per MW enables cost effective operations/expansion.– 50% reduction in CapEx for new lower-tier datacenters (Tier IV vs. Tier II)

• Burst Capacity (DC and Cloud)

Datacenter tier = level of redundancy

Page 6: Openstack and eBay

Energy-proportional computing

Meta Scheduler

Traffic

SLAModels

BMS metrics

Utilization (headroom)Availability

SLC PHX (Tier 4) PHX (Tier2)

Cloud Bursting

Direct traffic to the most economical location / optimize placement within DC

KWh cost / incentives / forecasts

Page 7: Openstack and eBay

Evaluate tradeoffs by varying size of internal cloud, and costs

Sum cost over period

HW/SW lease, networking, space, power, laborPredict future costs trends

Negotiated price with public cloud vendor

Hourly cost of CUin external cloud

Hourly total costHourly cost of CU in internal cloud

Financial model structure

Hourly CUs neededin external cloud

Based on server inventoryand growth forecast

Number of CU in internal cloud

Hourly computing units (CU) required

Define a standard CU

Max TPS per CU

Historical (from ODW) or predicted

Hourly demand(in average TPS)

Evaluate tradeoffs by varying size of internal cloud, and costs

Sum cost over period

HW/SW lease, networking, space, power, laborPredict future costs trends

Negotiated price with public cloud vendor

Hourly cost of CUin external cloud

Hourly total costHourly cost of CU in internal cloud

Hourly CUs neededin external cloud

Based on server inventoryand growth forecast

Number of CU in internal cloud

Hourly computing units (CU) required

Define a standard CU

Max TPS per CU

Historical (from ODW) or predicted

Hourly demand(in average TPS)

Page 8: Openstack and eBay

Cost components

Fixed, $0.88

Power, $0.03

Leases, $0.08

Networking, $0.04 Licenses, $0.04Datacenter

People

Total cost per CU/h : $1.07

Page 9: Openstack and eBay

TSP ↑ = more attractive options for cloud bursts

All self operated CUs

Load served by external cloud

CU decreasing byLease expiration

Historical TPS hourly data from ODW

TPS and FE Compute Units (CU) 24-Month Projects

Load served by self operated CU

Page 10: Openstack and eBay

Cost-benefit analysis

Cloud cost ($/hour)

0.5

0.81

1.11.21.5

234

DC CUs Impact on Project Annual Cost 9/2010 – 8/2011DC CU Hr Cost = 1.07, 30 TPS per CU

DC CUs

To

tal

Co

st (

$)

0 2000 4000 6000 8000

20,0

00,0

0040

,000

,000

60,0

00,0

00

0 DCs$20M

0 DCs$30M

3K DCs$40M

3.5K DCs$45M

4K DCs$47M

4.8K DCs$52M

5K DCs$55M

Page 11: Openstack and eBay

Business Intelligence

Focus for the future

LowerCost

• Commerce expertise

• Customer experience

• Reliability

• Security

• Etc.

Business Intelligence

Increased Focus

Infrastructureas CommodityInfrastructureas Commodity

Page 12: Openstack and eBay

Financial Cost Model for the Hybrid Cloud