45
1 © 2014 EnterpriseDB Corporation. All rights reserved. Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL Brian Berryman, Principal Sales Engineer, Enterprise DB Tony Tomarchio, Director of Field Engineering, SIOS Technology Corp.

Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Embed Size (px)

DESCRIPTION

Learn how to optimize and deliver enterprise class high availability protection for Postgres environments.

Citation preview

Page 1: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

1© 2014 EnterpriseDB Corporation. All rights reserved.

Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQLBrian Berryman, Principal Sales Engineer, Enterprise DBTony Tomarchio, Director of Field Engineering, SIOS Technology Corp.

Page 2: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

2© 2014 EnterpriseDB Corporation. All rights reserved.

• Introductions− Brian Berryman, Principal Sales Engineer, Enterprise DB

− Tony Tomarchio, Director of Field Engineering, SIOS

• EnterpriseDB: The Need for a Better Way

• SIOS: Cost Saving High Availability Protection for Postgres and PostgreSQL

• Demo SIOS Protection Suite for Linux

• Conclusion

Agenda

Page 3: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

3© 2014 EnterpriseDB Corporation. All rights reserved.

• Evolution of today’s new enterprise data infrastructure model

• Workloads best suited for introducing Postgres into your environment

− Key advances in recent Postgres releases that support new data types and evolving data challenges

• Success milestones for evaluating the ‘when and how’ of expanding Postgres deployments

• The implementation process

• Optimizing cost savings and high availability protection for Postgres and PostgreSQL

• Configuration flexibility, easy HA and DR with SIOS Clusters Your Way

• Demonstration of SIOS Protection Suite software

Webcast Objectives

Page 4: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

© 2013 EDB All rights reserved 8.1. 4

The Need For a Better Way

Page 5: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

5© 2014 EnterpriseDB Corporation. All rights reserved.

Strategic IT Budget Problem

5

EDB reduces your DBMS costs by 80% or more enabling you toinvest in emerging

technologies

5© 2014 EnterpriseDB Corporation. All rights reserved.

UP TO

35%

DBMS Maintenanceand Fees

of software budgets are spent on Database Management Systems:

BIG DATA

CLOUD COMPUTING

Page 6: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

6© 2014 EnterpriseDB Corporation. All rights reserved.

OPERATING SYSTEM

Open Source Use Evolving

Time

Sav

ing

s

Largest Savings PotentialMany companies have adopted OSS

for other layers of their software stacks. The rewards for database are even greater.

TODAY

MIDDLEWARE DATABASE

Page 7: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

7© 2014 EnterpriseDB Corporation. All rights reserved.

Postgres’ GrowthDB-Engines Ranking, December 2013

We congratulate MongoDB, PostgreSQL and Cassandra for their extraordinary achievements in 2013….The fact that we have three open source tools and two NoSQL systems amongst the winners may be an indication of what 2014 has in store for us.

Page 8: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

8© 2014 EnterpriseDB Corporation. All rights reserved.

Postgres: A Proven Track Record• Most mature open source DBMS technology

• Enterprise-class features (built like Oracle, DB2, SQL Server)

• Strong, independent community driving rapid innovation

8

Fully ACID Compliant

MVCC

Point in Time Recovery (PITR)

Data and Index Partitioning

Bitmap Indexes

ANSI Constraints

Triggers & Stored Functions

Views & Data Types

Nested Transactions

Online Backup

Online Reorganization

Foreign Keys

Streaming Replication

Multi-Core Support

JSON support

Page 9: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

9© 2014 EnterpriseDB Corporation. All rights reserved.

• Object Relational Database features from the 90’s

• XML storage capabilities at the turn of the century

• NoSQL & Non-standard SQL features:− JSON

− Nondurable storage

− Hstore

− PLV8

− Full Text Indexing

• Foreign Data Wrappers

• PPAS Connector for Hadoop

• Oracle database compatibility

Evolution and Growth of Postgres

Page 10: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

10© 2014 EnterpriseDB Corporation. All rights reserved.

Market Forces Influence Direction

Easy to Use/DeployHigh-end Enterprise

Requirements

PostgreSQL is growing from the “middle out”

New Workloads/Platforms (Big Data & Cloud)

Page 11: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

11© 2014 EnterpriseDB Corporation. All rights reserved.

Postgres’ Future

• Diagnosing Problems

• Configuring for success

• Still easier installs

• Tighter integration with frameworks

• Integration with other data stores

• Very simple in the cloud

• Vertical Scale (parallel query)

• Horizontal Scale

• Performance Diagnostics

• Incremental Backup

• Integration with other data stores

• Zero down time upgrades

• Liasons with other communities

• FDW for common no-SQL DBs

• Continues to evolve new data types: JSON, XML, Hstore

Easy to use/DeployHigh-end Enterprise

Requirements

New Workloads/Platforms (Big Data & Cloud)

Page 12: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

13© 2014 EnterpriseDB Corporation. All rights reserved.

How To Contain Costs

Complementary Coexistence:• NEW apps on Postgres

• Move easy-to-migrate existing apps

• Reassign other licenses to support HW upgrades and core apps

Reduced Cost & Increased Control:•Avoid additional license costs

•Reduce dependencies on vendors

•Improve negotiating leverage

•Lower costs over time

EXISTING apps

NEW apps

Y1 Y2 Y3 Y4

Hardware Upgrades

License Creep:

• Expansion of existing applications

• Hardware upgrades

• New applications

Page 13: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

14© 2014 EnterpriseDB Corporation. All rights reserved.

Postgres Plus Deployment Strategies

Strategy Benefits

Develop/DeployNew LOB Applications

• Significant cost savings for non mission critical systems

• Leverages all existing Oracle skills• Very low risk

Deploy Postgres Plus

as Oracle Replication Server

• Significant cost savings• Leverages Postgres Plus Replication Server• Leverages all existing Oracle skills• Improves transaction and query performance

Develop/Move Workloads to the Cloud

• Exponential TCO savings from hardware and software infrastructure

• Increased flexibility to move between physical, virtual and cloud database services

• Reduces DBA resource needs

Migrate/Rewrite non Mission Critical Oracle Apps to Postgres

Plus

• Significant cost savings• Leverages all existing Oracle skills• Very low risk

Migrate/Rewrite Mission Critical Oracle Apps to

Postgres Plus

• Biggest cost savings• Leverages all existing Oracle skills• Greatest deployment flexibility

Page 14: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

15© 2014 EnterpriseDB Corporation. All rights reserved.

EASY

• Private instances Not shared

• Set your own scale-out and backup parameters

• Access to set your own tuning configurations

MAXIMUM CONTROL

• Run PostgreSQL or Postgres Plus

• Same DB in Cloud as in Data Center - Portability between environments

• AWS, OpenStack, CloudStack or bare metal environments

PORTABILITY

© 2014 EnterpriseDB Corporation. All rights reserved. 15

CLOUD DATABASE

POSTGRES

PLUS Enterprise Control

& Portability

Page 15: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

16© 2014 EnterpriseDB Corporation. All rights reserved.

Postgres Fit Matrix (New and Existing)

Single Department Multi-Department/Enterprise

Mission Critical Standard Mission Critical Standard

99.99%+ availability; geographic failover

<1 TB; < 100 concurrent users

99%+ availability

99.99%+ availability; geographic failover

> 1 TB; highly integrated; > 1000 concurrent users

99%+ availability

OLTP

Web Apps

ODS

Archiving

Reporting

DWH

Data Mart

COTS

Best Fit Good Fit Emerging

Page 16: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

17© 2014 EnterpriseDB Corporation. All rights reserved.

Applications Built on Postgres

Page 17: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

18© 2014 EnterpriseDB Corporation. All rights reserved.

Synchronized with and contributing to the PostgreSQL community

Enterprise Leverage of Open Source

Page 18: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

© 2013 EDB All rights reserved 8.1. 19

Case Study: Staggering Cost Savings

Fantastic ROI when you move to Postgres

Source: TCO/ROI Analysis with ROI Analyst from Alinean, Inc.Source: TCO/ROI Analysis with ROI Analyst from Alinean, Inc.

Oracle vs. Postgres Plus Advanced Server

• $1,706,673 of 3-year cumulative benefits by moving to EnterpriseDB PPAS on HP Integrity BL890c server blades

• Return on investment of 271%

• Internal rate of return of 101%

• Payback period of 12 months

Page 19: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

20© 2014 EnterpriseDB Corporation. All rights reserved.

EDB Enterprise Enablement

• Agile enablement cycles are repeated with manageable groups of applications and databases

• Business metrics are continuously measured and priorities reassessed

Agile Enablement

Discover

Plan

Develop

• Inventory all DB’s

• Group apps into logical

& manageable sets

• Assess in-house skill levels

• Create multi-year transformational road map

• Assemble cross-functional teams

• ID license options & cost savings potential

• Existing: • Migration Assessment testing• Prioritization, scheduling, execution

• Architectural assistance

• Infrastructure DBA services

• Developer subscriptions

• Migration Factory assistance

• EDB professional services

• New: • ROI Validation• Performance design

• Ongoing support

• Remote DBA

• Training & certification

• Cloud DBMS

OperateLearn• Postgres & EDBcapabilities

• Best practices

• Business caseparameters

Re

so

urc

eC

om

mitm

en

t

Checkpoint

Page 20: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

21© 2014 EnterpriseDB Corporation. All rights reserved.

Assessing Ease of Migration

21

Oracle

1. Analyze Oracle schema layout for supported features in PPAS

2. Review features used in Oracle client application

3. Supported features and recommended fixes

Difficult Easy

4. Overall composite score and migration plan with workarounds and time estimates

Page 21: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

22© 2014 EnterpriseDB Corporation. All rights reserved.

Organizations that migrated Oracle-based applications to Postgres Plus Advanced Server stated the degree to which they had to modify these

applications.

Source: TechValidate

Survey: Ease of Migration

51% had slight to no modifications

Page 22: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

23© 2014 EnterpriseDB Corporation. All rights reserved.

71% of surveyed organizations using Postgres Plus Advanced Server identified the ability to use existing Oracle DBA skills as having the greatest impact on the productivity of their DBA team.Source: TechValidate Survey

Survey: Reuse Oracle DBA Skills

Page 23: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

24© 2014 EnterpriseDB Corporation. All rights reserved.24

Security• Fine Grained Audit Logging• Row Level Security (VPD)• SQL Injection attack guard• Server-side code protection• EAL2 certification

Bundled Tools• Oracle, SQL Server &

PostgreSQL to Postgres Plus replication

• Enterprise management, monitoring and tuning

• Oracle, SQL Server & MySQL to Postgres Plus Migration ToolsOracle Compatibility

• Faster, easier migrations• PL/SQL, OCI support• Oracle SQL extensions• User defined objects• Function packages• Database links• Oracle-like tools:

EDB*Loader, EDB*Plus, EDB*Wrap

Performance• Faster Partitioning

- 400x faster writes - 76x faster selects

• SQL Profiler – fix slow workloads

• Bulk Data Loader - 2x faster• Index Advisor - speeds up

inquiries• Query Hints - optimizer control• DynaTune - memory upgrades• Bulk Collect/Fetch/Binding of

arrays• Dynamic runtime statistics

reveals SQL wait bottlenecks

ADVANCED SERVERPOSTGRES PLUS

Page 24: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

25© 2014 EnterpriseDB Corporation. All rights reserved.

New Gartner ODBMS Magic Quadrant

Gartner Comments:

•Community leadership — EnterpriseDB is the primary contributor to the PostgreSQL community and is responsible for many new features of PostgreSQL, including JSON.

•Functionality — The functionality of EnterpriseDB's Postgres Plus has increased greatly, and with the Oracle Compatibility Feature is now more than sufficient to run both mission-critical and non-mission-critical applications.

•Stability and compatibility — References specifically call out compatibility with Oracle, the stability of the DBMS and product support as strengths.

Page 25: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

26© 2014 EnterpriseDB Corporation. All rights reserved.

Postgres Plus Advanced Server Postgres Plus

Cloud Database

High AvailabilityPerformanceManagement

REMOTEDBA 24x7

SUPPORTPROFESSIONAL

SERVICES

TRAINING

EDB Serves All Your Postgres Needs

PostgreSQL

Security

Page 26: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

27© 2014 EnterpriseDB Corporation. All rights reserved.

POSTGRESinnovation

ENTERPRISE reliability

24/7 support

Services & training

Enterprise-class features & tools

Indemnification

Product road-map

Control

Thousands of developers

Fast development

cycles

Low cost

No vendor lock-in

Advanced features

Get The Best Of Both Worlds

Page 27: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright 2014 SIOS Technology Corp. All rights reserved.

Clusters Your Way.™

Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Tony Tomarchio, Director of Field Engineering,

SIOS Technology Corp.

Page 28: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

Founded in 1999 Headquartered in San Mateo, CA Worldwide presence with offices across US, UK and Japan SIOS Protection Suite™ and SIOS DataKeeper ™ family of software

products 50,000+ licenses installed globally

Leading Technology Partners

About SIOS

29

Page 29: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright 2014 SIOS Technology Corp. All rights reserved.

Easy, Cost Efficient HA and DR for PostgreSQL

30

Page 30: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright 2014 SIOS Technology Corp. All rights reserved.

More applications are

mission-critical PostgreSQL central to key

business operations No tolerance for downtime

How much does downtime

cost your business?

The Cost of Downtime

Business Operation

Cost/Hr. of Downtime

Brokerage $6.45 M

Credit Card / Sales Authorization

$2.6 M

Home Catalog Sales $90 K

Airline Ticketing $89.5 K

Tele-Ticketing Sales $69 K

Package Shipping $28 K

ATM Fees $ 14.5 K

31

Page 31: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright ©2014 SIOS Technology Corp. All rights reserved.

Unparalleled Flexibility:

Platform – Linux and Windows

Storage – Shared Storage, NAS, iSCSI, Data Replication

Single and/or Multi-Site protection

Deployment – Physical-to-Physical (P2P), Physical-to-Virtual (P2V) and Virtual-to-Virtual (V2V) clusters

Application Aware: Built-in availability for 30+ key applications out-of-the-box (PostgreSQL, etc).

Supports Enterprise Linux distributions

i.e., Red Hat Enterprise Linux (RHEL) SuSE Linux Enterprise Server (SLES); Oracle Linux; CentOS;

SIOS SAN and #SANLess Software Products

32

Page 32: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

Monitors the health of the entire application environment:

Servers, storage, operating system, network, database, and application software.

Recover a service or application locally or on another cluster node at the same site or another location.

Accommodates a wide range of storage architectures

Provides cascading and prioritized failover of services

SIOS Protection Suite Clustering Software

APPSIOS #SANLess cluster

SAN Based Cluster

APP

FAILOVER

33

Page 33: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

SIOS Protection Suite for Linux

Features Benefits of SIOS Protection Suite

Deployment Options

2 to 32 nodes, cascading/ prioritized failover, n-to-1, 1-to-n, physical and virtual

Storage Support for Fibre Channel SAN, iSCSI, NAS or Host-based Replication,

IO Fencing Ensure data integrity when using Shared Storage with SCSI reservations. No need for external STONITH devices.

Monitor Status of protected servers, communication paths, resources and applications via the GUI, CLI or SMTP / SNMP alerts.

Consistent Architecture

Supports rolling and in-place upgrades. Leverage existing servers, storage and networking

34

Page 34: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

Out of the Box Linux Protection

Services

• SAP• WebSphere MQ• Any Custom App

Applications• Apache• Samba• NFS• LVM• SW Raid (md)

Databases Storage

• PostgreSQL• Oracle• MySQL• Sybase• DB2

• DMMP• NAS• EMC PowerPath• Hitachi HDLM• IBM SDD• Data Replication

High Availability

35

Page 35: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright 2014 SIOS Technology Corp. All rights reserved.

SIOS DataKeeper Data ReplicationFeatures Benefits of SIOS DataKeeper Replication

Fast, Efficient Replication

• Host-based data replication with existing LAN/WAN• Block-Level, volume/LUN replication• Very low overhead – only replicates changes• Prevents full re-syncs via Intent Logging and bitmap

support

Flexible Configuration

• Synchronous & Asynchronous• Multi-target replication

Bandwidth Optimized

• Bandwidth throttling and 9 levels of compression

• Uses available bandwidth without hardware accelerators/devices

Automated • Automatic reversal of source/target during failover

36

Page 36: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

User Friendly InterfaceMonitor and administer

clusters via a single, intuitive

interfaceWizard-based setupJava-based UI

Run as an application

or browser based applet Command Line Interface

(CLI) and SDK for integration

and extension

Easy to Deploy and Use

37

Page 37: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

Local storage acts like a SAN Real time, block level replication synchronizes

local storage on primary and standby nodes

Cost savings No costly SAN. No single point of failure risk

Configuration flexibility Protects physical, virtual, cloud, and high

performance storage environments

Easy to use. Easy to own.

SIOS #SANLess cluster solution

38

SIOS #SANLess cluster

Page 38: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

The Customer:Software-as-a-Service (SaaS) Platform supporting Web-centric

reservation services for leading airlines, hotels, car rental agencies

The Environment:Custom platform based on the PostgreSQL open source

database management system to support its services. Separate databases for each client process with thousands of

transactions per dayRuns on Dell servers - 8 node cluster with EMC Shared Storage

(using PowerPath)

Customer Case Study

39

Page 39: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

The ChallengeNeeded an affordable, easy-to-use way to

maintain high availability

The ResultsEase of installation- fully protected

environment within one day>99.95% uptime over 2.5 yearsIdentified a crucial issue that risked global

outage; performed failover with no downtime

Customer Case Study (Cont.)

40

Page 40: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

Live Demo

41

SIOS Protection Suite for Linux

Page 41: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

Demonstration:PostgreSQL HA using SIOS Protection Suite

42

Page 42: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

High Performance Storage

Clusters Your Way.™

43

Physical Servers

Cloud

Hybrid Cloud

Virtual Servers

Multisite Environments

APP

FAILOVER

FAILOVER

REPLICATION

Physical Servers

APP

FAILOVER

Hybrid Storage

APP

FAILOVER

FAILOVER

REPLICATION

FAILOVER

Extending Clusters for DR

SAN and SANLess and any combination of physical, virtual and cloud.

Page 43: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

Clusters Your Way.™

Copyright © 2014 SIOS Technology Corp. All rights reserved.

Easy to use. Easy to own.Easy setup and maintenanceSmaller footprint

Advanced Monitoring of the Entire Application EnvironmentApplication, Database, Network,

Adds FlexibilityProtects mission-critical workloads

The SIOS Cluster Advantage

44

SIOS, SIOS Technology, SIOS DataKeeper and SIOS Protection Suite and associated logos are registered trademarks or trademarks of SIOS Technology Corp. and/or its affiliates in the United States and/or other countries. All other trademarks are the property of their respective owners.

Page 44: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

45© 2014 EnterpriseDB Corporation. All rights reserved.

About SIOS Clusters Your Way™?

www.us.sios.com

Toll Free (US): 866.381.0108

Main : (US )+1.650.645.7000

Email: [email protected]

Twitter: @SIOSTech

Ready to Learn More. . .

About EnterpriseDB for Postgres?

www.enterprisedbcom

Main: (US) +1 781.357.3390

Email:

[email protected]

Twitter: @EnterpriseDB

Page 45: Optimizing Cost Savings and High Availability Protection for Postgres and PostgreSQL

46© 2014 EnterpriseDB Corporation. All rights reserved.