26
Better, Faster, Stronger! Migration to 3.0 © 2015 Amadeus IT Group SA Upgrade MongoDB in the enterprise environment Attila Tozser, Amadeus Data Processing GmbH, MongoDB Days Germany, 20/10/2015

Better, Faster, Stronger! Migration to 3.0

  • Upload
    mongodb

  • View
    544

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Better, Faster, Stronger! Migration to 3.0

Upgrade MongoDB in the enterprise environment

Attila Tozser, Amadeus Data Processing GmbH, MongoDB Days

Germany, 20/10/2015

Page 2: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Amadeus IT Group1

Page 3: Better, Faster, Stronger! Migration to 3.0

Amadeus is a technology company dedicated to the global travel industry. We are present in 195 countries with a worldwide team of more than 13,200 people. 

Our solutions help improve the business performance of travel agencies, corporations, airlines, airports, hotels, railways and more.

_ Introduction1Amadeus in a few words

© 2

015

Amad

eus I

T Gr

oup

SA

Page 4: Better, Faster, Stronger! Migration to 3.0

Our solutions facilitate journeys and enrich the travel experience for hundreds of millions of people every year. 

to shape the future of travel 

_ Introduction1

We are working together with our customers and partners

We have a clear purpose

© 2

015

Amad

eus I

T Gr

oup

SA

Page 5: Better, Faster, Stronger! Migration to 3.0

Page 6

A history of shaping the future of travel _ Amadeus history2

1987Amadeus is founded

1995World leader in number of travel agency locations

19981 MILLIONbookings made on a single day for the first time

2010Amadeus diversifiesinto IT for hotel, railand airport

1992First booking made through Amadeus

1996e-Commerce division launched

2000Partnership with BA and Qantas to launch Amadeus Altéa – our core Airline IT offering

2014Contracts with Ryanair and Southwest Airlinesand a strategic technology relationship with IHG

© 2

015

Amad

eus I

T Gr

oup

SA

Page 6: Better, Faster, Stronger! Migration to 3.0

Page 7

_ Amadeus today3Robust global operations

© 2

015

Amad

eus I

T Gr

oup

SA

1.6+billiondata requests processed per day

526milliontravel agencybookings processed in 2014

695millionPassengers Boarded (PBs) in 2014

95%of the world’s scheduled network airline seats

Page 7: Better, Faster, Stronger! Migration to 3.0

Page 8

Close to our customers

© 2

015

Amad

eus I

T Gr

oup

SA

Page 8: Better, Faster, Stronger! Migration to 3.0

Page 9

A global team of 13,200+ professionals

_ 118 nationalities_ Cultural diversity_ Clear focus on recruiting

and developing talent_ Values based culture

Page 9: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

MongoDB at Amadeus2

Page 10: Better, Faster, Stronger! Migration to 3.0

Page 11

Business needsGathered from customers

user-friendly way to query any datain our main operational databases_ Unpredictable ad-hoc search_ Many advanced reporting requirements

A way to store orders of magnitude more different data from various sources, but still maintain low latency

Sustain Organic growth of data and throughput (time-to-time 2X or more a year) without degradation

Page 11: Better, Faster, Stronger! Migration to 3.0

Page 12

Runs on standard x86 architecture

C++, Python & Java drivers

Enterprise-grade security_ SSL encryption_ Kerberos authentication_ Data-at-rest encryption

MongoDB is perfect match to our needs

IntegrationIn the Amadeus standards

Page 12: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

New features in MongoDB 3.02

Page 13: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Page 14: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

WiredTiger our observations• Compression ratio 3x-10x• IO characteristic tunable

• Better latency• Enhanced security

In-memory our observations• On OOM instant crash

• Sustained 150K/4KB IOPSOn a single box• 1-6ms latency

Page 15: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrade MongoDB in the enterprise environment

2AmadeusClients

Page 16: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

AmadeusClients

Page 17: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

SS

S

S

S

S

Application servers MongoDB

Page 18: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

SS

S

S

S

S

This appserver consist of• Operating System• Application code• MongoDB driver• Mongos binary

Database sever:Operating SystemMongoDB binariesMisc. processes:

Ops manager agentsMonitoring codeAutomation code

Page 19: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

MongoDB Cluster

MMS/Ops Manager

_Always Sharded and replicated

_Over 10 test levels

_Monitoring_Backup_(automation)

Mongodb 3.0 needs Ops Manager > 1.6.0

Page 20: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrading MMS3

MMS application database

Backup Database

Backup Database

Backup Database

MMS App Server MMS App Server MMS App Server

Backup Daemon

Backup Daemon

Backup Daemon

Backup agents

Monitoring agents

Automation agents

Upgrade separately as any other MongoDB cluster3.0 only from MMS 1.6

The server processes contain the new versions

Should be on the same version: Upgrade together

Page 21: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrading MMS3MMS App Server

REST API

Corporate Monitoring

API callsMetrics

Corporate Automation

API callsConfig options

Page 22: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

SS

S

S

S

S

http://docs.mongodb.org/manual/release-notes/3.0-upgrade/

_Upgrade MongoDB_Be prepared for fallback funnies

_Backup, MONGODB-CR auth_Lucky case: Give a try to Ops Manager

automation_Less lucky case: Do it by hand

_Start from a 2.6 installation

Page 23: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrading MMS3

S

Upgrade the Mongos processes

Config 1 Config 2 Config 3

S, 3.xUpgrade cluster metadata

Upgrade all the mongos processes

Upgrade config

Page 24: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

3

PrimaryMMAP v1

2.6

SecondaryMMAP v1

2.6SecondaryMMAP v1

2.6

Upgrade the Shards

SecondaryWT 3.0

Install binaries

Install binaries

Install binaries

PrimaryWT 3.0

SecondaryWT 3.0

SecondaryMMAPv1

2.6Secondary

WT 3.0PrimaryWT 3.0

SecondaryWT 3.0

Page 25: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Look into the future3MY MongoDB wishlist

_ Cross cluster replication _ Filtered / delayed / batched

_ Multimaster (AP operation)_ Multithreaded queries_ Transactions

_ On multi update

Page 26: Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Divider title here1Thank you!Questions?