Upload
mongodb
View
544
Download
1
Embed Size (px)
Citation preview
© 2
015
Amad
eus I
T Gr
oup
SA
Better, Faster, Stronger! Migration to 3.0
Upgrade MongoDB in the enterprise environment
Attila Tozser, Amadeus Data Processing GmbH, MongoDB Days
Germany, 20/10/2015
© 2
015
Amad
eus I
T Gr
oup
SA
Amadeus IT Group1
Amadeus is a technology company dedicated to the global travel industry. We are present in 195 countries with a worldwide team of more than 13,200 people.
Our solutions help improve the business performance of travel agencies, corporations, airlines, airports, hotels, railways and more.
_ Introduction1Amadeus in a few words
© 2
015
Amad
eus I
T Gr
oup
SA
Our solutions facilitate journeys and enrich the travel experience for hundreds of millions of people every year.
to shape the future of travel
_ Introduction1
We are working together with our customers and partners
We have a clear purpose
© 2
015
Amad
eus I
T Gr
oup
SA
Page 6
A history of shaping the future of travel _ Amadeus history2
1987Amadeus is founded
1995World leader in number of travel agency locations
19981 MILLIONbookings made on a single day for the first time
2010Amadeus diversifiesinto IT for hotel, railand airport
1992First booking made through Amadeus
1996e-Commerce division launched
2000Partnership with BA and Qantas to launch Amadeus Altéa – our core Airline IT offering
2014Contracts with Ryanair and Southwest Airlinesand a strategic technology relationship with IHG
© 2
015
Amad
eus I
T Gr
oup
SA
Page 7
_ Amadeus today3Robust global operations
© 2
015
Amad
eus I
T Gr
oup
SA
1.6+billiondata requests processed per day
526milliontravel agencybookings processed in 2014
695millionPassengers Boarded (PBs) in 2014
95%of the world’s scheduled network airline seats
Page 8
Close to our customers
© 2
015
Amad
eus I
T Gr
oup
SA
Page 9
A global team of 13,200+ professionals
_ 118 nationalities_ Cultural diversity_ Clear focus on recruiting
and developing talent_ Values based culture
© 2
015
Amad
eus I
T Gr
oup
SA
MongoDB at Amadeus2
Page 11
Business needsGathered from customers
user-friendly way to query any datain our main operational databases_ Unpredictable ad-hoc search_ Many advanced reporting requirements
A way to store orders of magnitude more different data from various sources, but still maintain low latency
Sustain Organic growth of data and throughput (time-to-time 2X or more a year) without degradation
Page 12
Runs on standard x86 architecture
C++, Python & Java drivers
Enterprise-grade security_ SSL encryption_ Kerberos authentication_ Data-at-rest encryption
MongoDB is perfect match to our needs
IntegrationIn the Amadeus standards
© 2
015
Amad
eus I
T Gr
oup
SA
New features in MongoDB 3.02
© 2
015
Amad
eus I
T Gr
oup
SA
© 2
015
Amad
eus I
T Gr
oup
SA
WiredTiger our observations• Compression ratio 3x-10x• IO characteristic tunable
• Better latency• Enhanced security
In-memory our observations• On OOM instant crash
• Sustained 150K/4KB IOPSOn a single box• 1-6ms latency
© 2
015
Amad
eus I
T Gr
oup
SA
Upgrade MongoDB in the enterprise environment
2AmadeusClients
© 2
015
Amad
eus I
T Gr
oup
SA
AmadeusClients
© 2
015
Amad
eus I
T Gr
oup
SA
SS
S
S
S
S
Application servers MongoDB
© 2
015
Amad
eus I
T Gr
oup
SA
SS
S
S
S
S
This appserver consist of• Operating System• Application code• MongoDB driver• Mongos binary
Database sever:Operating SystemMongoDB binariesMisc. processes:
Ops manager agentsMonitoring codeAutomation code
© 2
015
Amad
eus I
T Gr
oup
SA
MongoDB Cluster
MMS/Ops Manager
_Always Sharded and replicated
_Over 10 test levels
_Monitoring_Backup_(automation)
Mongodb 3.0 needs Ops Manager > 1.6.0
© 2
015
Amad
eus I
T Gr
oup
SA
Upgrading MMS3
MMS application database
Backup Database
Backup Database
Backup Database
MMS App Server MMS App Server MMS App Server
Backup Daemon
Backup Daemon
Backup Daemon
Backup agents
Monitoring agents
Automation agents
Upgrade separately as any other MongoDB cluster3.0 only from MMS 1.6
The server processes contain the new versions
Should be on the same version: Upgrade together
© 2
015
Amad
eus I
T Gr
oup
SA
Upgrading MMS3MMS App Server
REST API
Corporate Monitoring
API callsMetrics
Corporate Automation
API callsConfig options
© 2
015
Amad
eus I
T Gr
oup
SA
SS
S
S
S
S
http://docs.mongodb.org/manual/release-notes/3.0-upgrade/
_Upgrade MongoDB_Be prepared for fallback funnies
_Backup, MONGODB-CR auth_Lucky case: Give a try to Ops Manager
automation_Less lucky case: Do it by hand
_Start from a 2.6 installation
© 2
015
Amad
eus I
T Gr
oup
SA
Upgrading MMS3
S
Upgrade the Mongos processes
Config 1 Config 2 Config 3
S, 3.xUpgrade cluster metadata
Upgrade all the mongos processes
Upgrade config
© 2
015
Amad
eus I
T Gr
oup
SA
3
PrimaryMMAP v1
2.6
SecondaryMMAP v1
2.6SecondaryMMAP v1
2.6
Upgrade the Shards
SecondaryWT 3.0
Install binaries
Install binaries
Install binaries
PrimaryWT 3.0
SecondaryWT 3.0
SecondaryMMAPv1
2.6Secondary
WT 3.0PrimaryWT 3.0
SecondaryWT 3.0
© 2
015
Amad
eus I
T Gr
oup
SA
Look into the future3MY MongoDB wishlist
_ Cross cluster replication _ Filtered / delayed / batched
_ Multimaster (AP operation)_ Multithreaded queries_ Transactions
_ On multi update
© 2
015
Amad
eus I
T Gr
oup
SA
Divider title here1Thank you!Questions?