25
Exploring The Technologies Behind Big Data Week Twitter :: @nosqlasia Hash-Tags :: #bdw13 #nosqlkl Facebook :: http://facebook.com/groups/nosqlkl

1st NoSQL Asia Event in Malaysia

Embed Size (px)

DESCRIPTION

For more information, please visit - http://nosqlasia.org/blog/nosql-kl-01

Citation preview

Page 1: 1st NoSQL Asia Event in Malaysia

Exploring The Technologies Behind Big Data Week

Twitter :: @nosqlasia

Hash-Tags :: #bdw13 #nosqlkl

Facebook :: http://facebook.com/groups/nosqlkl

Page 2: 1st NoSQL Asia Event in Malaysia

NoSQL Asia Sponsors

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

http://nosqlasia.org/sponsors

Page 3: 1st NoSQL Asia Event in Malaysia

What is NoSQL Asia …?

Mission Statement: It is the mission of NoSQLasia.org to provide free access to NoSQL news, event placement, product announcements and service promotion for individuals, companies and organizations throughout South East Asia Manifesto: http://nosqlasia.org/blog/nosql-asia-manifesto

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 4: 1st NoSQL Asia Event in Malaysia

Why me …?

• Been living in Asia for over 15 years

• Early adopter / evangelist for MongoDB

• Established network of industry contacts

• Experience running meet-ups / events

• Experience presenting on stage

• Enjoy sharing knowledge with others

• Fanatical about OpenSource standards

• Truly believe life is sweet beyond SQL

• Tirath convinced me to do it !!!

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 5: 1st NoSQL Asia Event in Malaysia

Big Data Week :: Malaysian Partners

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

http://bigdataweek.com/kualalumpur

Page 6: 1st NoSQL Asia Event in Malaysia

Big Data Week :: Final Event Tomorrow @ 2pm

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

http://www.amiando.com/bdw_kl_dj.html

Page 7: 1st NoSQL Asia Event in Malaysia

Big Data :: Takes More Than a Week

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

http://facebook.com/groups/bigdatamy

Created by:

Page 8: 1st NoSQL Asia Event in Malaysia

How Big is Big …? -- According to IBM :: 90% of the World’s Data Created in The Last 2 Years --

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 9: 1st NoSQL Asia Event in Malaysia

What is NoSQL …?

Page 10: 1st NoSQL Asia Event in Malaysia

History Lessons

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

A LONG TIME AGO (1974) IN A GALAXY FAR, FAR AWAY ( the relational database was born )

Page 11: 1st NoSQL Asia Event in Malaysia

Building Reports = Good

Impedance Mismatch = Bad

• Before needing multiple servers, there was

the relational database …

• This model is still good for reports, though

often leads to impedance mismatch …

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 12: 1st NoSQL Asia Event in Malaysia

Then Came Web Apps

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 13: 1st NoSQL Asia Event in Malaysia

Research Papers & Hash-Tags

• Google developed and discussed BigTable

• Amazon developed and discussed DynamoDB

• This inspired a new generation of solutions

• Those developing these solution started a meet-up and needed a hash-tag

• MongoDB, CouchDB, Cassandra all at that same meet-up and someone picked #nosql

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 14: 1st NoSQL Asia Event in Malaysia

Defining NoSQL with Characteristics

• Non-Relational and OpenSource

-- OR –

• Cluster-Friendly and Schemaless

-- AND –

• 21st Century Hipster Qualities

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 15: 1st NoSQL Asia Event in Malaysia

Alternative Data Model Families

• Key Value Stores (simplicity) Riak, Redis

• Documents (rapid development) MongoDB, CouchDB, RavenDB

------------------------------------------------------------------------

• Column (inline indexing) Cassandra, HBase

• Graphs (persistent relationships) Neo4j, Titan

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 16: 1st NoSQL Asia Event in Malaysia

What about Aggregate Orientated models…?

• Key Values act as Documents with Meta Data

• Documents act as Key Values with IDs

• Both of these (and columns) aggregate data

• But what about relationships and natural joins?

• New wave of module database (ArangoDB / OrientDB)

• Time-series databases such as KairosDB

• More importantly, where does HyperDex fit in?

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 17: 1st NoSQL Asia Event in Malaysia

Then Came Trolls

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 18: 1st NoSQL Asia Event in Malaysia

Definitely Maybe Acidic

• Consistency comes in many forms (logic and replication)

• RDBMS = ACID (Atomic, Consistent, Isolate, Durable)

• NoSQL = BASE (Basically Available, Soft-State, Eventually Consistent)

• Scaling ACID compliant systems often looses true acidity

• Graph databases require and bolster acidity

• Aggregate orientation is designed NOT to have acidity

• Offline locks through version numbers to the rescue!

• ACID within a single Aggregate

• Consistency Vs Availability Vs Response Time

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 19: 1st NoSQL Asia Event in Malaysia

CAP THEOREM 101

Page 20: 1st NoSQL Asia Event in Malaysia

CAP THEOREM THE SEQUEL

Page 21: 1st NoSQL Asia Event in Malaysia

Navigating Through HyperSpace

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 22: 1st NoSQL Asia Event in Malaysia

Search Index Sharding

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 23: 1st NoSQL Asia Event in Malaysia

The Future of Data

• Distributed Designs (Spanner, Bitcoin)

• Polyglot Persistence and Event Sourcing …

• Domain driven design must be at forefront …

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 24: 1st NoSQL Asia Event in Malaysia

NoSQL Myths & Failures

• Relational Databases are ACID Compliant

• NoSQL Databases are NOT ACID Compliant

• Aggregate Orientation is good until you want or

need to change the basis of aggregation

• Most environments have implicit schemas

• Decisions, decisions - time is money

Twitter :: @nosqlasia

Facebook :: http://facebook.com/groups/nosqlkl

Page 25: 1st NoSQL Asia Event in Malaysia

Exploring The Technologies Behind Big Data Week

Twitter :: @nosqlasia

Hash-Tags :: #bdw13 #nosqlkl

Facebook :: http://facebook.com/groups/nosqlkl