Upload
cooper
View
37
Download
0
Embed Size (px)
DESCRIPTION
WTT 2014 - Workshop de Tendências Tecnológicas 2014. Agenda . NoSQL Concepts MongoDB Concepts MongoDB Demos. NoSQL databases? . “ NoSQL ” = “No SQL” = Not using traditional relational DBMS “No SQL” Don’t use SQL language Alternative to traditional relational DBMS - PowerPoint PPT Presentation
Citation preview
WTT 2014 - WORKSHOP DE TENDÊNCIAS TECNOLÓGICAS 2014
NoSQL ConceptsMongoDB ConceptsMongoDB Demos
Agenda
“NoSQL” = “No SQL” = Not using traditional relational DBMS “No SQL” Don’t use SQL language
Alternative to traditional relational DBMS+ Flexible schema+ Quicker/cheaper to set up+ Massive scalability+ Relaxed consistency higher performance & availability
– No declarative query language more programming– Relaxed consistency fewer guarantees
NoSQL databases?
NoSQL Systems
Map Reduce Framework Originally from Google, open source Hadoop
Key-Values-Stores Google BigTable, Amazon Dynamo, Cassandra, HBase, …
Document Stores• Data model: (key, document) pairs• Document: JSON, XML, other semistructured formats• CouchDB, MongoDB, SimpleDB, …
Graph Database Systems Neo4j, FlockDB, Pregel, …
Big-Table Implementation Teradata, Exadata, GreenPlum, MonetDB, …
ACID versus BASE ACID Atomicity, Consistency, Isolation, Durability Traditional Databases
CAP Strong Consistency + High Availability + Partition-tolerance
The CAP-Theorem postulates that only two of the three different aspects of scaling out are can be achieved fully at the same time.
Many of the NOSQL BASE Basically Available, Soft-state, Eventually consistent
Quiz. NoSQL Applications ?
[ ] Web Log Analysis URL, timestamp, number of accesses
[ ] Social-network graphs user1, user2, Find friends of a friends
[ ] Wikipedia Pages Large collections, structured and unstructured data
[ ] Twitter messages unstructured data
[ ] Blog maintenance unstructured data
[ ] Account credits and debts
MongoDB
MongoDB (from "humongous") is an open-source document database, and the leading NoSQL database. Written in C++, MongoDB features
• Document-Oriented Storage• Querying• Full Index Support• Replication & High Availability• Auto-Sharding• Map/Reduce• Geospatial support• Text Search
DB-Engines Ranking
SQL to MongoDB Mapping Chart
JSON x SQL x BSONJSONJavaScript Object Notation. A human-readable, plain text format for expressing structured data with support in many programming languages.
BSONA serialization format used to store documents and make remote procedure calls in MongoDB. “BSON” is a portmanteau of the words “binary” and “JSON”.
SQL Schema Statements MongoDB Schema Statements
CREATE TABLE users ( Id INT NOT NULL AUTO_INCREMENT, user_id Varchar(30), age Number, status char(1), PRIMARY KEY (id) )
db.users.insert( { user_id: "abc123", age: 55, status: "A" } )
var p = {‘_id’: ‘3432’,‘author’: DBRef(‘User’, 2), ‘title’: ‘Introduction to MongoDB’,‘body’: ‘MongoDB is an open sources.. ‘,‘timestamp’: Date(’01-04-12’),‘tags’: [‘MongoDB’, ‘NoSQL’],‘comments’: [{‘author’: DBRef(‘User’, 4),
‘date’: Date(’02-04-12’),‘text’: ‘Did you see.. ‘,‘upvotes’: 7, … ]
}> db.posts.save(p);
JSON Document Model
Create Index on any field in the document// 1 means ascending, -1 means descending> db.posts.ensureIndex({‘author’: 1});
//Index Nested Documents> db.posts.ensureIndex(‘comments.author’: 1);
// Index on tags> db.posts.ensureIndex({‘tags’: 1});
// Geo-spatial Index> db.posts.ensureIndex({‘author.location’: ‘2d’});
Indexes
// find posts which has ‘MongoDB’ tag.> db.posts.find({tags: ‘MongoDB’});
// find posts by author’s comments.> db.posts.find({‘comments.author’: DBRef(‘User’,2)}).count();
// find posts written after 31st March. > db.posts.find({‘timestamp’: {‘gte’: Date(’31-03-12’)}});
// find posts written by authors around [22, 42]> db.posts.find({‘author.location’: {‘near’:[22, 42]});
Queries?
$gt, $lt, $gte, $lte, $ne, $all, $in, $nin, count, limit, skip, group, etc…
db.posts.update({_id: ‘3432’}, {‘title’: ‘Introduction to MongoDB (updated)’, ‘text’: ‘Updated text’, ${addToSet: {‘tags’: ‘webinar’}});
Updates? Atomic Operations
$set, $unset
MongoDB does not support TRANSACTIONS !
$push, $pull, $pop, $addToSet
$inc, $decr, many more…
Some Cool features, but not in this lab
• Geo-spatial Indexes for Geo-spatial queries.$near, $within_distance, Bound queries (circle, box)
• Map/ReduceGROUP BY in SQL, map/reduce in MongoDB.
• GridFSStores Large Binary Files.
Demo: my bond girls database
Demo: mongodb installhttp://www.mongodb.org/downloadshttp://docs.mongodb.org/manual/tutorial/install-mongodb-on-windows/
C:\mongodb\bin\mongod.exe --dbpath d:\test\mongodb\data
Demo: mongodb as a Service https://mongolab.com/welcome/
Demo: pymongo
Demo: mongolab create a account
Demo: after a Collection, create a document
Demo: find( ) with Python
Demo: find( ) with mongo shell
Demo: load a .CSV collection with mongo shell
Demo: results of load a .CSV collection
Demo: find( ) a document with mongo shell
Demo: find( ) a document with Python
Demo: find( ) select a field
References The little Mongodb Book by Karl Seguinhttp://openmymind.net/mongodb.pdf
Mongodbhttp://docs.mongodb.org/manual/reference/sql-comparison/http://www.mongodb.org/downloadshttp://docs.mongodb.org/manual/installation/http://docs.mongodb.org/manual/tutorial/getting-started-with-the-mongo-shell/http://docs.mongodb.org/manual/https://www.mongodb.com/reference https://university.mongodb.com
Mongodb-as-a-Servicehttps://mongolab.com/welcome/https://www.mongohq.com/
Pymongo, mongodb drive for Pythonhttp://api.mongodb.org/python/current/installation.htmlhttp://api.mongodb.org/python/current/tutorial.html
Easy Install, to install pymongo for Windows https://pypi.python.org/pypi/setuptools
Schema-lessWrites
db.createCollection(‘logs’, {capped: true, size: 1048576})
NO TRANSACTIONSData Processing ~ MapReduceGeospatial Full Text SearchNoSQL + tools and maturity
Conclusion: When to use MongoDB
WTT 2014 - WORKSHOP DE TENDÊNCIAS TECNOLÓGICAS 2014Prof. Dr. Rogério de Oliveira [email protected]://meusite.mackenzie.br/rogerio