20
MongoDB and The Internet of Things Arthur Viegers Senior Solutions Architect, MongoDB MongoDB IoT City Tour 2014

MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

  • Upload
    mongodb

  • View
    202

  • Download
    2

Embed Size (px)

DESCRIPTION

The value of the fast growing class of NoSQL databases is the ability to handle high velocity and volumes of data while enabling greater agility with dynamic schemas. MongoDB gives you those benefits while also providing a rich querying capability and a document model for developer productivity. Arthur Viegers will outline the reasons for MongoDB's popularity in IoT applications and how you can leverage the core concepts of NoSQL to build robust and highly scalable IoT applications.

Citation preview

Page 1: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

MongoDB and The Internet of Things

Arthur ViegersSenior Solutions Architect, MongoDB

MongoDB IoT City Tour 2014

Page 2: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

MongoDB

Document Database

Open-Source

General Purpose

Page 3: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Documents Are Core

Relational MongoDB{ first_name: "Paul", surname: "Miller", city: "London", location: [45.123,47.232], cars: [ { model: "Bentley", year: 1973, value: 100000, … }, { model: "Rolls Royce", year: 1965, value: 330000, … } ]}

Page 4: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Documents Are Core

Relational MongoDB

Page 5: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

MongoDB Scales Horizontally

Page 6: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

MongoDB Replication

Page 7: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

MongoDB Architecture

Page 8: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

Modelling time series datain MongoDB

Page 9: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Rexroth NEXO Cordless Nutrunner

Page 10: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

• Store event data

• Support Analytical Queries

• Find best compromise of:- Memory utilization- Write performance- Read/Analytical Query Performance

• Accomplish with realistic amount of hardware

Time series schema design goal

Page 11: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

• Document per event

• Document per minute (average)

• Document per minute (second)

• Document per hour

Modelling time series data

Page 12: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Document per event

{ deviceId: "Test123", timestamp: ISODate("2014-07-03T22:07:38.000Z"), temperature: 21}

• Relational-centric approach

• Insert-driven workload

Page 13: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Document per minute (average)

{ deviceId: "Test123", timestamp: ISODate("2014-07-03T22:07:00.000Z"), temperature_num: 18, temperature_sum: 357}

• Pre-aggregate to compute average per minute more easily

• Update-driven workload

• Resolution at the minute level

Page 14: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Document per minute (by second)

{ deviceId: "Test123", timestamp: ISODate("2014-07-03T22:07:00.000Z"), temperature: { 0: 18, 1: 18, …, 58: 21, 59: 21 }}

• Store per-second data at the minute level

• Update-driven workload

• Pre-allocate structure to avoid document moves

Page 15: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Document per hour (by second)

{ deviceId: "Test123", timestamp: ISODate("2014-07-03T22:00:00.000Z"), temperature: { 0: 18, 1: 18, …, 3598: 20, 3599: 20 }}

• Store per-second data at the hourly level

• Update-driven workload

• Pre-allocate structure to avoid document moves

• Updating last second requires 3599 steps

Page 16: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Document per hour (by second)

{ deviceId: "Test123", timestamp: ISODate("2014-07-03T22:00:00.000Z"), temperature: { 0: { 0: 18, …, 59: 18 }, …, 59: { 0: 21, …, 59: 20 } }}

• Store per-second data at the hourly level with nesting

• Update-driven workload

• Pre-allocate structure to avoid document moves

• Updating last second requires 59 + 59 steps

Page 17: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

Rexroth NEXO schema

{ assetId: "NEXO 109", hour: ISODate("2014-07-03T22:00:00.000Z"), status: "Online", type: "Nutrunner", serialNo : "100-210-ABC", ip: "127.0.0.1", positions: { 0: { 0: { x: "10", y:"40", zone: "itc-1", accuracy: "20” }, …, 59: { x: "15", y: "30", zone: "itc-1", accuracy: "25” } }, …, 59: { 0: { x: "22", y: "27", zone: "itc-1", accuracy: "22” }, …, 59: { x: "18", y: "23", zone: "itc-1", accuracy: "24” } } }}

Page 18: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

Summary

Page 19: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

*

• IoT processes are real-time

• Relational technologies can simply not compete on cost, performance, scalability, and manageability

• IoT data can come in any format, structured or unstructured, ranging from text and numbers to audio, picture and video

• Time series data is a natural fit

• IoT applications often require geographically distributed systems

Why is MongoDB a good fit for IoT?

Page 20: MongoDB IoT City Tour EINDHOVEN: Managing the Database Complexity

Thank you!