26
Real-Time Geospatial Intelligence at Scale 1

Real-Time Geospatial Intelligence at Scale

  • Upload
    memsql

  • View
    237

  • Download
    2

Embed Size (px)

Citation preview

FileNewTemplate

Real-Time Geospatial Intelligence at Scale

1

Mike KilrainPresident, MemSQL USG

2

We live in an on-demand economy

3

Consumers are now conditionedto instant services4

Data scientists need to carry the world forward5

Too often stuck with batch processing and slow ETL6

Slow LoadingSlow QueriesNo ConcurrencyOn-going Data Processing Barriers

7

There isa shift underwaythe move to real time

8

INTRODUCING MEMSQL 5

The Real-Time Database Platform for Transactions and Analyticsmemsql.com/download

10MemSQL is Designed for Modern WorkloadsScalable SQLIn-Memory and Solid-StateDistributedDatacenter or CloudMulti-modeOLTP, OLAP, HTAPMulti-modelANSI SQLKey-valueDocument/JSONGeospatialIn-Memory rowstoreSolid-state columnstoreStream directly to rowstore or columnstoreDistributed query optimizer and executionScale-out on commodity hardware

Deploy on-premisesCloud agnosticAmazonMicrosoftGoogleDigital OceanSimpleReal-TimeAffordableFlexible

SSD

10

11

Real-time dashboards are just thefirst step

12

Streamliner

real-time pipelines andpredictive analytics

13

Spark MLlib Predictive ModelRaw Sensor 1 + Predictive Score 1Real-Time Scoring for Predictive Applications

IDS1S2P1P21

Real-Time Inputs

Apache Spark

STREAMLINER

Business Logic14

HadoopApache Spark

STREAMLINERExtending Hadoop to Real-Time Processing15

Putting Streamliner to work for IoT applications

16

Internet-of-Things simulation depicting health of wind turbines globally.

7 machines - AWS C4-2X large instances, at $0.311 per hour per machine, annual cost ~ $19,000.

MemSQL PowerStream17

Sensors

Wind TurbineWind FarmMemSQL PowerStream197,000 wind turbines around the world18

1 to 2 million data points per secondwith MemSQL Streamliner19

Apache Spark

STREAMLINERData Producers(simulating sensor activity)PowerStream User InterfaceMemSQL PowerStream Architecture

20

21

22

Real-time Business Intelligence dashboard

Simulated pickup/drop-off data streamed into MemSQL as rides completeTaxiStats

23

Real-time data on pickups by ZIP codeTotal ride volumeRides by time of dayZoomData Dashboard

24

Get the blueprint25

THANK YOU