Greenplum 100419142438 Phpapp02

The Future of Business Intelligence

Tim O’Reilly

April 12, 2010

Monday, April 19, 2010

“Major Strasser has been shot...Round up the usual suspects”

Business Intelligence

“You keep using that word. I do not think it means what you think it means.”

Web 2.0 Cloud Computing

You may think of me as a book publisher

What We Really Do At O'Reilly

Change the world by spreading the knowledge of innovators

“I’m an inventor. I became interested in long term trends because an invention has to make sense in the world in which it is finished, not the world in which it is started.”

-Ray Kurzweil

O’Reilly Radar Methodology

“The future is here. It’s just not evenly distributed yet.” - William Gibson

We “watch the alpha geeks” and think about the futures they are living in

We then look for trend data that tells us that a particular future is becoming mainstream

I’m going to tell you some seemingly unconnected technology stories from the front lines of innovation. Then we’re going to connect the dots.

Hackers play Entrepreneurs build products for consumer early

adopters Enterprises follow

We saw this with the PC, with the World Wide Web, with open source software, with social networking

The cloud future includes...

Devices acting as sensors for intelligent data collection

Devices whose UI is on the web rather than the device

Feeding data into multiple online services that will turn into a full-on sensor web

Setting the stage for robotics, augmented reality, and the next generation of personal electronics

Providing “personal business intelligence” (aka “Quantified Self”)

What we see here

Peer-to-peer credit card payments Social networks used for risk evaluation

The PC is out of the loop The phone is a sensor platform

– Hardware add-on innovation– Location based sensing– Touch screen UI

Processing is done in real time in the cloud– Allowing processing that can’t be done on the device– Big data analysis– Building new networks on the back of existing ones

Reinventing a major industry

The smart phone plus local search. Today pizza,

Round Table Pizza, 4300 Great America ParkwayGiovanni’s NY Pizzeria 1127 Lawrence ExpwyLittle Caesar’s Pizza, 4767 Lafayette Street

Little Caesar’s, 3900 Las Vegas Blvd SouthAnthony’s Coal Fired, 3569 Las Vegas Blvd SouthTrattoria del Lupo, 3950 Las Vegas Blvd South

An application running on a mobile device whose user interface is driven by sensors:

- Touch screen- Motion and proximity sensors- Microphone- GPS or cell tower triangulation

An application that depends on cooperating cloud data services: - Speech recognition- Search- Location data

An application that applies context-sensitive filters to give users just the information they need.

In real time

The Yelp Monocle

Find cafes nearby.

Crowdsourcing includes the use of humans as sensors

AMEE - the world’s energy meter

We’re moving to a world in which every device generates useful data, in which every action creates “information shadows” on the net.

GoodData here

•Search in plain English•Search by voice•Traffic view•Search along route•Satellite view•Street view

An application that depends on cooperating cloud data services: - Location- Search- Speech recognition- Live Traffic- Imagery

Business Intelligence

“You keep using that word. I do not think it means what you think it means.”

Web 2.0 Cloud Computing

The Internet Operating System is A Data Operating System

The Internet Operating System is a Data Operating System

It helps applications find out about– People– Places– Things– Prices– Documents– Images– Sounds– Relationships– ...

and helps people interact with them through services– Search– Payment– Matching and Recognition– ...

In Real Time

And that’s why Business Intelligence as we knew it

is dead

We’re moving from a world in which analysts and executives study data and make decisions to a world in which analysts study data and rewrite algorithms that make decisions.

“We don’t have better algorithms than anyone else. We just have more data.”

--Peter Norvig, Chief Scientist, Google

Or do they?

There’s a lot of data in the world

Why syndicated data - and a platform that supports business rules for sharing - is essential

Interoperable web services, open data, and standard protocols are at least as important as open source

That’s Why Greenplum Chorus is important

another simplegeo slide (or is that the right co?)

Switching tracks (a bit)...

Open Source and Scientific Data“With the very pressing issue of climate change, releasing raw data is vital.

There can be no excuse not to. Releasing source code is optional, trulygreat for open source review - but very dangerous if everyone just re-runsthe same code with the same baked-in implicit and explicit assumptions anderrors.

In discussion with our Chief Scientist, we have agreed it's much better topublish the following:

- the raw data and the circumstances of its collection - the method and assumptions used to process the data (in words and equations) - the results of the processing - the known limitations on the method and significance of the assumptions

The computer code should be written from scratch as many times as possibleto reduce the chance that it affected the results in any way.”

--Gavin Starks, CEO, AMEE

For more information

The Open Source Paradigm Shift (2003) http://bit.ly/cKLSUP

What is Web 2.0? (2005) http://oreil.ly/a0zT65

Web Squared: Web 2.0 Five Years On (2009) http://bit.ly/kEKgs

Government as a Platform (2010) http://opengovernment.labs.oreilly.com/

Ongoing commentaryhttp://radar.oreilly.comhttp://twitter.com/timoreillyhttp://buzz.google.com/timoreilly

Greenplum 100419142438 Phpapp02

Documents

Pivotal Greenplum: GPText 2

Greenplum/EMC - Open MPI

Pivotal Greenplum DatabasePRODUCT DOCUMENTATION Pivotal™ Greenplum Database® Version 5.6.1 Pivotal Greenplum Database Documentation Rev: A02 © 2018 Pivotal Software, Inc

About Pivotal, Inc. About Greenplum Database 4.2.8 · • Known Issues in Greenplum Database 4.2.8.2 • Upgrading to ... In the next major release of Greenplum Database, connecting

Greenplum Database

Greenplum MapReduce Whitepaper

Welcome to Greenplum Day! · Community Greenplum Database – – Github code – mailing lists / community engagement – Global project w/ external contributors Pivotal Greenplum

Pivotal Greenplum Database

MicroStrategy interoperability with Greenplum

Greenplum Overview

Pivotal Greenplum Text

Pivotal Greenplum Database · Contents Release Notes 4 Initializing Greenplum Database.....61

Pivotal Greenplum Command Center

Greenplum for PostgreSQL hackers Heikki Linnakangas / Pivotal · Greenplum Greenplum is PostgreSQL with Massively Parallel Processing bolted on with lots other extra features and

Greenplum hadoop

Pivotal Greenplum Databasegpdb.docs.pivotal.io/43310/pdf/GPDB43AdminGuide.pdf · • Managing Greenplum Database Access covers configuring Greenplum Database authentication, managing

Greenplum feature

Welcome to Pivotal Greenplum Database 4.3.23 · Only Pivotal Greenplum Database is supported by Pivotal Support. About Greenplum Database 4.3.23.0 Greenplum Database 4.3.23.0 is a

Welcome to Greenplum Database 4.0.4 - …media.gpadmin.me/wp-content/uploads/2011/02/GPDB-4040-README.pdfWelcome to Greenplum Database 4.0.4.0 Greenplum Database is a massively parallel

Greenplum on PKS