Embed Size (px)
Citation preview
1 | Energy Efficiency and Renewable Energy eere.energy.gov
Big DataMaking big data more accessible so that taxpayers work, live and
play -- faster, better, cheaper, smarter!
Robert BectelUS Department of Energy
Office of Energy Efficiency and Renewable Energy
2 | Energy Efficiency and Renewable Energy eere.energy.gov
The Obligatory Big Data Definition
• Big data is the term adopted by the market to describe extreme information management and processing issues which exceed the capability of traditional information technology along one or multiple dimensions to support the use of the information assets. Throughout 2010 and into 2011, big data has focused primarily on the volume issues of extremely large datasets generated from technology practices such as social media, operational technology, Internet logging and streaming sources. A wide array of hardware and software solutions have emerged to address the partial issue of volume.
At this point, big data, or extreme information processing and management, is essentially a practice that presents new business opportunities. -- http://www.gartner.com/it-glossary/big-data/
3 | Energy Efficiency and Renewable Energy eere.energy.gov
Don’t like that definition? Here are 10 more out of 1.2 million from Google.
1. Big data - Wikipedia, the free encyclopedia
2. Defining 'big data' depends on who's doing the defining
3. What is "Big Data?" | ZDNet
4. Big Data: Defining its definition | ZDNet
5. Big Data Definition from PC Magazine Encyclopedia
6. What's The Definition of Big Data? Who Cares? —
7. What is big data (Big Data)? - Definition from WhatIs.com
8. Big Data | The Definition of Enterprise Big Data - Wikibon
9. What is big data? - O'Reilly Radar
10.Big data - Definition, discussion, review, latest news and thought ...
4 | Energy Efficiency and Renewable Energy eere.energy.gov
Source: Intel Newsroom
5 | Energy Efficiency and Renewable Energy eere.energy.gov
`
Source: http://xkcd.com/802/
Source: http://www.digitalbuzzblog.com/facebook-statistics-stats-facts-2011/
Facebook StatisticsWith over 500 million users, Facebook is now used by 1 in every 13 people on earth, with over 250 million of them (over 50%) who log in every day. The average user still has about 130 friends, but that should expand in 2011. Over 700 Billion minutes a month are spent on Facebook, 20 million applications are installed per day and over 250 million people interact with Facebook from outside the official website on a monthly basis, across 2 million websites. Over 200 million people access Facebook via their mobile phone. 48% of young people said they now get their news through Facebook. Meanwhile, in just 20 minutes on Facebook over 1 million links are shared, 2 million friend requests are accepted and almost 3 million messages are sent.
6 | Energy Efficiency and Renewable Energy eere.energy.gov
Mobile Devices – creation and consumption of Big Data
• ComScore (Feb 2011) finds that there are now 29 percent of US subscribers who have unlimited data plans
• VC investments in mobile marketing and advertising companies was $592 million in 2011 (up from $128 million).
• VC investments in mobile commerce and payments was $558 million in 2011 (up from $276 million).
• VC investments in mobile health was $356 million in 2011 (up from $209 million).
Source: * http://mobithinking.com/mobile-marketing-toolsImage source: http://www.bondgrp.com/blog/mobile-phones-amazing-growth/
• At the end of 2011, there were 6 billion mobile subscriptions. (that's 87 percent of the world’s population). *
• ComScore (February 2011) estimates that 90 percent of mobile subscribers in US and Western Europe have a phone that can access the mobile Web. *
• In 2010, 300,000+ applications were downloaded 10.9 billion times. IDC predicts that global downloads will reach 76.9 billion in 2014 and will be worth US$35 billion.*
7 | Energy Efficiency and Renewable Energy eere.energy.gov
Where is big data & how do I find it?
Energy.data.gov
591 Data Sets5 Apps35 Maps
OpenEI.org
811 Data Sets160 Apps1000+ Maps
Data for:• Buildings• Geothermal• Smart Grid• Solar• Utilities• Wind Oil &
Gas
8 | Energy Efficiency and Renewable Energy eere.energy.gov
National & State GeoThermal Data Systems
State GeoThermal Data.org
364 Data Sets with more than 2,000,000+ Records
DiscoverableOnly 41.98% of their total
expected deliverables!
9 | Energy Efficiency and Renewable Energy eere.energy.gov
BioEnergyKDF.net
Harnessing Web 2.0 and social networking technologies to build a collective knowledge system that can better examine the economic and environmental impacts of development options for biomass feedstock production, biorefineries, and related infrastructure.
1400+ Spatial Data Sets
1206 Downloadable data,
200 Curated Articles
Links to 38 Domain Models
Geospatial & Graphical Visualization
Search
Contribute
Associate
Analyze
Share
Visualize
Collaborate!
10 | Energy Efficiency and Renewable Energy eere.energy.gov
• The number of data-driven start-ups is growing, particularly when it comes to social media. For example companies like Lexalytics and Klout.
• DOE/EERE is preparing to launch real time sentiment analysis for media, including Twitter, Facebook, Google, Flickr, News Outlets, and many other information streams.
• The Visual Patent Search Tool is designed to provide a facilitated search of the patent content contained in the Energy Innovation Portal. (ex. Wireless spread-spectrum telesensor chip with synchronous digital architecture) http://techportal.eere.energy.gov/VPS/
Making Big Data Work through Simplified Analytics and Cutting-edge Visualizations
11 | Energy Efficiency and Renewable Energy eere.energy.gov
• Mashup various building specific datasets– BAS
– Local Measurements
– Comfort
– Lighting
• Enable occupant feedback (and control)
• Provide visualizations for various user types
12 | Energy Efficiency and Renewable Energy eere.energy.gov
• Geothermal Data Analysis -- An overview of the Idaho National Laboratory's Computer Assisted Virtual Environment or CAVE.http://www.youtube.com/watch?v=SU6cCJIq73c
• The Precision Information Environments -- (PIE) project at Pacific Northwest National Laboratory is leading the effort to combine Natural User Interactions with real-time collaborative environments, allowing users to naturally interact with both computer systems and each other.http://www.youtube.com/watch?v=5tfnmhl-A54&feature=youtu.be
Big Data Analysis
13 | Energy Efficiency and Renewable Energy eere.energy.gov
…More Big Data Visualization and Analysis
• Social Networking -- The Scalable Reasoning System (SRS) is an analytic framework for developing web-based applications. Using a growing library of both visual and analytic components, custom applications can be created for any domain, from any data source. -- http://youtu.be/_tZmT7flqp0?
• CyberSecurity -- The Middleware for Data-Intensive Computing (MeDICi) Integration Framework, an integrated platform to solve data analysis and processing needs, supporting analytics research in cyber security, where increases in data collection for cyber events reach 200 million per day. -- http://youtu.be/i70E0hb4U3M
14 | Energy Efficiency and Renewable Energy eere.energy.gov
• Get the data• Mash up the data• Understand the data
• Where & When you are!
Conclusions
15 | Energy Efficiency and Renewable Energy eere.energy.gov
• Email: [email protected]• LinkedIn: http://www.linkedin.com/in/rbectel• Twitter: http://twitter.com/rbectel• Phone: 202-586-9290
How To Contact Me
