View
113
Download
0
Category
Tags:
Preview:
DESCRIPTION
Citation preview
1
Hue HBase BrowserKevin Wang, Platform Intern, Cloudera@Kevinverse
2
Cloudera Hue
• Web Interface for making Hadoop easier to use • Aggregation of apps for each Hadoop component
(e.g. Hive, Pig, Impala, Oozie, Solr, Sqoop, HBase...)
3
• Industry Usage
• Widespread HBase Usage• Meetups, HBaseCon
• Community Need
Product Mission - HBase Usage Size
Organic ExampleCommunity Expresses Need for HBase UI
4
Product Mission - Problem & Competition
Lack of Accessibility• Hard for beginnersLack of Familiarity• Unfamiliarity with Key-ValueUsability Challenges• Lack of any web UI• Lack of imaginative interface• Low-level• CDH - Command Line
HBase Manager’s Tabular View
Competing Application
5
• Open HBase usage to non-technical people• Drive HBase adoption in startups/organizations• Solve a pain point with a good product
• Knockout/JS/jQuery• Django • Thrift Hbase
Project Purpose – Addressing this Need
6
Demo
7
Technical Challenges - Design
• Design Innovation• Problem: HBase is a key-value store, not a traditional RDB • Solution: Collapse Sparse Data across HBase Tables
Tabular View HBase Browser Smartview
8
• Scale • Problem: Performance on Millions of Columns• Solution: Lazy loading & Truncation using Thrift FilterString
• Stream raw data cached MEM DOM elements dynamically generated• b64encode binary data to preserve during ASCII dump• Detect schema on preview reading byte headers• Capped, Lazy Loaded & Bound to DOM via MVVM Pattern
Technical Highlight - Scale
100MB Currently Streamed Thrift 5TB HBase Cluster
9
Technical Highlight - Flexible Searchbar
• Flexible Searchbar• Problem: Need high-level tool for complex data fetching &
analysis• Solution: Simple custom query language
• Supports HBase filter language• Supports selection & Copy + Paste, Gracefully degrades in IE• Autocomplete Help Menu• Regenerate Rendered Position – Firefox Bug
Row Key
Scan Length
Prefix Scan
Column/Family Filters
Thrift Filterstring
Searchbar Syntax Breakdown
10
Current• Ramp up for CDH 4.4 release• Tutorial Video & Blog Post• Tons of JIRAs
Roadmap, Timeline & Next Steps
Initial Release in Hue 2.5 Ship in CDH 4.4
11
Any Questions?Kevin, Platform Intern, ClouderaFollow me: @Kevinversewww.gethue.com
Hue HBase Browser250+ commits20000+ lines of code∞ cups of coffee
Pageviews
12
Icons (more to come)
13
Arrows
Working Elements
Recommended