Upload
others
View
6
Download
0
Embed Size (px)
Citation preview
Photo by Transaction Fraud - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/62015778@N04Created with Haiku Deck
Photo by jev55 - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/52024976@N06 Created with Haiku Deck
Photo by Chrissy Downunder - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/8492674@N08Created with Haiku Deck
Photo by robysaltori - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/7996982@N08 Created with Haiku Deck
Photo by William Brawley - Creative Commons Attribution License http://www.flickr.com/photos/93841400@N00 Created with Haiku Deck
Photo by Daveybot - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/12771303@N00Created with Haiku Deck
Photo by VinothChandar - Creative Commons Attribution License http://www.flickr.com/photos/44345361@N06 Created with Haiku Deck
Photo by digitalnoise - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/8294958@N03Created with Haiku Deck
Photo by PhotoDu.de / CreativeDomainPhotography.com - Creative Commons Attribution License http://www.flickr.com/photos/75814942@N00Created with Haiku Deck
Photo by lars hammar - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/7603557@N08Created with Haiku Deck
Photo by angela7dreams - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/58117789@N00Created with Haiku Deck
GAIA General Architecture
Data Objects
Multi-core Compute and Rendering Device
GAIA Machine Node
Photo by @Doug88888 - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/29468339@N02Created with Haiku Deck
Photo by Werner Kunz - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/35375520@N07Created with Haiku Deck
Photo by Sukanto Debnath - Creative Commons Attribution License http://www.flickr.com/photos/7487149@N03 Created with Haiku Deck
Source Document
Scalable Data parse
service
Scalable Data parse
service
Object Writer Topology
Object Writer Topology
GAIA Topology
GAIA Topology
Kafka QueueKafka Queue
Kafka QueueKafka Queue
1. Parse source document and generates in-memory Object using grammar
Object expressed in common semantic data grammar
2. Generated Object gets written to topic where Object Writer Topology is subscribed
AccumuloAccumulo3. Once an object is received the writer topology ensures that the full object is successfully written to Accumulo, once written it pushes an in memory copy of the object to the ‘written’ topic on which the GAIA topology is listening
GAIAGAIA
4. Once an object is received by the GAIA topology it is written to GAIA via an HTTP request
Object Lifecycle Scenario
5. GAIA Maintains a connection to Accumulo for authorization decisions
Schema C
GAIAGAIASchema B
Schema A
Add object to MASTER
Add object to MASTER
Add object to MASTER
Nai(‘master’,..).select(‘vtype == car || vehicle = 0’).histogram(..)
Single Parent Multiple Children Varying Schemas Single Query Example
Photo by Muhammad Ashiq - Creative Commons Attribution-ShareAlike License http://www.flickr.com/photos/56712180@N02 Created with Haiku Deck
Photo by Oracle_Photos_Screenshots - Creative Commons Attribution License http://www.flickr.com/photos/49034885@N05 Created with Haiku Deck
Photo by onkel_wart (thomas lieser) - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/26405526@N00
Created with Haiku Deck
Photo by tanakawho - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/28481088@N00 Created with Haiku Deck
Photo by octal - Creative Commons Attribution License http://www.flickr.com/photos/70594506@N00 Created with Haiku Deck
Photo by stiefkind - Creative Commons Attribution License http://www.flickr.com/photos/52924836@N00 Created with Haiku Deck
Photo by ~maja*majika~ - Creative Commons Attribution License http://www.flickr.com/photos/93941813@N00 Created with Haiku Deck
Photo by DJOtaku - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/87734610@N00Created with Haiku Deck
Photo by StayRAW - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/24879347@N00Created with Haiku Deck
Photo by pierpeter - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/99295419@N00 Created with Haiku Deck
Photo by miss mass - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/9087290@N02 Created with Haiku Deck
Photo by jurvetson - Creative Commons Attribution License http://www.flickr.com/photos/44124348109@N01 Created with Haiku Deck
Photo by xgravity23 - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/21164801@N00Created with Haiku Deck