Upload
others
View
36
Download
0
Embed Size (px)
Citation preview
5 Redis Use CasesThat Power the Datorama Query API
Gur Dotan
Platform Team Leader
- Datorama R&D -
About Me
@gurdotan
Datorama is
Intelligence for Marketing
Everyperformance,outcome&investmentacrossthecustomerjourney– allinoneplace.
Daily Stats
5 Billion 3.5Million 40,000Rows
ProcessedRedis
Calls/SecondQueriesExecuted
The Datorama Query API
- Core Service -
IO Intensive
CPU Intensive
RAM Intensive
Distributed Nature => Driven By Redis
A Distributed Swiss Army Knife
Caching
Queueing
Locking
Throttling
PubSub’ing
Query API Backend
WebServer
QueryWorker
WebServer
1. Caching
CacheWebServer
QueryWorker
Speed Less Compute
QueryWorker
2. Queueing
Queue
CacheWebServer
QueryWorker
Decentralization Auto-Scaling
3. Locking
Queue
LockCacheWebServer
QueryWorker
Resilience no “Noisy Neighbor”
4. Throttling
LockCacheWebServer
Queue
QueryWorker
Congestion Mgmt.
Queue
5. PubSub’ing
PubSub
Queue
LockCacheWebServer
QueryWorker
Immediate Feedback
One Flow – Five Use Cases
Caching
Queueing
Locking
Throttling
PubSub’ing
WE’RE HIRING
engineering.datorama.com
Thank You!