From Sectional to Sofa

NoSQL with .J. Steven Young

Show Me the Cache

• 11 Clusters (4 mirrored) – 100 nodes

• > 3 TB of data• ~430m objects (146m in largest)• Total ops/sec ~ 75k – *149k with HA

In The Beginning

• Cache Scalability• Drop in replace Memcached• Database relief• HA caching

From the Bottom Up

• Processors• Memory• Disk• Virtualization• “Bloat”-ware

Establish Standard Architecture

• LESSON: STANDARDIZE HARDWARE– Sizing Environments Properly– Testing Failures–Performance Testing / Tuning–Documenting Failures and Successes

Expectations of Users

• LESSON: Know what is wanted– Object Sizing and Number– TTL, ops/sec, # Host Connections– Bucket Type– Indexing and Queries and Replication– Binary vs. JSON

Cache Behaving Badly

• LESSON: PREPROD TESTING– Rebalance Issues– Swapping– Memory Consumption– Out Dated Libraries

Cache in the Couch

• LESSON: Know TCO– Resources– Administrative Costs / Time– Usage / Consolidation

Balancing Act

• Consolidation• Replication• Fault Tolerant Applications• Off-loading Processes• Libraries • Connections

Use Case #1

• Content– HTML– Image Links– HA caches– XDCR

Example of HADC 1 DC 2

VS.

Use Case #2

• Upselling– Package Deals– Ads Data– Added Offers

Use Case #3

• Search History / Trends– Previous Searches– What Properties are Trending– Stored Pricing

Image the Possibilities

• Alerting Management• Configuration Management• RDBS Caching• Release Management• Trending Analysis

If you build it… They will come!

Foundations for Success

• From the Ground Up• Know Your Environment• Know Your Limitations• Monitor

Q & A @jstevenyoung