Embed Size (px)
DESCRIPTION
LucidWorks App for Splunk Enterprise is the first of its kind, specifically designed to allow companies to analyze and manage the health and availability of their Solr deployments in Splunk software. The solution integrates multi-structured data indexed by Solr directly into Splunk® Enterprise, giving system administrators the ability to look at the intersection of documents, customer records or other unstructured data sources as they relate to machine data. This enables companies to optimize their Solr applications, glean insights from search and usage patterns and spot security concerns to improve end user experiences and derive more business value from data-driven applications. This webinar will explore the features of the App, and provide attendees with valuable information on the following key components: Solr Monitor: Monitor the health and availability and utilization of LucidWorks and/or Solr deployments with pre-defined data inputs, dashboards and reports Search Analytics: Perform user behavior and click-stream analysis with pre-built search analytics reports and fields NoSQL Lookups: Using Splunk’s lookup facility enrich your Splunk reports with data of any structure using Solr’s fully indexed and searchable NoSQL-datastore Search Time Joins: Join Splunk data with human generated and other unstructured data sources stored in Solr at search time for developing data-driven applications
Citation preview
Search | Discover | Analyze
© 2013 LucidWorks, All Rights Reserved
Introducing the LucidWorks App for Splunk Enterprise
Will HayesChief of Products, LucidWorksDecember 18, 2013
2
• Prior to LW, spent 8 years at Splunk, employee #9ish (held various roles Engineering, Business Development, Solutions)
• 15 years developing data driven apps and solutions
• Proud Search Snob!
Today’s Presenter
Chief of Products at LucidWorks
@iamwillhayes
3
• About LucidWorks
• LucidWorks for Splunk Enterprise Deployment Architecture
• LucidWorks for Splunk Enterprise Overview
• Example Use Cases
• Demo
Agenda
LucidWorks App for Splunk Enterprise
4
Our Mission
Enable Smarter Data Driven Applications Through the Power of Search
5
Techniques such as relevancy, recommendations, result ranking and personalization greatly enhance enterprise and consumer applications:– Consumer Websites– Knowledge Management– Cyber Security– Fraud Detection– Governance and Compliance
Data Driven Applications
Data Driven Applications deliver contextually relevant information when it’s needed
6
• Founded in 2007 to be the go-to-company for Lucene/Solr expertise• 300+ customers (many Fortune 500)• 30% of the Apache Lucene/Solr committers contributing over 50%
of dev• Creators of industry’s first enterprise grade search product built on
Lucene/Solr
Who is LucidWorks?
Commercializing and Extending Industry Leading Open Source Search
100’s of Billionsof documents
searched
4,000+Enterprise
applications
200%Growth in
recurring revenue
7
What is LucidWorks Search?
Most comprehensive enterprise search built on an Open Core
+
+High-Performance Indexing | Powerful, Accurate & Efficient Search AlgorithmsRanked & Field searchingFlexible faceting, highlighting, joins and result groupingPluggable ranking models
Advanced Full-Text Search CapabilitiesOptimized for High Volume Web TrafficStandards Based Open Interfaces - XML, JSON and HTTPComprehensive HTML Administration InterfacesServer statistics exposed over JMX for monitoringLinearly scalable
Entity ExtractionUser Interface for customizationConnectors & CrawlersCluster installerBusiness RulesRelevancy WorkbenchTime to Value
LuceneAll built on Java
8
60k - 100k downloads per month
Over 300,000 production deployments
What is Lucene/Solr
is a library that delivers robust full-text indexing for
unstructured data
provides a search server exposing a variety of features and APIs:
• Distributed shared architecture with real time replication
• Most advanced querying capability for both structured and unstructured data
9
The Solr Data Store provides:– Distributed shared architecture with real time replication
– Schemaless support and incremental field updates
– Schema updates without re-indexing
– Most advanced querying capability for both structured and unstructured data
Fully Indexed and Searchable NoSQL Store
The Search First NoSQL store
10
Reference Architecture
SystemManagem
ent
Installation
Administration
Monitoring
Configuration Mgt.
Service Management
Data Management
ZooKeeperMapRSearch
IndexesSearch Logs
Big Data File System
› Analytics› Classification/Machine Learning› Natural Language Processing› Key Workflows (bulk loading, log analysis, common
metrics)
Search – Discovery – Analytics EngineContentAcquisitio
n
Enterprise Repository
Social Media
MongoDB
Databases
HDFS
Cloud
Push
Uniform REST API
11
What is Splunk?
The Platform for Operational Intelligence
12
Reference Architecture
The best of both worlds
LucidWorks App for Splunk Enterprise Search logs collected from lws server
Perf counters Collected using REST
Reports generated leveraging data from Splunk + LucidWorks/Solr
13
The LucidWorks App for Splunk Enterprise
Multidimensional Data Analytics and Document Search for Splunk
Solr MonitorMonitor the health, availability and resource utilization Solr deployments with pre-defined data inputs, dashboards and reports.
Search AnalyticsPerform user behavior and search usage analysis with pre-built search analytics reports and field extractions.
NoSQL Data Joins and Document Search
Splunk’s lookup facility, enrich your Splunk reports with data of any structure using Solr’s fully indexed and searchable NoSQL-datastore.
Multi-Dimensional Data AnalysisJoin Splunk data with multiple
unstructured data sources stored in Solr at search time for developing powerful
data driven applications.
14
Solr Monitor
15
Solr Monitor
16
Solr Monitor
17
Solr Monitor
18
User Behavior - Search Analytics
19
Corporate Compliance – Multidimensional Analysis
Web Access Logs in Splunk show search
Correlation and Enrichment Powered by LucidWorks
20
Document Search - E-mail Messages and Attachments
21
Demo
Demo!
22
• Visit the Solr Marketplace: – lucidworks.com/marketplace
• Request a detailed demo:– [email protected]– 650-353-4057 x171
Take the Next Step
@LucidWorks LucidWorks.com/facebook
