25
Copyright © 2015 Splunk Inc. Glenn Block (@gblock) – Principal Product Manager Jian Lee – Senior Software Engineer Splunk Developer Platform & Core Liberate Your Application Logging!

Liberate your Application Logging

Embed Size (px)

Citation preview

Page 1: Liberate your Application Logging

Copyright © 2015 Splunk Inc.

Glenn Block (@gblock) – Principal Product Manager Jian Lee – Senior Software EngineerSplunk Developer Platform & Core

Liberate Your Application Logging!

Page 2: Liberate your Application Logging

2

DisclaimerDuring the course of this presentation, we may make forward looking statements regarding future events

or the expected performance of the company. We caution you that such statements reflect our current expectations and estimates based on factors currently known to us and that actual events or results

could differ materially. For important factors that may cause actual results to differ from those contained in our forward-looking statements, please review our filings with the SEC. The forward-looking

statements made in the this presentation are being made as of the time and date of its live presentation. If reviewed after its live presentation, this presentation may not contain current or accurate information.

We do not assume any obligation to update any forward looking statements we may make.

In addition, any information about our roadmap outlines our general product direction and is subject to change at any time without notice. It is for informational purposes only and shall not, be incorporated

into any contract or other commitment. Splunk undertakes no obligation either to develop the features or functionality described or to include any such feature or functionality in a future release.

Page 3: Liberate your Application Logging

3

“Sending events to

Splunk from my apps is

hard!” A disgruntleddeveloper:

Page 4: Liberate your Application Logging

4

Your apps should be freed to be Splunked!Free from requiring a local forwarder

Free from complex configuration

Free from scale and performance bottlenecks

Free to be sent from any client

Page 5: Liberate your Application Logging

In Splunk 6.3, they can be liberated!In Splunk 6.3, they can be liberated!

Page 6: Liberate your Application Logging

6

Introducing

HTTP Event Collector

Page 7: Liberate your Application Logging

7

HTTP Event CollectorA new token-based JSON API for events

Send events directly from anywhere (servers, mobile devices, IOT)

Easy to configure / works out of the box.

Easy to secure

Highly performant, scalable and available

Page 8: Liberate your Application Logging

Demo:HTTP Event Collector

8

Page 9: Liberate your Application Logging

Sending data//send with curlcurl -k https://localhost:8088/services/collector -H 'Authorization: Splunk 46931F1C-352C-4DF6-820C-F2689CF88494' -d '{"event":"Hello Event Collector"}'

9

Page 10: Liberate your Application Logging

How you useEnable HTTP Event CollectorCreate/Get a tokenSend events to Splunk using the token– Use HTTP Directly

Create a POST request and set the Auth header with the token

POST JSON in our event format to the collector

– Use logging libraries Support for .NET, Java and JavaScript loggers

10

Page 11: Liberate your Application Logging

Event protocol advanced capabilitiesBatching:{"event":"event 1"}

{"event":"event 2"}

{"event":"event 3"}

11

Metadata:{

"source":"foo",

"sourcetype":"bar",

"host": "192.168.1.1",

"time": 1441139779

"event":"Hello World"

}

Index selection:{

"index": "collector"

"event":"Hello World"

}

JSON objects{

"event": {

"message":"….",

"severity":"warn"

"category":"web"

}

}

Page 12: Liberate your Application Logging

12

Logging libraries• Provide integrations with common

loggers (log4J, log4net, etc)• Very friendly to developers and

easy to pull into their applications• Provide robustness (async, retries,

batching)• Java , .NET and node.js

Page 13: Liberate your Application Logging

Demo:Loggers galore(java, .NET, Node)

13

Page 14: Liberate your Application Logging

14

Retries

Logger can resend if it is not able to reach the server.

Uses an incremental back-off policy by default

Page 15: Liberate your Application Logging

15

Batching

Events can be batched up:

– number of events– number of bytes– time interval– manual flush

Page 16: Liberate your Application Logging

16

Logging libraries

Supported libraries

• Java – log4j, logback, java.util.logging• .NET – Trace Listeners, SLAB• Node.js – Bunyan

More to come!

Page 17: Liberate your Application Logging

17

How you get them?

• Pull the logging library of choice into your application• Configure the logger• Log away!

Page 18: Liberate your Application Logging

18

Scale and High Availability

Indexers

Page 19: Liberate your Application Logging

19

3rd party integrations

Page 20: Liberate your Application Logging

Demo:Splunk and AWS Lambda

20

Page 21: Liberate your Application Logging

21

Splunk and AWS LambdaMonitor your Lambda functions within Splunk!

Use Lambda to pipe events from services like Kinesis to Splunk

Configure right in the AWS Console or use our JavaScript and Java logging libraries

http://dev.splunk.com/goto/awslambda

Page 22: Liberate your Application Logging

22

Liberate your logs!

HTTP Event Collector

Page 23: Liberate your Application Logging

Building Solutions on the Splunk Platform

Splunk Reference AppsComplete, working real-world Splunk solutions built together with partners

Splunk Developer Guide

dev.splunk.com/goto/devguide

Page 24: Liberate your Application Logging

24

Next steps?

Breakouts The HTTP Event Collector, a New Way for Developers to Send Events to Splunk Accelerating your Solution Development with Splunk Reference Apps Cloud, Wearables, and IoT! How Orion Leverages Splunk Cloud to Ensure Performance and Gain

Analytics from Internet-connected Accessories

More information dev.splunk.com/goto/awslambda dev.splunk.com blogs.splunk.com/dev

Come by the Developer Booth and say hi / ask questions!

Related breakout sessions and activities…

Page 25: Liberate your Application Logging

THANK YOU