41
Monitoring Nagios Check_MK Conclusion Monitoring with Nagios and Check_MK Stefan Hornburg (Racke) [email protected] YAPC::EU 2015, Granada, 4th September 2015 racke Monitoring with Nagios and Check_MK

Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Monitoring with Nagios and Check_MK

Stefan Hornburg (Racke)[email protected]

YAPC::EU 2015, Granada, 4th September 2015

racke Monitoring with Nagios and Check_MK

Page 2: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Monitoring

I Why ?

I Who ?

I What ?

racke Monitoring with Nagios and Check_MK

Page 3: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Why ?

I Availability of servers and services

I 3rd party services (SLA)

racke Monitoring with Nagios and Check_MK

Page 4: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Who ?

I Companies

I Open Source Projects

racke Monitoring with Nagios and Check_MK

Page 5: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

What ?

I Use Case MailserverI Basic ChecksI Mail Checks

I Other / Custom checks

racke Monitoring with Nagios and Check_MK

Page 6: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Basic Checks

I CPU

I Memory Usage

I TCP Connections

I Disk Usage

racke Monitoring with Nagios and Check_MK

Page 7: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Email Checks I

I SMTP

I IMAP/POP

I Webmail

I Database

racke Monitoring with Nagios and Check_MK

Page 8: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Email Checks II

I Email loop

racke Monitoring with Nagios and Check_MK

Page 9: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Email Checks III

I Antivirus

I Spamfilter

racke Monitoring with Nagios and Check_MK

Page 10: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Email Checks IV

I Queue

racke Monitoring with Nagios and Check_MK

Page 11: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

Email Checks V

I Blacklists

racke Monitoring with Nagios and Check_MK

Page 12: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Why ?Use Case MailserverMore Checks

More Checks

I stuck jobs

I products on Amazon

I orders

I crashes

I import files

I backups

I MySQL replication

I Security updates

racke Monitoring with Nagios and Check_MK

Page 13: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

AdvantagesChecksDisadvantages

Nagios

I Advantages

I Checks

I Disadvantages

racke Monitoring with Nagios and Check_MK

Page 14: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

AdvantagesChecksDisadvantages

Advantages

I Flexible

I Plugins (simple model)

I Addons

I Community

I Ecosystem

racke Monitoring with Nagios and Check_MK

Page 15: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

AdvantagesChecksDisadvantages

Checks

I Check = Plugin/usr/lib/nagios/plugins/check_http

I active checks

I passive checks

racke Monitoring with Nagios and Check_MK

Page 16: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

AdvantagesChecksDisadvantages

Check States

I OK

I WARNING

I CRITICAL

I UNKNOWN

racke Monitoring with Nagios and Check_MK

Page 17: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

AdvantagesChecksDisadvantages

Text and Performance Data

HTTP OK: HTTP/ 1 . 1 200 OK −33920 bytes i n 0.263 second response time| time=0.262644s ; ; ; 0 .000000 s ize =33920B ; ; ; 0

HTTP WARNING: HTTP/ 1 . 1 404 Not Found −317 bytes i n 0.004 second response time| time=0.003667s ; ; ; 0 .000000 s ize =317B ; ; ; 0

racke Monitoring with Nagios and Check_MK

Page 18: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

AdvantagesChecksDisadvantages

Performance Graph

racke Monitoring with Nagios and Check_MK

Page 19: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

AdvantagesChecksDisadvantages

Disadvantages

I Configuration

I Scalability in large environments

racke Monitoring with Nagios and Check_MK

Page 20: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Check_MK

I Features

I Components

I Installation & Configuration

I Practical Advice

racke Monitoring with Nagios and Check_MK

Page 21: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Features

I Automatic service detection

I Rule based, hierarchical configuration

I High performance through passive checks

I Creates Nagios configs for you

racke Monitoring with Nagios and Check_MK

Page 22: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Components

I Configuration & Check Engine

I Livestatus

I Multisite

I WATO

I Notify

I Business Intelligence

I Mobile

I Event Console

racke Monitoring with Nagios and Check_MK

Page 23: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Architecture

Source: http://mathias-kettner.de/bilder/overview_600.trans.png

racke Monitoring with Nagios and Check_MK

Page 24: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

WATO Configuration

racke Monitoring with Nagios and Check_MK

Page 25: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Git Version Control

commit a326fb1cdc8b26cad68434de092b6b3d5360ce32Author : omdadmin <omdadmin>Date : Tue Aug 4 09:06:24 2015 +0200

Created new host t u r b i n e .

racke Monitoring with Nagios and Check_MK

Page 26: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Installation

I Open Monitoring Distribution http://omdistro.org/I Bundle in a single package

I NagiosI check_mkI MultisiteI ...

I /opt/omd

racke Monitoring with Nagios and Check_MK

Page 27: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Installation Agent

I /opt/omd/versions/.../share/check_mk/agents

I Debian/Ubuntu packages

I RPM packages

I Scripts for BSD, Mac OS, ...

I Windows Installer

racke Monitoring with Nagios and Check_MK

Page 28: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Installation Agent Debian

I dpkg -i check-mk-agent_1.2.6p5-1_all.deb

I /etc/xinetd.d/check_mk

I Restart xinetd

racke Monitoring with Nagios and Check_MK

Page 29: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Adding and updating hosts

Inventory check_mk -I linuxia

Inventory check_mk -II linuxia

Reload check_mk -O linuxia

racke Monitoring with Nagios and Check_MK

Page 30: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Migrating from NRPE to MRPE

Configuration file /etc/check_mk/mrpe.cfg

ExampleAPT /usr/lib/nagios/plugins/check_apt

racke Monitoring with Nagios and Check_MK

Page 31: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Practical Advice

I Tune configuration for slower hosts

I Check execution time

I Check intervals

racke Monitoring with Nagios and Check_MK

Page 32: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Tune configuration for slower hosts

I Connect timeout

I Check interval

I Ping round trip time

I NTP notifications

racke Monitoring with Nagios and Check_MK

Page 33: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Connect timeout

conf.d/wato/global.mk

tcp_connect_t imeout = 10.0 # d e f a u l t 5 seconds

racke Monitoring with Nagios and Check_MK

Page 34: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Check interval

conf.d/wato/rules.mk

ext ra_host_conf [ ’ check_ in te rva l ’ ] = [( 3 .0 , [ ] , ALL_HOSTS, { ’ comment ’ : u ’ Set check i n t e r v a l to 3 minutes ’ } ) ,

] + ex t ra_host_conf [ ’ check_ in te rva l ’ ]

# d e f a u l t 1 minute

racke Monitoring with Nagios and Check_MK

Page 35: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Ping round trip time

conf.d/wato/rules.mk

p ing_ leve l s = [( { ’ l oss ’ : (80 .0 , 100.0) ,

’ packets ’ : 6 ,’ t imeout ’ : 20 ,’ r t a ’ : (1500.0 , 3000 .0 ) } ,

[ ’wan ’ , ] , ALL_HOSTS,{ ’ comment ’ : u ’ Al low longer round t r i p t imes when p ing ing WAN hosts ’ } ) ,

] + p ing_ leve l s

racke Monitoring with Nagios and Check_MK

Page 36: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

NTP notifications

ex t ra_serv i ce_con f [ " n o t i f i c a t i o n _ o p t i o n s " ] = [( " n " , ALL_HOSTS, [ "NTP Time " ] ) ,]

racke Monitoring with Nagios and Check_MK

Page 37: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Practical Advice

I Status files

I Cached checks

racke Monitoring with Nagios and Check_MK

Page 38: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

FeaturesComponentsWATOGit Version ControlInstallation & ConfigurationPractical Advice

Cached checks

I Run script in background.

I Store result in cache file.

I Use cache for x seconds.

racke Monitoring with Nagios and Check_MK

Page 39: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Questions

Questions?

racke Monitoring with Nagios and Check_MK

Page 40: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Resources

Check_MK Homepage http://mathias-kettner.com/check_mk.html

racke Monitoring with Nagios and Check_MK

Page 41: Monitoring with Nagios and Check MK - LinuXia · Check_MK Conclusion Features Components WATO Git Version Control Installation & Configuration Practical Advice Installation Agent

MonitoringNagios

Check_MKConclusion

Slides

Slides: http://www.linuxia.de/talks/yapc2015/nagios-en-beamer.pdf

racke Monitoring with Nagios and Check_MK