Monitoring Elasticsearch电子书

Monitoring Elasticsearch

Table of Contents

Monitoring Elasticsearch

Credits

About the Author

About the Reviewers

www.PacktPub.com

eBooks, discount offers, and more

Why subscribe?

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Downloading the example code

Downloading the color images of this book

Errata

Piracy

Questions

1. Introduction to Monitoring Elasticsearch

An overview of Elasticsearch

Learning more about Elasticsearch

Data distribution, redundancy, and fault tolerance

Full-text search

Similar technologies

Apache Lucene

Solr

Ferret

Monitoring Elasticsearch

Resourcefulness and problem solving

Summary

2. Installation and the Requirements for Elasticsearch

Installing Elasticsearch

DEB/RPM installation

The yum and apt-get repositories

Ubuntu/Debian and apt-get

CentOS/RHEL and yum

Verification

Configuration files

Configuring an Elasticsearch cluster

Cluster name

Memory configuration

Open file limit

The maximum file limit

Updating max file descriptors on Ubuntu Linux

Enabling pluggable authentication modules

Verifying the open file limit

Disabling swapping

Understanding your cluster

Installing Elasticsearch-head

Installing Bigdesk

Marvel

Cluster requirements

Summary

3. Elasticsearch-head and Bigdesk

Cluster setup

Cluster configuration

Sample data

Elasticsearch-head

The Overview tab

Cluster states

Node and index actions

The Indices tab

The Browser tab

The Structured Query tab

The Any Request tab

The official website

Bigdesk

The Elasticsearch cat API

Background

Count

Health

Indices

Shards

Summary

4. Marvel Dashboard

Setting up Marvel

Upgrading Marvel

Configuring Marvel

Marvel agent configuration settings

Marvel index configuration

Understanding the Marvel dashboard

Overview dashboard

Indices dashboard

Nodes dashboard

Monitoring node failures

Summary

5. System Monitoring

Working with Kopf

Installing Kopf

The cluster page

The nodes page

The rest page

The more dropdown

Working with Logstash and Kibana

ELK

Installation

Installing Logstash

Loading NGINX logs

Installing Kibana

Working with Nagios

Installing Nagios

Command line tools for system and process management

top

tail

grep

ps

kill

free

du and df

Summary

6. Troubleshooting Performance and Reliability Issues

System configuration

The fielddata cache

Analyzing queries

Slow log

Improving query performance

High-cardinality fields

Querying smaller indices

Cold indices

The shard query cache

Script queries

Testing meticulously

System and data architecting

Hot-Warm architecture

Master nodes

Hot nodes

Warm nodes

Reducing disk size

Compression

Storing the _source and analyzed fields

Optimizing data ingestion

Bulk indexing operations

Drive configuration

Case studies

Node configuration

Query optimization

Web application performance

Summary

7. Node Failure and Post-Mortem Analysis

Diagnosing problems

OutOfMemoryError exceptions

Shard failures

Slow queries

Resolving OutOfMemoryError exceptions

Elasticsearch process crashes

Disk space

Resolving the issue

Reviewing some case studies

The ES process quits unexpectedly

Query requests slow and timing out

Summary

8. Looking Forward

Elasticsearch 5 overview

Performance and reliability

Data loss

Upgrading to Elasticsearch 5.0

When to upgrade

Monitoring Elasticsearch 5

Summary

Index