awesome-elasticsearch

official website

is a data pipeline that helps you process logs and other event data from a variety of systems

is a data analysis tool that helps to visualize your data;

is the platform for building lightweight, open source data shippers for many types of data you want to enrich with Logstash, search and analyze in Elasticsearch, and visualize in Kibana

teaches you how to leverage neural networks, NLP, and deep learning techniques to improve search performance. (2019)

demystifies relevance work. Using Elasticsearch, it teaches you how to return engaging search results to your users, helping you understand and leverage the internals of Lucene-based search engines. (2016)

teaches you how to build scalable search applications using Elasticsearch (2015)

hands-on guide to developing fully functional search engines with Elasticsearch and Kibana. (2021)

notes and exercises to prepare the certification exam

frutik/awesome-search

I am building e-commerce search now. Below are listed some of my build blocks

is an open source full featured Enterprise Search, with a web-crawler

Yelp/elastalert

is a modular flexible rules based alerting system written in Python

etsy/411

an Alert Management Web Application (credentials: user/user)

appbaseio/mirage

is a 🔎 GUI for composing Elasticsearch queries

exceptionless/Exceptionless

is an error (exceptions) collecting and reporting server with client bindings for a various programming languages

searchkit/searchkit

is a UI framework based on React to build awesome search experiences with Elasticsearch

is a React based UI components library for building Airbnb / Foursquare like Maps

is a library of beautiful React UI components for Elasticsearch

appbaseio/dejavu

The missing UI for Elasticsearch;

Simple File Server

is an Openstack Swift compatible distributed object store that can serve and securely store billions of large and small files using minimal resources

a log shipper to parse and ship logs to Elasticsearch including bulk indexing, disk buffers and log format detection

ItemsAPI

simplified search API for web and mobile (based on Elasticsearch and Express.js)

Kuzzle

An open-source backend with advanced real-time features for Web, Mobile and IoT that uses ElasticSearch as a database. ( )

SIAC

SIAC is an enterprise SIEM built on the ELK stack and other open-source components

Sentinl

Sentinl is a Kibana alerting and reporting app

Praeco

Elasticsearch alerting made simple

DataStation

Easily query, script, and visualize data from every database, file, and API

DocKit

GUI client for elasticsearch to query, manage and visualize your data

Official low-level elasticsearch client for python

High-level python client for Elasticsearch

ESORM

Python Asyncio ORM based on the famous

Ruby Elasticsearch Client

Official low-level elasticsearch client for Ruby

Sense (from Elastic)

A JSON aware developer console to Elasticsearch; official and very powerful

ES-mode

An Emacs major mode for interacting with Elasticsearch (similar to Sense)

Examples for the most used queries, API and settings for all major version of Elasticsearch

Elasticstat

CLI tool displaying monitoring informations like htop

Elastic for Visual Studio Code

An extension for developing Elasticsearch queries like Kibana and Sense extention in Visual Studio Code

Elastic Builder

A Node.js implementation of the Elasticsearch DSL

Bodybuilder

A Node.js elasticsearch query body builder

enju

A Node.js elasticsearch ORM

Peek

An interactive CLI in Python that works like Kibana Console with additional features

Logstash pipeline parser

Python Parsing expression grammar (PEG) and Abstract syntax tree (AST) for Logstash pipeline syntax

Knapsack plugin

is an "swiss knife" export/import plugin for Elasticsearch

Elasticsearch-Exporter

is a command line script to import/export data from Elasticsearch to various other storage systems

esbulk

Parallel elasticsearch bulk indexing utility for the command line

elasticdump

tools for moving and saving indices

elasticsearch-loader

Tool for loading common file types to elasticsearch including csv, json, and parquet

Esctl

High-level command line interface to manage Elasticsearch clusters

Vulcanizer

Github's open sourced cluster management library based on Elasticsearch's REST API. Comes with a high level CLI tool

sscarduzio/elasticsearch-readonlyrest-plugin

Safely expose Elasticsearch REST API directly to the public

mobz/elasticsearch-head

is a powerful and essential plugin for managing your cluster, indices and mapping

Live charts and statistics for elasticsearch cluster

Elasticsearch cluster management console with live monitoring and beautiful UI

Cerebro

is an open source(MIT License) elasticsearch web admin tool. Supports ES 5.x

Kopf

Another management plugin that have REST console and shard allocation

Search Guard

Elasticsearch and elastic stack security and alerting for free

ee-outliers

ee-outliers is a framework to detect outliers in events stored in an Elasticsearch cluster

Elasticsearch Comrade

Elasticsearch admin panel built for ops and monitoring

elasticsearch-admin

Web administration for Elasticsearch

SIREn Join Plugin for Elasticsearch

This plugin extends Elasticsearch with new search actions and a filter query parser that enables to perform a "Filter Join" between two set of documents (in the same index or in different indexes)

NLPchina/elasticsearch-sql

Query elasticsearch using familiar SQL syntax. You can also use ES functions in SQL

elastic/elasticsearch-hadoop

Elasticsearch real-time search and analytics natively integrated with Hadoop (and Hive)

jprante/elasticsearch-jdbc

JDBC importer for Elasticsearch

pandasticsearch

An Elasticsearch client exposing DataFrame API

monstache

Go daemon that syncs MongoDB to Elasticsearch in near realtime

jprante/elasticsearch-plugin-bundle

A plugin that consists of a compilation of useful Elasticsearch plugins related to indexing and searching documents

elastic/timelion

time-series analyses application. Overview and installation guide: Timelion:

Kibana Alert App for Elasticsearch

Kibana plugin with monitoring, alerting and reporting capabilities

VulnWhisperer

VulnWhisperer is a vulnerability data and report aggregator

Wazuh Kibana App

A Kibana app for working with data generated by

Datasweet Formula

A real time calculated metric plugin

nbs-system/mapster

a visualization which allows to create live event 3d maps in Kibana

Kibana Tag Cloud Plugin

tag cloud visualization plugin based on d3-cloud plugin

LogTrail

a plugin for Kibana to view, analyze, search and tail log events from multiple hosts in realtime with devops friendly interface inspired by Papertrail

Analyze API

Kibana 6 application to manipulate the API graphically

kbn_network

This is a plugin developed for Kibana that displays a network node that link two fields that have been previously selected

does not fit well into this category, but worth checking out!

everything you need to now when you are creating your first Elasticsearch+Logstash+Kibana instance

dwyl/learn-elasticsearch

a getting started tutorial with a pack of valuable references

demonstrates how you can build Elasticsearch + Logstash + Kibana stack to collect and discover your data

liveVideo course that teaches you to search, analyze, and visualize big data on a cluster with Elasticsearch, Logstash, Beats, Kibana, and more

with NGINX, LDAP and SSL

Useful Elasticsearch guides with best practices, troubleshooting instructions for errors, tips, examples of code snippets and more

PDF Comparison of JVM GC

Fine tunine your garbage collector

To tune and troubleshoot G1 GC enabled JVMs, one must have a proper understanding of G1 GC log format. This article walks through key things that one should know about the G1 GC log format

and not only for Azure. That's a great article about Elasticsearch Performance testing by example

when you plan to index large amounts of data in Elasticsearch (by Patrick Peschlow)

Elasticsearch configuration tips and tricks from Sanity

by Joseph Lynch @yelp

topology, separate master, data and search balancers nodes

Elasticsearch on Azure Guidance

it is 10% on Azure and 90% of a very valuable general information, tips and tricks about Elasticsearch

and typical use cases

by engineeringblog.yelp.com

by engineeringblog.yelp.com

by Felix Barnsteiner

By Colin Goodheart-Smithe

Shewhart Control Charts via Moving Averages: - by Zachary Tong

Implementing a Statistical Anomaly Detector: - - by Zachary Tong

( ) by Emmanuel Benazera

( ) by Kunihiko Kido

Elasticsearch, Kafka, Apache Spark, Redhsift, other AWS services

using AWS

Streaming Search on Tweets: Storm, Elasticsearch, and Redis

Graylog2/graylog2-server

Free and open source log management (based on ES)

logiq

Simple WebUI Monitoring Tool for Logstash ver. 5.0 and up

An ElasticSearch plugin to return query results as either PDF,HTML or CSV

explanations of Elasticsearch terminology, including examples, common best practices and troubleshooting guides for various issues

by Sematext Developers

a beginner overview

introduction + basic performance optimization

this course will introduce users to Elasticsearch, how it works, and how to use it with .NET projects

Comprehensive guide to Elasticsearch, the popular search engine built on Apache Lucene

2019 by Philipp Krenn (Elastic) optimization tips and tricks

and

O'Reilly Media

by Nick Pentreath & Jean-François Puget

reyjrar/elasticsearch.yml

chenryn/ESPL - Elastic Search Processing Language

PEG parser sample for SPL to Elasticsearch DSL

thomaspatzke/EQUEL

an Elasticsearch QUEry Language, based on G4 grammar parser