wtf is elasticsearch?

elasticsearch is the back-end used in the centralized logging getting started tutorial on the logstash.net site.

So from the front page blurb.. "It is an Open Source (Apache 2), Distributed, RESTful, Search Engine built on top of Apache Lucene. "

Basically you chuck JSON data into elasticsearch, and use lucene queries, or some JSON dsl to request data back. Its all RESTful, so you can look at the stuff in a browser;
http://localhost:9200

or you can use wget or curl, as you prefer...

curl -XGET http://localhost:9200/twitter/tweet/2

I was a little perplexed by all the multicast fuckery that I was getting when trying to use the non-embedded version of elasticsearch shipped with logstash, but now I have read the docs, I can see why the clustering makes sense.

# ElasticSearch, by default, binds itself to the 0.0.0.0 address, and listens
# on port [9200-9300] for HTTP traffic and on port [9300-9400] for node-to-node
# communication. (the range means that if the port is busy, it will automatically
# try the next port).


Persistence and data
elasticsearch uses the notion of a gateway.
http://www.elasticsearch.org/guide/reference/setup/dir-layout.html
By default elastic search has persistence of data and indexes (??) under the elasticsearch/data/ dir of the unpacked logstash


elastic search uses 9200+ for httpd and 9300+ for rcp..?




rabbitmq-server manager
http://opencirrus-g0803.hpl.hp.com:55672/#/




over riding the JAVA_OPTS
http://www.elasticsearch.org/guide/reference/setup/installation.html



elasticsearch front ends
https://github.com/mobz/elasticsearch-head
This is super cool, whether it is any us, is another question. The install was super easy- elasticsearch/bin/plugin -install mobz/elasticsearch-head

https://github.com/lukas-vlcek/bigdesk


java service wrapper
http://wrapper.tanukisoftware.com/doc/english/download.jsp


service wrapper on github
https://github.com/elasticsearch/elasticsearch-servicewrapper


elasticsearch rpm spec files
https://github.com/tavisto/elasticsearch-rpms

elastic search chef cookbook
http://community.opscode.com/cookbooks/elasticsearch