Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Graylog2 v0.9.6 released, transitions from MongoDB to ElasticSearch

graylog2.org

Post reply on HN
Print view View original

1–9 of 9 posts

Re: Graylog2 v0.9.6 released, transitions from MongoDB to ElasticSearch

#5

Post by wavetossed »

That sucks. I was looking at implementing Graylog but Elastic Search, or any other cloud datastore, is out of the question. We need to keep the logs in the same data centre as the servers for reasons of confidentiality, and for performance reasons as well. Most of the logs will never be used for anything. We log lots of stuff just in case, and after a few weeks there is no real use for them. If we wanted stats we would calculate them and then delete the logs. We certainly don't want to consume huge amounts of bandwidth shipping logs across the Internet.

At this point I'll probably just use an older version so that we have local storage and local search.

Re: Graylog2 v0.9.6 released, transitions from MongoDB to ElasticSearch

#6

Post by rbranson »

wavetossed wrote: post #5

That sucks. I was looking at implementing Graylog but Elastic Search, or any other cloud datastore, is out of the question. We need to keep the logs in the same data centre as the servers for reasons of confidentiality, and for performance reasons as well. Most of the logs will never be used for anything. We log lots of stuff just in case, and after a few weeks there is no real use for them. If we wanted stats we wou…

You must be confused. ElasticSearch stores it's documents on the local hard drive.

Re: Graylog2 v0.9.6 released, transitions from MongoDB to ElasticSearch

#7

Post by bartschuller »

wavetossed wrote: post #5

That sucks. I was looking at implementing Graylog but Elastic Search, or any other cloud datastore, is out of the question. We need to keep the logs in the same data centre as the servers for reasons of confidentiality, and for performance reasons as well. Most of the logs will never be used for anything. We log lots of stuff just in case, and after a few weeks there is no real use for them. If we wanted stats we wou…

You might want to look at http://www.elasticsearch.org/ Elastic Search is not to be confused with Elastic Compute Cloud. Elastic Search is a Lucene-based NoSQL-like search engine. You install it on your own machines.

Re: Graylog2 v0.9.6 released, transitions from MongoDB to ElasticSearch

#8

Post by Argorak »

wavetossed wrote: post #5

That sucks. I was looking at implementing Graylog but Elastic Search, or any other cloud datastore, is out of the question. We need to keep the logs in the same data centre as the servers for reasons of confidentiality, and for performance reasons as well. Most of the logs will never be used for anything. We log lots of stuff just in case, and after a few weeks there is no real use for them. If we wanted stats we wou…

Elasticsearch is not "cloud storage". It has facilities to run well on EC2, yes, but you can easily setup your own, local instance quickly on any machine. Its just a fulltext indexed store like Solr or others.
Post reply on HN