You are here

scalable log storage and analysis at PLUG

This Thursday Kibana creator Rashid Khan will talk scalable log storage and analysis at PLUG. His talk will cover patterns for log shipping, the problems in traditional centralized log storage, as well as issues with syslog shipping overall. We'll explore the options in the open source space, and define a stack that can be gradually merged into a legacy syslog network, with further optimizations as we later spin down the legacy redundant logging infrastructure.

Rashid is a data geek, a developer and a recovering operations addict. He's currently a developer at Elasticsearch. However, he spent the last 10 years in operations writing tools to make his life easier. Every now and then one of those tools is useful enough that he should publish it.

Kibana is the thing he wrote to get around the fact that he couldn't afford exorbitantly expensive commercial log analysis. he originally wrote it to work with a fantastic log pipeline called Logstash, which stores events in Elasticsearch.

I have strongly recommended to my students that they attend the talk and asked other instrutors to make the same recommendation.

I also recommend it for anyone else interested in scalability.

PLUG east side meetings start at 19:00 on the second Thursday of the month.

Desert Breeze Substation: 251 North Desert Breeze Blvd, Chandler, AZ 85226

G+ calendar invite

PLUG meeting entry