Febbweiss/febbweiss.github.io
1
0
Fork 0
mirror of https://github.com/Febbweiss/febbweiss.github.io.git synced 2026-03-05 06:35:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

Feature: update docs for log centralizer project

Browse Source
This commit is contained in:
Febbweiss
2017-05-24 15:40:11 +02:00
parent e2277667c5
commit 6d8d52a934
20 changed files with 489 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files

20
docker/docker_log_centralizer/index.html
View File

@@ -130,6 +130,13 @@
<li class="toctree-l1 ">
<a class="" href="../docker_java_log_generator/">Docker java log generator</a>
</li>
<li class="toctree-l1 current">
<a class="current" href="./">Docker log centralizer</a>
@@ -231,9 +238,10 @@
<h1 id="docker-log-centralizer">Docker log centralizer</h1>
<p>This a end-to-end log centralizer powered by the ELK stask.</p>
<h2 id="embedded-containers">Embedded containers</h2>
<ol>
<ul>
<li><a href="https://www.elastic.co/products/beats/filebeat">Filebeat</a> - An agent to poll logs</li>
<li><a href="https://github.com/elastic/logstash-forwarder">Logstash-Forwarder</a> - An other agent to poll logs</li>
<li><a href="http://www.rsyslog.com/">rsyslog</a> - A standard Linux log manager</li>
<li><a href="https://www.elastic.co/products/logstash">Logstash</a> - The collector / analyzer / parser solution</li>
<li><a href="http://kafka.apache.org">Kafka</a> - The queueing solution for logs</li>
<li><a href="https://zookeeper.apache.org/">ZooKeeper</a> - The cluster on which Kafka is running</li>
@@ -241,13 +249,15 @@
<li><a href="https://www.elastic.co/products/kibana">Kibana</a> - The visualization / dashboard tool for ElasticSearch</li>
<li><a href="https://github.com/yahoo/kafka-manager">Kafka Manager</a> - The Kafka cluster web manager</li>
<li><a href="https://github.com/Febbweiss/docker-apache-log-generator">Apache log generator</a> - A container generating fake apache logs</li>
<li><a href="https://hub.docker.com/r/davidmccormick/random_log_generator">Random log generator</a> - A container genrating text logs (Star Wars quotes)</li>
</ol>
<li><a href="https://hub.docker.com/r/davidmccormick/random_log_generator">Random log generator</a> - A container generating text logs (Star Wars quotes)</li>
<li><a href="https://github.com/Febbweiss/docker-java-log-generator">Java log generator</a> - A container generating Java logs (with exception stack trace)</li>
</ul>
<h2 id="how-it-works">How it works</h2>
<p>There are 2 agent types :</p>
<ul>
<li>Filebeat</li>
<li>Logstash-Forward</li>
<li>rsyslog</li>
</ul>
<p>These agents push logs (from the apache and random generators) to a Logstasth shipper filling a Kafka queue (one type of log for one topic).
A Logstash indexer polls the Kafka topics indexing logs into a ElasticSearch.</p>
@@ -273,7 +283,7 @@ Kafka Manager is available at http://localhost:9000</p>
<a href="../../games/Space_invaders_stories/" class="btn btn-neutral float-right" title="Space invaders stories">Next <span class="icon icon-circle-arrow-right"></span></a>
<a href="../docker_gocd/" class="btn btn-neutral" title="Docker gocd"><span class="icon icon-circle-arrow-left"></span> Previous</a>
<a href="../docker_java_log_generator/" class="btn btn-neutral" title="Docker java log generator"><span class="icon icon-circle-arrow-left"></span> Previous</a>
</div>
@@ -301,7 +311,7 @@ Kafka Manager is available at http://localhost:9000</p>
<a href="https://github.com/febbweiss/" class="icon icon-github" style="float: left; color: #fcfcfc"> GitHub</a>
<span><a href="../docker_gocd/" style="color: #fcfcfc;">&laquo; Previous</a></span>
<span><a href="../docker_java_log_generator/" style="color: #fcfcfc;">&laquo; Previous</a></span>
<span style="margin-left: 15px"><a href="../../games/Space_invaders_stories/" style="color: #fcfcfc">Next &raquo;</a></span>