mirror of
https://github.com/Febbweiss/febbweiss.github.io.git
synced 2026-03-05 06:35:50 +00:00
Initial commit
This commit is contained in:
ECAILLE Fabrice (externe)
34
docs/docker/docker_apache_log_generator.md
Normal file
34
docs/docker/docker_apache_log_generator.md
Normal file
@@ -0,0 +1,34 @@
|
||||
#Docker Apache log generator
|
||||
This is a simple Docker container to provide random apache logs.
|
||||
It's based on [Fake-Apache-Log-Generator](https://github.com/kiritbasu/Fake-Apache-Log-Generator)
|
||||
|
||||
The default behaviour is the following :
|
||||
```sql
|
||||
python apache-fake-log-gen.py -o LOG -p /var/log/apache/apache -n 0 -s 3
|
||||
```
|
||||
The endless generated file is located in /var/log and a line is appended every 3 seconds.
|
||||
|
||||
##Timezone
|
||||
|
||||
You can change the timezone mounting */etc/timezone* and */etc/localtime* files with a file content such as :
|
||||
```shell
|
||||
Europe/Paris
|
||||
```
|
||||
|
||||
|
||||
##Licences
|
||||
|
||||
Copyright (c) 2017 Fabrice ECAILLE aka Febbweiss
|
||||
|
||||
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
|
||||
|
||||
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
|
||||
|
||||
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
|
||||
|
||||
|
||||
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/github-fork-ribbon-css/0.2.0/gh-fork-ribbon.min.css" />
|
||||
<!--[if lt IE 9]>
|
||||
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/github-fork-ribbon-css/0.2.0/gh-fork-ribbon.ie.min.css" />
|
||||
<![endif]-->
|
||||
<a class="github-fork-ribbon" href="https://github.com/Febbweiss/docker-apache-log-generator" target="_blank" title="Fork me on GitHub">Fork me on GitHub</a>
|
||||
23
docs/docker/docker_gocd.md
Normal file
23
docs/docker/docker_gocd.md
Normal file
@@ -0,0 +1,23 @@
|
||||
#Docker GoCD
|
||||
GoCD is a Continuous Delivery solution. This project embedded different containers such as a server and nodes.
|
||||
|
||||
##Embedded containers
|
||||
|
||||
1. [GoCD server](https://github.com/Febbweiss/gocd-docker/tree/master/gocd-server) - The main container based on Debian image
|
||||
2. [Cloudfoundry agent](https://github.com/Febbweiss/gocd-docker/tree/master/gocd-agent-cloudfoundry) - A node to deploy on CloudFoundry based on alpine image
|
||||
3. [Docker agent](https://github.com/Febbweiss/gocd-docker/tree/master/gocd-agent-docker) - A node to build and deploy Docker containers based on docker image
|
||||
4. [Java agent](https://github.com/Febbweiss/gocd-docker/tree/master/gocd-agent-jdk8) - A node to manage Java applications (compile / build) based on alpine-oraclejdk8 image
|
||||
5. [NodeJS agent](https://github.com/Febbweiss/gocd-docker/tree/master/gocd-agent-nodejs) - A node to manage NodeJS applications (compile / build) based on Debian image
|
||||
6. [Generic agent](https://github.com/Febbweiss/gocd-docker/tree/master/gocd-agent) - A node providing Java and NodeJS applications management based on Node image
|
||||
|
||||
##Usage
|
||||
The full stack is manage with docker-compose. So, to launch it, just use
|
||||
```
|
||||
docker-compose up
|
||||
```
|
||||
|
||||
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/github-fork-ribbon-css/0.2.0/gh-fork-ribbon.min.css" />
|
||||
<!--[if lt IE 9]>
|
||||
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/github-fork-ribbon-css/0.2.0/gh-fork-ribbon.ie.min.css" />
|
||||
<![endif]-->
|
||||
<a class="github-fork-ribbon" href="https://github.com/Febbweiss/gocd-docker" target="_blank" title="Fork me on GitHub">Fork me on GitHub</a>
|
||||
41
docs/docker/docker_log_centralizer.md
Normal file
41
docs/docker/docker_log_centralizer.md
Normal file
@@ -0,0 +1,41 @@
|
||||
#Docker log centralizer
|
||||
This a end-to-end log centralizer powered by the ELK stask.
|
||||
|
||||
##Embedded containers
|
||||
|
||||
1. [Filebeat](https://www.elastic.co/products/beats/filebeat) - An agent to poll logs
|
||||
2. [Logstash-Forwarder](https://github.com/elastic/logstash-forwarder) - An other agent to poll logs
|
||||
3. [Logstash](https://www.elastic.co/products/logstash) - The collector / analyzer / parser solution
|
||||
4. [Kafka](http://kafka.apache.org) - The queueing solution for logs
|
||||
5. [ZooKeeper](https://zookeeper.apache.org/) - The cluster on which Kafka is running
|
||||
6. [ElasticSearch](https://www.elastic.co/products/elasticsearch) - The indexing engine
|
||||
7. [Kibana](https://www.elastic.co/products/kibana) - The visualization / dashboard tool for ElasticSearch
|
||||
8. [Kafka Manager](https://github.com/yahoo/kafka-manager) - The Kafka cluster web manager
|
||||
9. [Apache log generator](https://github.com/Febbweiss/docker-apache-log-generator) - A container generating fake apache logs
|
||||
10. [Random log generator](https://hub.docker.com/r/davidmccormick/random_log_generator) - A container genrating text logs (Star Wars quotes)
|
||||
|
||||
##How it works
|
||||
|
||||
There are 2 agent types :
|
||||
|
||||
- Filebeat
|
||||
- Logstash-Forward
|
||||
|
||||
These agents push logs (from the apache and random generators) to a Logstasth shipper filling a Kafka queue (one type of log for one topic).
|
||||
A Logstash indexer polls the Kafka topics indexing logs into a ElasticSearch.
|
||||
|
||||
A short schema :
|
||||
```
|
||||
Agent -> Logstach shipper -> Kafka <- Logstash indexer -> ElasticSearch
|
||||
```
|
||||
|
||||
##Tools access
|
||||
|
||||
Kibana is available at http://localhost:5601.
|
||||
Kafka Manager is available at http://localhost:9000
|
||||
|
||||
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/github-fork-ribbon-css/0.2.0/gh-fork-ribbon.min.css" />
|
||||
<!--[if lt IE 9]>
|
||||
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/github-fork-ribbon-css/0.2.0/gh-fork-ribbon.ie.min.css" />
|
||||
<![endif]-->
|
||||
<a class="github-fork-ribbon" href="https://github.com/Febbweiss/docker-log-centralizer" target="_blank" title="Fork me on GitHub">Fork me on GitHub</a>
|
||||
Reference in New Issue
Block a user