kafka + OCP and random

So we have Docker, K8 and OCP.  Quick review below.

View story at Medium.com

https://docs.google.com/presentation/d/1fDWgL26ebC8jkUxyLP4v-iw_jqiJDGnc-rCH-gzfO6w/edit#slide=id.g4b03b719b_266

https://sysdig.com/blog/understanding-how-kubernetes-services-dns-work/

Good read why Databases should not live in containers —

https://myopsblog.wordpress.com/2017/02/06/why-databases-is-not-for-containers/#comments

Software Defined Arch

All DevOps crews should publish something similar…

https://gitlab.com/gitlab-com/runbooks

Sweet A tut on InSpec – take it to Ansible

https://www.10thmagnitude.com/tech-blog/compliance-code-introduction-inspec/

http://www.anniehedgie.com/inspec-basics-1

http://rubular.com/

https://github.com/chef-training/workshops

ANSIBLE

https://www.linode.com/docs/applications/ansible/getting-started-with-ansible

https://valdhaus.co/writings/ansible-post-install/

https://code.tutsplus.com/tutorials/automate-all-the-things-with-ansible-part-one–cms-25931

https://code.tutsplus.com/tutorials/automate-all-the-things-with-ansible-part-two–cms-25940

Use the Vault please

https://serversforhackers.com/video/ansible-using-vault

Micro Services or Microservices

https://dzone.com/articles/introduction-to-microservices-part-1?utm_source=Microservices%20Bundle&utm_campaign=Monday%20Email%2B2017-02-20&utm_medium=email

https://dzone.com/articles/microservices-and-docker-at-scale?edition=268935&utm_source=Spotlight&utm_medium=email&utm_campaign=devops%202017-02-10

Spring Boot Quick Start

https://dzone.com/articles/spring-boot-a-quick-start?edition=271881&utm_source=Daily%20Digest&utm_medium=email&utm_campaign=dd%202017-02-17

Jenkins Declares

https://dzone.com/articles/announcing-general-availability-of-declarative-pip?edition=154264&utm_source=Weekly%20Digest&utm_source=Weekly%20Digest&utm_medium=email&utm_medium=email&utm_campaign=wd%202017-02-08&utm_campaign=wd%202017-02-08

https://jenkins.io/blog/2017/02/07/declarative-maven-project/

Need to collect some thoughts, links for various messaging on OCP.

Of course there is simple queues – JMS, rabbitmq, ActiveMQ

Need streaming and plugins to data sources..

Kafka —

OCP + Kafka

DEMO — https://github.com/sabre1041/fis-kafka

Deployment on OCP — https://github.com/redhat-cop/containers-quickstarts/tree/master/kafka

A potential mix – remove dcos – integrate OCP

http://www.cakesolutions.net/teamblogs/smack-stack-on-dcos

 

 

Advertisements

I Love Logging

With the MO of  “get all into splunk or else” – ran into some OCP/k8 challenges aggregating all logs to get to splunk.  Nothing native in OCP..

 

So digging around:

https://github.com/kubernetes/kubernetes/issues/24677

various options dealing with aggregation to include container logs.

 k8 logging — https://kubernetes.io/docs/user-guide/logging/overview/

OCP-EFK — https://docs.openshift.com/container-platform/3.4/install_config/aggregate_logging.html

Nice OCP Logging Overview – http://playbooks-rhtconsulting.rhcloud.com/playbooks/installation/logging.html

Have a Splunk agent on the nodes is great but doesn’t capture the container logs.  So leverage the EFK stack – where it aggregates — fluentd.

Using the fleuntd secure forward plugin (SFP) to forward EFK logs to an external fluentd which has the fluentd file output plugin which gets picked up by the Splunk forwarding agent.

Logging Roundup 

https://sematext.com/blog/2016/09/13/logstash-alternatives/

https://www.slant.co/topics/326/~best-log-aggregation-monitoring-tools