igefimov_microservices

igefimov microservices repository

Lesson 15. Homework

Технология контейнеризации. Введение в Docker

git branch: docker-2

Problems 😅

docker-machine create --driver google --google-machine-image https://www.googleapis.com/compute/v1/projects/ubuntuos-cloud/global/images/family/ubuntu-1604-lts --google-machine-type n1-standard-1 --google-zone europe-west1-a docker-host Running pre-create checks... (docker-host) Check that the project exists Error with pre-create check: "Project with ID "788736709048" not found. googleapi: Error 403: Access Not Configured. Compute Engine API has not been used in project 788736709048 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/compute.googleapis.com/overview?project=788736709048 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured"

Solution: Need to enable API first. Follow https://console.developers.google.com/apis/api/compute.googleapis .com/overview?project=

Notes:

• Container has two PIDs: 1 external(on the host where container is running) and 1 internal(PID=1) Each container has its own hostname. How to find it:

  1. running hostname from container
  2. running docker container ls from host where is container started

• Good pRACTICE: start container instance not from root user

• We can manage host processes from container if we use: docker run --rm --pid host

Docker-machine We can run our docker containers on the remote hosts in GCP using docker-machine command

• docker-machine create <host_name> - create hosts
• eval $(docker-machine env <host_name>) - set the host active. From now on all docker commands will be executed on the remote host
• eval $(docker-machine env --unset) - Switch to local docker

Example:

• export GOOGLE_PROJECT=docker-248711
• docker-machine create --driver google
  --google-machine-image https://www.googleapis .com/compute/v1/projects/ubunt-uos-cloud/global/images/family/ubuntu-1604-lts
  --google-machine-type n1-standard-1
  --google-zone europe-west1-b
  docker-host

Extra task ⭐

• Create image with pre-installed Docker using packer
• Spin on few instances using terraform. Number of instances should be regulated by variable
• Create Ansible playbook with dynamic inventory to install python docker SDK and run there application

Lesson 16. Homework

Docker-образы. Микросервисы

• Install linter for docker: brew install hadolint
• Prepared 3 diff Dockerfiles for 3 microservices

Problems 😅

docker build -t igefimov/post:1.0 ./post-py

was failing with

error: command 'gcc' failed with exit status 1

Solution: added to the post-py/Dockerfile:

RUN apk add --no-cache gcc musl-dev
RUN pip install --upgrade pip && pip install -r /app/requirements.txt

Extra task ⭐

Reduced size of UI image from original 781Mb to 253Mb:

➜  src git:(docker-3) ✗ docker images | grep ui
igefimov/ui         3.0                 b19cc522053a        31 seconds ago      253MB
igefimov/ui         2.0                 277750068613        2 hours ago         451MB
igefimov/ui         1.0                 40c2ba8bf669        4 hours ago         781MB

• Created a new post in UI using <docker_host_ip>:9292
• Killed all dockers and started them again
• Post goes away 😞
• Create volume and attach it to the MongoDB container
• Create a new post, restart containers. Post is not deleted anymore!

Lesson 19. Homework

Устройство Gitlab CI. Построение процесса непрерывной поставки

• Created new VM in GCP
• Install docker there
• Run docker with Gitlab CI
• Configure Gitlab CI
• Prepare definition of pipeline in .gitlab-ci.yml
• Add one Runner to the project
• Define different envs in the pipeline
• Define limits and restrictions in the pipeline
• Define dynamic environment

Lesson 20. Homework

Введение в мониторинг.Системы мониторинга.

Important notice: before you push images to dockerhub, you should run first docker-compose down Link to my github account with all docker images saved: https://hub.docker.com/u/igefimov All the repositories are public.

• Configured Prometheus in docker
• Started Prometheus in docker
• Collecting metrics from docker host using node-exporter

Lesson 21. Homework

Мониторинг приложения и инфраструктуры.

• Put configuration for monitoring in a separate file: docker-compose-monitoring.yml

    docker-compose up -d
    docker-compose -f docker-compose-monitoring.yml up -d

• Created firewall rule for cAdvisor: gcloud compute firewall-rules create cadvisor-default --allow tcp:8080
• Later created firewall rules for all new services
• Adding Grafana running on port 3000
• Exported from Grafana Dashboard config and stored it in the repo: grafana/dashboards/{config-name}.json
• Collected business metrics
• Set up alerting using Alert Manager
• Alerting system is connected with #igor_efimov slack channel

Link to my github account with all docker images saved: https://hub.docker.com/u/igefimov

Lesson 25. Homework

Введение в Kubernetes.

• Performed installation of Kubernetes cluster described in https://github.com/express42/kubernetes-the-hard-way
• Teared down all the components