setup_worker_docker.md

Setup Docker Host as a Worker Node

TLDR: WORKER_TYPE=docker MASTER_NODE=x.x.x.x make setup-worker

For the Worker Node with meeting the system requirements, three steps are required:

• Docker daemon setup
• Docker images pulling
• Firewall Setup

System Requirements

• Hardware: 4c8g50g
• Docker engine:
  • 1.10.0~1.18.6

Docker Daemon Setup

Let Docker daemon listen on port 2375, and make sure Master can reach Worker Node through this port.

Ubuntu 18.04

Edit systemd service config file /lib/systemd/system/docker.service, update the ExecStart line under section [Service], as the following:

[Service]
ExecStart=/usr/bin/dockerd -H fd:// -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2375 --default-ulimit=nofile=8192:16384 --default-ulimit=nproc=8192:16384

Ubuntu 16.04

Edit systemd service config file usr/lib/systemd/system/docker.service, update the ExecStart line under section [Service], as the following:

[Service]
ExecStart=/usr/bin/dockerd -H fd:// -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2375 --default-ulimit=nofile=8192:16384 --default-ulimit=nproc=8192:16384

Regenerate the docker service script and restart the docker engine:

$ sudo systemctl daemon-reload; sudo systemctl restart docker.service

Alternatively (for all Linux distro):

This will run the docker-daemon on port 2375 as long as the system is restarted or docker-daemon is killed.

$ sudo systemctl stop docker.service
$ sudo dockerd -H fd:// -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2375 --default-ulimit=nofile=8192:16384 --default-ulimit=nproc=8192:16384 -D &

At last, run the follow test at Master node and get OK response, to make sure it can access the Worker node successfully.

[Master] $ docker -H Worker_Node_IP:2375 info

Setup

Run the following cmd to pull the necessary images and copy required artifacts.

$ MASTER_NODE=xx.xx.xx.xx make setup-worker

Firewall Setup

Make sure ip forward is enabled, you can simply run the follow command.

$ sysctl -w net.ipv4.ip_forward=1

And check the os iptables config, to make sure host ports are open (e.g., 2375, 7050~10000)

Work with MacOS

In MacOS, Docker currently provides no support to config the daemon to listen from network.

Users need to use some tools to config Docker daemon to listen at network manually, e.g., to config Docker daemon to listen on 127.0.0.1:2375,

$ docker run -d -v /var/run/docker.sock:/var/run/docker.sock -p 127.0.0.1:2375:2375 bobrik/socat TCP-LISTEN:2375,fork UNIX-CONNECT:/var/run/docker.sock
$ docker -H 127.0.0.1:2375 info

And users can use 0.0.0.0 to replace 127.0.0.1 to make sure Master can reach Worker Node through this port, as Ubuntu.

$ docker run -d -v /var/run/docker.sock:/var/run/docker.sock -p 0.0.0.0:2375:2375 bobrik/socat TCP-LISTEN:2375,fork UNIX-CONNECT:/var/run/docker.sock

This work is licensed under a Creative Commons Attribution 4.0 International License.