dockerd启动配置_修改IP和systemd管理

Posted 2021-10-28 embedded-linux

docker采用CS架构，dockerd是管理后台进程，默认的配置文件为/etc/docker/daemon.json（--config-file可以指定非默认位置）。

一个完整的daemon.json示例参考：https://docs.docker.com/engine/reference/commandline/dockerd//#daemon-configuration-file。

通过此文件可修改docker0的默认IP及bridge（Customize the docker0 bridge）：

{
  "bip": "192.168.1.5/24",
  "fixed-cidr": "192.168.1.5/25",
  "fixed-cidr-v6": "2001:db8::/64",
  "mtu": 1500,
  "default-gateway": "10.20.1.1",
  "default-gateway-v6": "2001:db8:abcd::89",
  "dns": ["10.20.1.2","10.20.1.3"]
}

几乎可以通过daemon.json配置所有docker daemon特性， 除了HTTP proxy。

HTTP/HTTPS proxy

The Docker daemon uses the HTTP_PROXY, HTTPS_PROXY, and NO_PROXY environmental variables in its start-up environment to configure HTTP or HTTPS proxy behavior. You cannot configure these environment variables using the daemon.json file.

Proxy相关配置参考：https://docs.docker.com/config/daemon/systemd/

systemd管理

一般dockerd启动采用systemd管理：

[Service]
ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

其中-H fd://如何理解呢？

When you start the Docker daemon, -H fd:// will tell Docker that the service is being started by Systemd and will use socket activation. systemd will then create the target socket and pass it to the Docker daemon to use. This is described in introduction to Systemd and in introduction to socket activation. The blogs are pretty long but really worth reading, here‘s a short summary of key points for understanding this question:

• Systemd is a new init system intended to replace traditional SysV init system. One of its key features is faster init process.
• Socket activation is one of the technologies used in Systemd to speed up service initialization
• To receive requests, the service needs a socket to listen on. Take Docker as an example, it needs a unix domain socket like /var/run/docker.sock or a TCP socket. Of course these sockets needs something to create them and most of the time it is the service itself at start time.
• With socket activation, SystemD will create these sockets and listen to them for services, and pass these sockets to service with exec when the service is started. One benefit is that client requests can be queued in the socket buffer once the socket is successfully created, even before the related service is started.
• The socket info for a certain service used by Systemd is in socket unit file, for Docker it‘s [docker.socket][3] with content:

[Unit]
Description=Docker Socket for the API
PartOf=docker.service

[Socket]
ListenStream=/var/run/docker.sock
SocketMode=0660
SocketUser=root
SocketGroup=docker

[Install]
WantedBy=sockets.target

Let‘s see how the whole thing works. I have the files docker.socket and docker.service under /etc/systemd/system. The ExecStart line for docker.service is:

ExecStart=/usr/bin/dockerd -H fd://

1）Stop Docker service: systemctl stop docker

$> ps aux | grep ‘docker‘ # the `grep` itself in the output is ignored
$> lsof -Ua | grep ‘docker‘
$>

No docker process is running, and no docker.sock

2）Execute systemctl start docker.socket:

$> systemctl start docker.socket
$> ps aux | grep ‘docker‘ 
$> lsof -Ua | grep ‘docker‘
systemd       1    root   27u  unix 0xffff880036da6000      0t0 140748188 /var/run/docker.sock

After start docker.socket, we can see that there‘s still no docker process running, but the socket /var/run/docker.sock has been created, and it belongs to the process systemd.

(Off-Topic: Actually the socket is ready to receive requests now, even though docker is not running yet. systemd will start docker.service at the moment the first request comes, passing the already created sockets to Docker. This is so-called on-demand auto-spawning)

3）Start docker.service

$> systemctl start docker.service
$> ps aux | grep ‘docker‘
root     26302  0.0  1.8 431036 38712 ?        Ssl  14:57   0:00 /usr/bin/dockerd -H fd://
<....>

As you can tell Docker is now running. Let‘s go one step back and try to execute /usr/bin/dockerd -H fd:// manually from terminal:

$> /usr/bin/dockerd -H fd://
FATA[0000] no sockets found via socket activation: make sure the service was started by systemd

Now you see the difference; when you use -H fd://, docker will expect the socket to be passed by its parent process rather than creating it by itself. When it‘s started by Systemd, Systemd will do the job, but when you manually start it on terminal, you don‘t do the job so the docker daemon process failed and aborted. This is the code of how docker process fd:// when docker daemon starts, you can have a look if you‘re interested.

 

参考：

1． https://stackoverflow.com/questions/43303507/what-does-fd-mean-exactly-in-dockerd-h-fd

2． https://docs.docker.com/engine/reference/commandline/dockerd//#daemon-configuration-file

3． https://docs.docker.com/config/daemon/systemd/

4.  Docker 如何自定义默认网桥 docker0