README

Create a Ubuntu VM in Openstack to run diskimage-builder

Create your config file:

cp vars.yaml.template vars.yaml

and edit the vars.yaml file:

vmname: images-builder-ansible
image: Ubuntu Trusty 14.04 (SWITCHengines)
flavor: m1.xlarge
key_name: YOUR_KEY_NAME
net_name: private
ansible_user: ubuntu

Source your user OpenStack credentials:

source ~/.openrc-user

Run the playbook

export ANSIBLE_HOST_KEY_CHECKING=False
ansible-playbook main.yaml

This will create an image builder VM, with all the required packages installed and configured.

Build the images

Now you can login to the instance and use the script to build all the images:

./SWITCHengines-create-images.sh

Or you can build single distros using the -d DISTRO option, like:

./SWITCHengines-create-images.sh -d ubuntu -d centos7

The distro names are defined in the distrosInfo file:

Distro Name	Release	Raw File
centos7	Centos 7	centos7.raw
ubuntu	Ubuntu 14.04	ubuntu.raw
ubuntuxenial	Ubuntu 16.04	ubuntuxenial.raw
debianJessie	Debian 8	debianJessie.raw
debianStretch	Debian 9	debianStretch.raw
fedora	Fedora 22	fedora.raw
rstudio	RStudio Appliance	rstudio.raw
zeppelin	Spark Zeppelin	zeppelin.raw

You can check the progress of the script with the logfiles produced in the /tmp folder.

When everything is okay, you will find the images in /usr/share/nginx/html/images/.

The images are served with nginx over http at the URL http://ip.domain/images/

Upload the images to Glance

IMPORTANT: You will need an OpenStack admin openrc file to run this tool.

Use the tool to upload the new created images to glance. To upload all the images in both region (S1/S2 or LS/ZH) use:

source ~/.openrc-s2-admin
./SWITCHengines-images-uploader.py -v --all-regions

Or to upload some selected distros use the -d DISTRO option, like:

./SWITCHengines-images-uploader.py  -v --all-regions -d ubuntu_trusty -d ubuntu_xenial

The distro names are defined in the distrosInfo.py file:

Distro Name	Release	Raw File	SWITCHengines Image
centos_7	Centos 7	centos7.raw	CentOS 7 (SWITCHengines)
ubuntu_trusty	Ubuntu 14.04	ubuntu.raw	Ubuntu Trusty 14.04 (SWITCHengines)
ubuntu_xenial	Ubuntu 16.04	ubuntuxenial.raw	Ubuntu Xenial 16.04 (SWITCHengines)
debian_jessie	Debian 8	debianJessie.raw	Debian Jessie 8 (SWITCHengines)
debian_stretch	Debian 9	debianStretch.raw	Debian Stretch 9 (SWITCHengines)
fedora	Fedora 25	fedora.raw	Fedora release 25 (SWITCHengines)
rstudio	RStudio Appliance	rstudio.raw	RStudio Appliance (SWITCHengines)
zeppelin	Spark Zeppelin	zeppelin.raw	Spark Zeppelin (SWITCHengines)

The new images will be uploaded as public.

This tool is meant to refresh existing images. It will change the name of old version of the images already present, and make them private. The archived images will have in the name the timestamp of when they were initally created.

The users will not be able to start new VMs using the old images.
However note that old images cannot be deleted from Glance, because there are possibly Cinder volumes and Nova ephemeral volumes depending on the old Glance images. This is a consequence of the CoW features of RBD.

Upload the images to the HTTP images repository

When an image has been built, it should also be copied (e.g. using scp) to the HTTP images archive on http://images.cloud.switch.ch/, corresponding to /var/www/html/engines/images on images.cloud.switch.ch alias ubuntu.mirror.cloud.switch.ch.

today=`date +%Y-%m-%d`
ssh ubuntu.mirror.cloud.switch.ch "mkdir /engines-repo/engines/images/$today/"
scp /usr/share/nginx/html/images/*.raw ubuntu.mirror.cloud.switch.ch:/engines-repo/engines/images/$today/

Testing images

Before upgrading to production you can manually make these checks running the images privately on your tenant.

login with ssh

• Ubuntu: ssh ubuntu@<FLOATING_IP>
• Debian: ssh debian@<FLOATING_IP>
• Centos: ssh centos@<FLOATING_IP>
• Fedora: ssh fedora@<FLOATING_IP>

check common commands

hostname
sudo su
init 6

Also check the hostname on the console. Can also be checked via ssh with: cat /dev/vcs1

Check the file /etc/apt/sources.list

• correct Release
• security repo enabled
• mirrors in Switzerland
• Automatic Security Updates enabled?

In the file /etc/apt/apt.conf.d/20auto-upgrades

APT::Periodic::Update-Package-Lists "1";
APT::Periodic::Unattended-Upgrade "1";

Can also be checked with something like:

apt-config dump | grep Periodic

In file /etc/ntp.conf, the pool should be in Switzerland

ntpq -p

check the Zeppelin installation in browser

(the TCP port 8080 must be open)

http://FLOATING_IP:8080