QA

Before a CIAO release can be created, a series of high level tests will run on the latest commit of the master branch to ensure that the main functionality of the CIAO project works correctly. As we are an agnostic OS project, the tests must run in at least two different Operating systems: Clear Linux and Ubuntu. Three nodes cluster well be used to execute these tests and we will cover the next high level scenarios:

Cluster Setup

• Verify certificates creation with ciao-cert
• Verify cluster is up and running

Compute service

• Launch instances (VMs and docker containers) with different tenants
• Verify instances are up and running
• Stop running instances
• Restart stopped instances
• Delete instances

Network

• Verify CNCIs are being created per tenant
• Connect via ssh to the instances through the CNCI
• Connect via ssh to the instances through the compute hosts
• Verify that instances from different tenants are in different subnets
• Instances from the same tenant can communicate to each other
• Verify that instances belonging to different tenants cannot communicate

CLI

• Get cluster status
• List compute nodes
• List tenants
• Get available workloads of each tenant
• List tenant resources per tenant
• List quotas per tenant
• List created instances per tenant
• List created instances per compute node

The result of the tests should be documented in the release notes of each CIAO version. If a test fails, the release process will not continue and a github issue should be opened to track the failure. Tests may change as new features, fixes or changes are added to the CIAO project.