[e2e] Support to provide e2e testing configuration #752
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR introduces the possibility to set e2e testing configuration that makes e2e testing more flexible:
upgrade
flag to mark that the cluster upgrade should be testedConfig format
Config is a map where keys are the supported provider names: aws, azure, vsphere and values are the array of cluster testing configurations
If the config is unset, it'll be populated with defaults. If the config is not empty but some of the providers are missing, its deployment will be skipped. If the provider is defined but the provider config is empty, this config will be populated with default (see examples section).
The cluster name will have a postfix with an array index to ensure uniqueness.
Config Examples
Run tests with the default configuration (config is empty)
Run tests on the AWS provider only with the default configuration
Deploy AWS managed cluster with
aws-standalone-cp-0-0-3
templateDeploy Azure managed cluster with
azure-standalone-cp-0-0-3
template and hosted managed cluster withazure-hosted-cp-0-0-3
Deploy 2 Vsphere managed clusters, one single cluster with the
vsphere-standalone-cp-0-0-2
template and another with thevsphere-standalone-cp-0-0-3
template and the hosted cluster on it.Deploy Azure managed cluster with the
azure-standalone-cp-0-0-2
template and hosted managed cluster with theazure-hosted-cp-0-0-2
then upgrade clusters to the newer templates (upgrade template for the standalone cluster will be selected automatically).Code updates
MANAGED_CLUSTER_NAME -> MANAGED_CLUSTER_PREFIX
in the github build actionsOut of scope
Closes #641