Some user-supplied configuration is overriden?

[usedUsername1]

Greetings,

I am trying to run the Alertmanager pod with two options different from the default configuration:

1. Listening on a different port instead of the default port 9094.
2. Using the local filesystem for storage.

I am really new to Kubernetes (K8s) and Cortex and haven’t worked with either of them before today.

I have tried to use some custom options using the following command:

sudo helm upgrade --version=2.4.0 --namespace cortex cortex cortex-helm/cortex -f cortex-values.yaml

I’ve attached the cortex-values.yaml file.
cortex-values.txt

The problem is that the Alertmanager pod keeps crashing (status is CrashLoopBackOff). I have deployed a debug pod and mounted the same volumes as Alertmanager in order to inspect the config file, and it looks like my user-supplied values are being overridden with the default values. I have also attached this config file.
actual-pod-config.txt

Running the Helm upgrade command with the --debug flag shows the final computed configuration values.
helm-debug.txt

Problem Details

The issue I am facing is that no matter what I do, I cannot seem to change the default Alertmanager storage value from s3 to local filesystem.

The output of the command:

sudo kubectl logs <pod-name>

kubectl-logs.txt

indicates that the reason for the pod's failure is an error trying to connect to an S3 endpoint. I have also attached this log output here.

Questions

• Is there something I am doing wrong?
• Is there something wrong with the software?

Thanks!

[nschad]

You're not actually overwriting the default values from this chart. ALL cortex-specific configuration must be under the config: key.

Example:

cortex-helm-chart/ci/test-configmap-values.yaml

Lines 6 to 24 in b24a8b6

	config:
	ingester:
	lifecycler:
	join_after: 30s
	final_sleep: 30s
	tokens_file_path: "/data/tokens"
	ring:
	replication_factor: 1
	kvstore:
	store: "memberlist"
	blocks_storage:
	backend: "filesystem"
	tsdb:
	dir: "/data/tsdb"
	bucket_store:
	sync_dir: "/data/tsdb-sync"
	filesystem:
	dir: "/data/store"

Have a look at our Values Guide

So in your file it would be

config:
  blocks_storage:
    backend: filesystem
[...]