How to manually update the retention policy of an index (Quickwit 0.8)

[guilload]

There is no API to do so in Quickwit 0.8.

[guilload]

The API for updating the retention policy will be available in Quickwit 0.9. For versions 0.8 and below, you can manually update the retention policy by editing the metastore file (if using a file-backed metastore) or running a SQL query (if using PostgreSQL).

File-backed metastore

1. Stop the metastore instance.
2. Locate the metastore file for your index at <metastore URI>/<index ID>/metastore.json.
3. Open the file in a text editor and find the index.index_config.retention section.
4. Set the period to the desired retention duration.
5. If the retention object is missing or set to null, you can create it with the following structure:

"retention": {
  "period": "30 days",
  "schedule": "daily"
}

6. Save the file and restart the metastore instance to apply the changes.

PostgreSQL

Simply run this SQL query with your desired retention settings, and the janitor will apply the changes within the next 10 minutes.

UPDATE indexes
SET index_metadata_json = jsonb_set(
    index_metadata_json::jsonb,
    '{index_config,retention}',
    '{"period": "30 days", "schedule": "daily"}'::jsonb,
    true
)::text
WHERE indexes.index_id = '<index ID>'
;

[xrl]

Is it possible to set the retention of automatic indexes like otel-logs-v0_7 from the root config file?

[guilload]

No, not at the moment.