Trouble deploying with minio ObjectStorage

[arthurzenika]

With a new deployement, when I upload a test video, it ends up in the PV named peertube-data

I have :

root@peertube-675fc6c68d-t5gwn:/app# cat config/default.yaml  | grep -A 2 object 
object_storage:
  enabled: false

root@peertube-675fc6c68d-t5gwn:/app# env  | grep AW
AWS_SECRET_ACCESS_KEY=XXX
AWS_ACCESS_KEY_ID=peertube
root@peertube-675fc6c68d-t5gwn:/app# env  | grep OBJ
PEERTUBE_OBJECT_STORAGE_VIDEOS_BUCKET_NAME=peertube
PEERTUBE_OBJECT_STORAGE_REGION=NA
PEERTUBE_OBJECT_STORAGE_ENABLED=true
PEERTUBE_OBJECT_STORAGE_STREAMING_PLAYLISTS_PREFIX=streaming/
PEERTUBE_OBJECT_STORAGE_STREAMING_PLAYLISTS_BUCKET_NAME=peertube
PEERTUBE_OBJECT_STORAGE_ENDPOINT=minio.XXX
PEERTUBE_OBJECT_STORAGE_VIDEOS_PREFIX=videos/

Could it be ? :

• I created the deployment before creating the secret so I have now have something wrong ?
• the region attribute is not applicable to minio so that's the bug ?

I don't seem to have any logs indicating the problem.

[adelcasse]

Hi Arthur,

Did you try to rollout restart you deployment after changing the secret ?

I never tried with minio. If there is an issue sending the videos to object storage, you might see the logs in this page https://your-peertube-instance/admin/system/jobs (with a specific type relating to S3 : I don't have them anymore so I can't give you an example right now)

I will test with minio next week if you can't get it working before.

[adelcasse]

Here is an example of what you should see in the admin UI when it's working (and it would show you an error in case of S3 endpoint/region/etc... misconfiguration) :

[adelcasse]

And for the config/default.yaml object_storage.enabled value set to false, that's normal.

Values should be overridden by environment variables : see https://github.com/Chocobozzz/PeerTube/blob/0305db28c98fd6cf43a3c50ba92c76215e99d512/support/docker/production/config/custom-environment-variables.yaml#L48

You could also, as an alternative to using environment variables, do like explained in "Other configurations" section of the README (https://github.com/coopgo/peertube-k8s#other-configurations) to provide a production.yaml file with object_storage settings.

[arthurzenika]

I got the following log :

Job: 1 Type: move-to-object-storage Processed on Sep 24, 2021, 4:49:50 PM Finished on Sep 24, 2021, 4:49:50 PM
--
{   "videoUUID": "a4a94b48-8a72-4abf-b892-cf9f94e58b85",   "isNewVideo": true }
Error: getaddrinfo ENOTFOUND peertube.minio.example.org     at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:66:26)

This means that it's using DNS based bucket. This might require the addition of something lik use_path_request_style (see Chocobozzz/PeerTube#147 (comment))

I'll look into it next week.

[adelcasse]

It's more an upstream Peertube issue then.

There is no configuration to change that : https://github.com/Chocobozzz/PeerTube/blob/e3c9ea722629a7d2b5656299ea51aec8c903b8ae/server/initializers/config.ts#L76

And S3Client is declared (https://github.com/Chocobozzz/PeerTube/blob/1c93ad0778d9bde1ba4caf87f24ecef27a8346a9/server/lib/object-storage/shared/client.ts#L21) without the option to use "forcePathStyle" (https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-s3/interfaces/s3clientconfig.html#forcepathstyle)