Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JDK install on Ubuntu/Debian fails with HTTP 403 #632

Closed
berndschatz opened this issue Nov 11, 2022 · 45 comments
Closed

JDK install on Ubuntu/Debian fails with HTTP 403 #632

berndschatz opened this issue Nov 11, 2022 · 45 comments
Assignees
Labels
bug Something isn't working Waiting on OP

Comments

@berndschatz
Copy link

Please provide a brief summary of the bug

please reopen issue --> #554

Please provide steps to reproduce where possible

see #554

Expected Results

#554

Actual Results

see #554

What Java Version are you using?

see #554

What is your operating system and platform?

see #554

How did you install Java?

see #554

Did it work before?

see https://github.com/adoptium/adoptium-support/issues/554

Did you test with other Java versions?

see https://github.com/adoptium/adoptium-support/issues/554

Relevant log output

see https://github.com/adoptium/adoptium-support/issues/554
@berndschatz berndschatz added the bug Something isn't working label Nov 11, 2022
@gdams
Copy link
Member

gdams commented Nov 11, 2022

Works for me, can you try the steps again incase it was a temporary outage?

@berndschatz
Copy link
Author

berndschatz commented Nov 11, 2022

no, still not working.

very strange, now also the download of temurin 11 fails:

Get:7 http://deb.debian.org/debian buster/main amd64 fonts-dejavu-core all 2.37-1 [1068 kB]

Get:8 http://deb.debian.org/debian buster/main amd64 fontconfig-config all 2.13.1-2 [280 kB]

Err:2 https://packages.adoptium.net/artifactory/deb buster/main amd64 temurin-11-jdk amd64 11.0.17.0.0+8

  403  Forbidden [IP: 52.92.147.122 443]

Get:9 http://deb.debian.org/debian buster/main amd64 fonts-dejavu-extra all 2.37-1 [1982 kB]

Err:3 https://packages.adoptium.net/artifactory/deb buster/main amd64 temurin-17-jdk amd64 17.0.5.0.0+8

  403  Forbidden [IP: 52.92.147.122 443]

Err:4 https://packages.adoptium.net/artifactory/deb buster/main amd64 temurin-8-jdk amd64 8.0.352.0.0+8-1

  403  Forbidden [IP: 52.92.147.122 443]

Get:10 http://deb.debian.org/debian buster/main amd64 fonts-dejavu all 2.37-1 [32.3 kB]

Get:11 http://deb.debian.org/debian buster/main amd64 java-common all 0.71 [14.4 kB]

@karianna
Copy link
Contributor

@berndschatz Are you able to share what part of the world you are in and whether or not you're on a VPN and which ISP provider you go through?

@berndschatz
Copy link
Author

berndschatz commented Nov 15, 2022

Germany.
Teammate in office has same issue with VPN, but without VPN it works for him.
For me, it works neither in office nor in homeoffice (with and without VPN).
Nightly in Azure works fine.

On my private Linux desktop it worked in the past,
but in the meantime it works not anymore.
My isp provider has ,,upgraded my old contract for free to 250Mbit/s'',
the result is that my download rate has now dropped from 125Mbit/s to 25MBit/s --> yes germany :(
My teammate has at home a download rate of 50MBit/s.

Maybe it is a timeout/download rate issue !?

@karianna
Copy link
Contributor

It could well be - I VPN'd into Germany and could not replicate your issue, so I suspect it is your local ISP provider :-(

@RulerOf
Copy link

RulerOf commented Nov 16, 2022

I'm having the same problem accessing the EL repos, 403 everywhere. Happens from my local network (AT&T in midwest USA) and also on AWS EC2 in us-west-2 region.

My repo config file:

[root@ip-10-2-2-162 ~] :) cat /etc/yum.repos.d/TemurinJDK.repo
# This file was generated by Chef
# Do NOT modify this file by hand.

[TemurinJDK]
name=Yum Repository
baseurl=https://packages.adoptium.net/artifactory/rpm/amazonlinux/$releasever/$basearch
enabled=1
fastestmirror_enabled=0
gpgcheck=1
gpgkey=https://packages.adoptium.net/artifactory/api/gpg/key/public
priority=1

Attempts to read the repo data:

[root@ip-10-2-2-162 ~] :) yum makecache --disablerepo='*' --enablerepo=TemurinJDK
Loaded plugins: cob, extras_suggestions, langpacks, priorities, update-motd, versionlock
https://packages.adoptium.net/artifactory/rpm/amazonlinux/2/x86_64/repodata/repomd.xml: [Errno 14] HTTPS Error 403 - Forbidden
Trying other mirror.
https://packages.adoptium.net/artifactory/rpm/amazonlinux/2/x86_64/repodata/8f32af76ae976666e483297d374d4c4b77f4aa00-filelists.xml.gz: [Errno 14] HTTPS Error 403 - Forbidden
Trying other mirror.


 One of the configured repositories failed (Yum Repository),
 and yum doesn't have enough cached data to continue. At this point the only
 safe thing yum can do is fail. There are a few ways to work "fix" this:

     1. Contact the upstream for the repository and get them to fix the problem.

     2. Reconfigure the baseurl/etc. for the repository, to point to a working
        upstream. This is most often useful if you are using a newer
        distribution release than is supported by the repository (and the
        packages for the previous distribution release still work).

     3. Run the command with the repository temporarily disabled
            yum --disablerepo=TemurinJDK ...

     4. Disable the repository permanently, so yum won't use it by default. Yum
        will then just ignore the repository until you permanently enable it
        again or use --enablerepo for temporary usage:

            yum-config-manager --disable TemurinJDK
        or
            subscription-manager repos --disable=TemurinJDK

     5. Configure the failing repository to be skipped, if it is unavailable.
        Note that yum will try to contact the repo. when it runs most commands,
        so will have to try and fail each time (and thus. yum will be be much
        slower). If it is a very temporary problem though, this is often a nice
        compromise:

            yum-config-manager --save --setopt=TemurinJDK.skip_if_unavailable=true

failure: repodata/8f32af76ae976666e483297d374d4c4b77f4aa00-filelists.xml.gz from TemurinJDK: [Errno 256] No more mirrors to try.
https://packages.adoptium.net/artifactory/rpm/amazonlinux/2/x86_64/repodata/8f32af76ae976666e483297d374d4c4b77f4aa00-filelists.xml.gz: [Errno 14] HTTPS Error 403 - Forbidden
[root@ip-10-2-2-162 ~] :(

It's pretty clear that the whole repo is blocked but yum requires the repomd.xml to know where to find anything, and that's clearly broken here: https://packages.adoptium.net/artifactory/rpm/amazonlinux/2/x86_64/repodata/repomd.xml

@RonneGisun
Copy link

And JDK install on CentOS/RHEL/Fedora failing with HTTP 403 on AWS EC2 in ap-southwest-2 region.

Same problem as @RulerOf above.

failure: repodata/repomd.xml from Adoptium: [Errno 256] No more mirrors to try.
https://packages.adoptium.net/artifactory/rpm/centos/7/x86_64/repodata/repomd.xml: [Errno 14] HTTPS Error 403 - Forbidden

@atlas-terii
Copy link

Getting the same thing as well.

"Failure talking to yum: failure: repodata/repomd.xml from Adoptium: [Errno 256] No more mirrors to try.\nhttps://packages.adoptium.net/artifactory/rpm/amazonlinux/2/x86_64/repodata/repomd.xml: [Errno 14] HTTPS Error 403 - Forbidden"

@tarekziade
Copy link

it's the whole subdomain that is down https://packages.adoptium.net

@RonneGisun
Copy link

Hi @gdams / @karianna, Seems to be a problem for everyone. Can we raise the priority please? Thanks

@speedythesnail
Copy link

speedythesnail commented Nov 16, 2022

Update: this is an issue for me as well, Linux Mint (Ubuntu focal). Receiving a 403, not using a VPN. Had no issues running apt update earlier this week (Sunday), today (Tuesday), am receiving a 403 only for this repo. Also receiving a 403 accessing packages.adoptium.net via Firefox.

@piru
Copy link

piru commented Nov 16, 2022

This is definitely broken from multiple locations. When tested with https://geopeeker.com/ it is 403 from all of them. So this seems to be a generic issue rather than some VPN or individual ISP one.

@Mahoney
Copy link

Mahoney commented Nov 16, 2022

Getting a 403 for https://packages.adoptium.net/artifactory/api/gpg/key/public from the UK (Virgin Media) and from AWS US East 1. It's pretty widespread.

@berndschatz
Copy link
Author

berndschatz commented Nov 16, 2022

i get 403 now from an other server:


$ sudo apt reinstall temurin-19-jdk/bullseye
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Selected version '19.0.1.0.0+10' (Artifactory:bullseye [amd64]) for 'temurin-19-jdk'
The following NEW packages will be installed:
  temurin-19-jdk
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 172 MB of archives.
After this operation, 347 MB of additional disk space will be used.
Err:1 https://packages.adoptium.net/artifactory/deb bullseye/main amd64 temurin-19-jdk amd64 19.0.1.0.0+10
  403  Forbidden [IP: 52.27.220.174 443]
E: Failed to fetch https://packages.adoptium.net/artifactory/deb/pool/main/t/temurin-19/temurin-19-jdk_19.0.1.0.0%2b10_amd64.deb  403  Forbidden [IP: 52.27.220.174 443]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

$ nslookup 52.27.220.174
174.220.27.52.in-addr.arpa	name = ec2-52-27-220-174.us-west-2.compute.amazonaws.com.

@stamepicmorg
Copy link

stamepicmorg commented Nov 16, 2022

  • finland (hezner)
  • germany (hezner)
  • russia (local isp)
  • amsterdam (local isp)

are have same issue.

wget -O - https://packages.adoptium.net/artifactory/api/gpg/key/public | tee /etc/apt/keyrings/adoptium.asc
--2022-11-16 12:15:09--  https://packages.adoptium.net/artifactory/api/gpg/key/public
Resolving packages.adoptium.net (packages.adoptium.net)... 52.27.220.174, 54.148.95.12, 52.33.146.50
Connecting to packages.adoptium.net (packages.adoptium.net)|52.27.220.174|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2022-11-16 12:15:14 ERROR 403: Forbidden.

@gdams
Copy link
Member

gdams commented Nov 16, 2022

We are aware of an issue affecting all users now. This has been broken for roughly 5 hours. I am working with the Artifactory team to get this resolved ASAP

@gdams
Copy link
Member

gdams commented Nov 16, 2022

This should be resolved now. Please let me know if you are still experiencing problems

@grigojev
Copy link

This should be resolved now. Please let me know if you are still experiencing problems

I am now getting this error, when running sudo apt update

Err:7 https://packages.adoptium.net/artifactory/deb kinetic Release
404 Not Found [IP: 54.148.95.12 443]
Reading package lists... Done
E: The repository 'https://packages.adoptium.net/artifactory/deb kinetic Release' does not have a Release file.

@gdams
Copy link
Member

gdams commented Nov 16, 2022

I am now getting this error, when running sudo apt update

I don't believe that we have ever supported Ubuntu Kinetic in our Deb installers to this date? Are you sure this worked before @grigojev?

@grigojev
Copy link

I am now getting this error, when running sudo apt update

I don't believe that we have ever supported Ubuntu Kinetic in our Deb installers to this date? Are you sure this worked before @grigojev?

Well, I just updated to it yesterday, so I can believe, that there was no support for this release. I have created the new issue for adding a support for it #633. There are not a lot of changes between 22.04 and new 22.10, so I believe it shouldn't take a lot of effort to add. Just would be nice to have 😃

@gdams
Copy link
Member

gdams commented Dec 6, 2022

closing in favour of adoptium/installer#561

@gdams gdams closed this as completed Dec 6, 2022
@berndschatz
Copy link
Author

The errors reported on 16.November were not the source of this issue.

I still get 403 errors:

Get:18 http://deb.debian.org/debian buster/main amd64 libxtst6 amd64 2:1.2.3-1 [27.8 kB]
Err:7 https://packages.adoptium.net/artifactory/deb buster/main amd64 temurin-17-jdk amd64 17.0.5.0.0+8
  403  Forbidden [IP: 52.218.196.234 443]
Err:9 https://packages.adoptium.net/artifactory/deb buster/main amd64 temurin-8-jdk amd64 8.0.352.0.0+8-1
  403  Forbidden [IP: 52.218.196.234 443]
Fetched 172 MB in 1min 35s (1804 kB/s)
E: Failed to fetch https://jfrog-prod-usw2-shared-oregon-main.s3.amazonaws.com/aol-adoptium/filestore/09/097d73e62006a695c21cd374fb0c1119f13c07af?X-Artifactory-username=anonymous&X-Artifactory-repositoryKey=deb&X-Artifactory-artifactPath=pool/main/t/temurin-17/temurin-17-jdk_17.0.5.0.0+8_amd64.deb&X-Artifactory-projectKey=temurin&x-jf-traceId=d5311f58c4d557f4&response-content-type=application/x-debian-package&X-Amz-Security-Token=FwoGZXIvYXdzEIH//////////wEaDDPsncaVbSrRWKzmpiKdBPo7gHEgaGxCmZExz6d7H0fBAH8oEcilwtegUWQZqPWrW/yozkWFHc0SAjtbbPtcZbF0PG8ju/HYu2W+50ZpOeTXe18FHXlFR02P2LlNoxyitHV/cfMzXmsqx61bxW2BHpneCuyk+IYIy7tkaQ7DXGvktfa6OAw0jbW4JI9De0tx0LBgMUofWtG49opup11Ast3DlhcYF2AXjAw65G6e2LXm/s4/qSU4vgzKFGneDC1PxMTu4/oRIWQhYhSMx54ATPW3xv2+82d0d1ERm/hVYTAMPNRjTjxjLO9cKvQboAfPo55jE92crgY3KmSvDFGO5KKVI/Q26tI1FO6Wqc0VLpNZNwthb35yzBHexclU27bKb52vJ4SXFQIprVO08G8uYXSEDL5GxwBTmE2A/AxDcp3kz3HcuzMyVT9Px6shuGJ2Y1cxZvsRj3wwqa/Y1XrK2KUfLoGainrPupksXdjCtIuEGL5jSak9Q3zRdip/XEyA3Og9vcQ7XJ1YIEjrTlwT6fVUEeuh3/bWl63fUR7XMZNDZibMvQv3U9dKLp7cClGzhyCsYJwBhoZYgekJgVfi7jFRhTkm9jHwDB7MA+72SGxw/Xqd+1khHaO2kZdyatKK47ysvfokiYIWylGsA3EDRvxWt9As/qxd115aurvMb524a/2yIdknqplIhUnBycAoKNdjD5jG7sEzgT3/nzIHDup3gSPslPVh6+LQ6HUo8prKnQYyKtV6Cga+SLvWSe0MXfzIon7ohmrf0Oupna5yRXr0RzbCNtxoT+4dzC9yGw==&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230102T084045Z&X-Amz-SignedHeaders=host&X-Amz-Expires=60&X-Amz-Credential=ASIA6RUGCBMHLJOBUVVK/20230102/us-west-2/s3/aws4_request&X-Amz-Signature=166411f45fbcfe6d0cc565dad42de2550e064a084d97a465e2e246bc60a88cdc  403  Forbidden [IP: 52.218.196.234 443]
E: Failed to fetch https://jfrog-prod-usw2-shared-oregon-main.s3.amazonaws.com/aol-adoptium/filestore/f8/f8e30de36e704eafa3fe4615c32200171e5a44ae?X-Artifactory-username=anonymous&X-Artifactory-repositoryKey=deb&X-Artifactory-artifactPath=pool/main/t/temurin-8/temurin-8-jdk_8.0.352.0.0+8-1_amd64.deb&X-Artifactory-projectKey=temurin&x-jf-traceId=9ff459a861b32ecd&response-content-type=application/x-debian-package&X-Amz-Security-Token=FwoGZXIvYXdzEIH//////////wEaDDPsncaVbSrRWKzmpiKdBPo7gHEgaGxCmZExz6d7H0fBAH8oEcilwtegUWQZqPWrW/yozkWFHc0SAjtbbPtcZbF0PG8ju/HYu2W+50ZpOeTXe18FHXlFR02P2LlNoxyitHV/cfMzXmsqx61bxW2BHpneCuyk+IYIy7tkaQ7DXGvktfa6OAw0jbW4JI9De0tx0LBgMUofWtG49opup11Ast3DlhcYF2AXjAw65G6e2LXm/s4/qSU4vgzKFGneDC1PxMTu4/oRIWQhYhSMx54ATPW3xv2+82d0d1ERm/hVYTAMPNRjTjxjLO9cKvQboAfPo55jE92crgY3KmSvDFGO5KKVI/Q26tI1FO6Wqc0VLpNZNwthb35yzBHexclU27bKb52vJ4SXFQIprVO08G8uYXSEDL5GxwBTmE2A/AxDcp3kz3HcuzMyVT9Px6shuGJ2Y1cxZvsRj3wwqa/Y1XrK2KUfLoGainrPupksXdjCtIuEGL5jSak9Q3zRdip/XEyA3Og9vcQ7XJ1YIEjrTlwT6fVUEeuh3/bWl63fUR7XMZNDZibMvQv3U9dKLp7cClGzhyCsYJwBhoZYgekJgVfi7jFRhTkm9jHwDB7MA+72SGxw/Xqd+1khHaO2kZdyatKK47ysvfokiYIWylGsA3EDRvxWt9As/qxd115aurvMb524a/2yIdknqplIhUnBycAoKNdjD5jG7sEzgT3/nzIHDup3gSPslPVh6+LQ6HUo8prKnQYyKtV6Cga+SLvWSe0MXfzIon7ohmrf0Oupna5yRXr0RzbCNtxoT+4dzC9yGw==&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230102T084045Z&X-Amz-SignedHeaders=host&X-Amz-Expires=60&X-Amz-Credential=ASIA6RUGCBMHLJOBUVVK/20230102/us-west-2/s3/aws4_request&X-Amz-Signature=25819c5afe923d329571011f01bfb5791c4d6431d3636dc2edc74b29b37da581  403  Forbidden [IP: 52.218.196.234 443]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

@berndschatz
Copy link
Author

please reopem this issue.

@karianna
Copy link
Contributor

karianna commented Jan 3, 2023

@berndschatz likely a temp issue with JFrog hosting again.

@karianna karianna reopened this Jan 3, 2023
@karianna
Copy link
Contributor

karianna commented Jan 3, 2023

@gdams are you able to reach out?

@berndschatz
Copy link
Author

Last week i worked on the country side,
very slow internet connection but other provider (german telekom).
Unfortunately same issue.

(see also #554)

@mobede
Copy link

mobede commented Jan 12, 2023

I do have the same problem, when I try to install adoptium, so something seems still to be wrong and I do not think that the problem is on my side.

Get:16 https://adoptium.jfrog.io/adoptium/deb buster/main amd64 temurin-11-jdk amd64 11.0.17.0.0+8 [167 MB]
Get:17 https://adoptium.jfrog.io/adoptium/deb buster/main amd64 temurin-17-jdk amd64 17.0.5.0.0+8 [165 MB]
Err:18 https://adoptium.jfrog.io/adoptium/deb buster/main amd64 temurin-8-jdk amd64 8.0.352.0.0+8-1
  403  Forbidden [IP: 52.218.212.58 443]
Fetched 337 MB in 1min 45s (3204 kB/s)
E: Failed to fetch https://jfrog-prod-usw2-shared-oregon-main.s3.amazonaws.com/aol-adoptium/filestore/f8/f8e30de36e704eafa3fe4615c32200171e5a44ae?X-Artifactory-username=anonymous&X-Artifactory-repositoryKey=deb&X-Artifactory-artifactPath=pool/main/t/temurin-8/temurin-8-jdk_8.0.352.0.0+8-1_amd64.deb&X-Artifactory-projectKey=temurin&x-jf-traceId=3f7eb1e7f0c70b54&response-content-type=application/x-debian-package&X-Amz-Security-Token=FwoGZXIvYXdzEFoaDERsj+Tkg+SKKLwe2iKdBFqmYjcfgHBRjw9nqa475h+8yc/7Aw1R2AepxIRdYJD+s50jr8Ayo11CEbEASUfGBisOWZkyrUbDaA8ZlsrUqb59ojMLWyfdf7E65R2t78w1VIF+LuiT/tuthhs/hXCdWkMzTqTE9qXhaN/UGvgLVH0yXC01vn3UoJcDkOAI3gOzPw/SPJ/vz5i33e1uklALSUP7++hPmA4Q5M7mNjBimh4V/vJRbZnL8HA7zs52g+VaIRHQ+/GesTnZvq6oPVsyTiQCPVjjQ6Ou2TP4uFV0U0IiY1MxyunaOg+WuV/YxLI8m2jiHGpmArxgpCoev/4aqWYzt8wXi8afHe+MgvBKEE27OuB4CZ/KT55XfkZTj23BthBL4X28/aaakoJCCSeYF4DPvbzcH8J4RvNxVbEyUJSR6m3ZObRMF8muVRjxEy8lAhhWurCCLiOeagQqb0us++zabcyEYaRZWe3tfImHuro/r3MhWN9PbbGyhcfWmlt83U7z2F4qdB5aQtx6dmugK18qbyjsanIT5poI6Bi7qu2v3dVH+Z/zuSGf1qWLnLbY4chut6nF4F9pnsQsMcmGknKuOmRXwSoRe7jdKS9yZKugKEk2P3Ms5HzwE8PSl1+u7KRZ36P1mki9G01LN+4Qh2/7/VGx03Y3oYjV/UOSZKav//mPZlZHX+tJt0Ws45aIYdoG4cyBVTDOBL2H7njgPjVY1wrTN3K6iMPxR+Yo5N75nQYyKms03DiOBGMWU06Cvq8uDuw32O9GHWLzDCNYZ5vrBhS6tDpDjyyF0hgkaA==&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230111T081428Z&X-Amz-SignedHeaders=host&X-Amz-Expires=60&X-Amz-Credential=ASIA6RUGCBMHHFJIVPUF/20230111/us-west-2/s3/aws4_request&X-Amz-Signature=657493eb8fac622131286022fc8f3e1207278bfbd29c094034a0d7720d546a98  403  Forbidden [IP: 52.218.212.58 443]E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

I am located in germany and the installation did not work on different locations (using different ISPs).
And I did not use any VPN.
So I think something is wrong with the S3 configuration.

@berndschatz
Copy link
Author

berndschatz commented Feb 1, 2023

Any news/progress here ?
Need some more informations from my side ?

@karianna
Copy link
Contributor

We can't find a way to reproduce this issue :-(

@berndschatz
Copy link
Author

Still does not work.
We have switched now to zulu jdk.

@nathan818fr
Copy link

I think the bug occurs when the time to fetch the apt sources takes more than 60 seconds.

I see the parameter X-Amz-Expires=60 in the download URL.
So the signature becomes invalid after 60 seconds (so before the download starts), which is way too short.

@berndschatz
Copy link
Author

Unfortunatlely, currently i cannot reproduce this error.
@mobede do you still have the issue? If yes, can you confirm,
that increasing the timeout for apt solves the issue?

@nathan818fr
Copy link

nathan818fr commented Mar 2, 2023

It's not about the timeout of apt, but the timeout of the S3 url signature.

apt-get install handles http redirects in a strange way, and when you try to install several packages at the same time it can act like this:

  1. Try to download temurin-8-jdk (which redirect to a presigned S3 url)
  2. Try to download temurin-11-jdk (which redirect to a presigned S3 url)
  3. Try to download temurin-8-jdk from the previous redirect (it works)
  4. Try to download temurin-11-jdk from the previous redirect (it fails because the S3 signature has expired if step 3 take too long)

You can reproduce this using trickle to limit your bandwidth:

sudo apt remove temurin-8-jdk temurin-11-jdk
sudo trickle -d 1000 apt install temurin-8-jdk temurin-11-jdk

Output of the reproduction:

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
  temurin-11-jdk temurin-8-jdk
0 upgraded, 2 newly installed, 0 to remove and 16 not upgraded.
Need to get 252 MB of archives.
After this operation, 528 MB of additional disk space will be used.
Get:1 https://packages.adoptium.net/artifactory/deb bullseye/main amd64 temurin-11-jdk amd64 11.0.18.0.0+10 [167 MB]
Err:2 https://packages.adoptium.net/artifactory/deb bullseye/main amd64 temurin-8-jdk amd64 8.0.362.0.0+9-1                                                                                                       
  403  Forbidden [IP: 1.2.3.4 443]
Fetched 166 MB in 2min 41s (1,034 kB/s)                                                                                                                                                                           
E: Failed to fetch https://jfrog-prod-usw2-shared-oregon-main.s3.amazonaws.com/aol-adoptium/filestore/e1/e134691e7bc0127fdde62622d15778b4f3e22e35?X-Artifactory-username=anonymous&X-Artifactory-repositoryKey=deb&X-Artifactory-artifactPath=pool%2Fmain%2Ft%2Ftemurin-8%2Ftemurin-8-jdk_8.0.362.0.0%2B9-1_amd64.deb&X-Artifactory-projectKey=temurin&x-jf-traceId=423c56bac0e3a835&response-content-type=application%2Fx-debian-package&X-Amz-Security-Token=IQoJb3JpZ2luX2VjEAAaCXVzLXdlc3QtMiJIMEYCIQCEte5c%2Ffiq%2F1aN13PjCoBmlebi63h09OnN8vuCjpH45QIhAO7yMtzTc7K5%2Br7qZ%2FMF2t4n7CqUoRBA3zwt0jE%2Banl5Ko8FCKn%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEQARoMOTk5OTM0NzkwNDE0Igwux3TNN4aeemhP71Yq4wSMmKLB1s3qo9nXLErRVLZ4NKJwNDbT2STc17%2B95I6Mup1u%2FaWcsdNL7KMWqRMNXMC%2BdMhxMrDIpPFdReZRwkqkGjaqeHeTNE%2B93Pn1NYlBAt52bM2YZkIBr5eKsWDvRRhCABMmEA2nGqX1qKsyLXe5OntdkRG3Wvn6QuXmoW1PGRLOd2M9eG7zT4T65LGivRd9HEF85EZdZIQyiuMqGSm2bbntuETGYJETBhu%2Bw6o7akR5Ilpl9QmFWZroaaBzpgCaZqTuUeh8sPxWCpwPD02X0HvrJY9NGL0MTpsIXgezIfgJ1%2FZhd4WMPU1u9rLnx7Oee%2Bo7FlgEwdw%2FDNCebjuzDes7uWqy3kaX%2BhvJGGo11dcaU1E4M0WXcG8AnR%2F68inqkkA3eCUv6ubN%2Bn6MbGuZ%2Faap21ZOJveIT0mnCV8urNwevguNEX3EvrBalnuLN4vGr5RZuYfmebnVDOpk1MF8U2a%2FFlUfcUoaPVON7jvUzCS7GRQ4Xm7DOJM9QwGUg4RlVnXtyenwoWoRHDHFTk0k%2BhdthMfitCatNUImRxGMz10opgMZaotYgGQd%2FMjGOkdOaZPdJW2S25CKkaNKScOJpSB6dVPW%2B3LZXPJsMofz0SvfWr3Fqam9VQbnI%2FVUgEO0clO8RCYkk85YzmekfEFKeKf%2Bx9hgguiBUkjHSMyC8jnwpVSix2RJ5TXbI1Zj73BkFVbT79YlCGwKFuKrnzoTo1EjAz0HNCRxBfEc4JJ15l46Iyo9trqSDLJYw2PRiZB%2F0gS1JkcFk0rkoCwpzWOAAh%2Fqn3L2orL5jFPMKII4LyFWjDD3jYOgBjqZAWr3x996BMjlqaE1yU8s0EoJ11rPFXCXV59DHBPD1v7jouWqQQdF2qq8RAMIHePRBE8TYSNOUVO8vonB6cTszRKOGtcG1N1Q8MrZt5OaEufrth4FSOL5GLXdHVkrCDj2lvY50fpzCLOJBFDUlvaUvi4uCbvgciRNAUj1z76jB4fy%2BnfI1WFZpVC06YLKwbB9PFGbSkH8r1y7Fw%3D%3D&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230302T164935Z&X-Amz-SignedHeaders=host&X-Amz-Expires=60&X-Amz-Credential=ASIA6RUGCBMHNHIEPTN4%2F20230302%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Signature=42b2760a9a49c59400b54e2d43cd890e630cee628424bb63c02eb9d2387b1987  403  Forbidden [IP: 1.2.3.4 443]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

To solve this problem, you have to increase the duration of the pre-signed S3 url (I hope artifactory allows to change this? I would say at least to 20 minutes to avoid any problem with the slowest connections).
Currently the presigned S3 url expire after 60 secondes (can see X-Amz-Expires=60 in the url - https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-query-string-auth.html)

@karianna
Copy link
Contributor

karianna commented Mar 2, 2023

@gdams - Can we pass this on to the JFrog folks?

@github-actions
Copy link

github-actions bot commented Jun 1, 2023

We are marking this issue as stale because it has not been updated for a while. This is just a way to keep the support issues queue manageable.
It will be closed soon unless the stale label is removed by a committer, or a new comment is made.

@github-actions github-actions bot added the stale label Jun 1, 2023
@karianna karianna removed the stale label Jun 1, 2023
@stamepicmorg
Copy link

  • finland (hezner)
  • germany (hezner)
  • russia (local isp)
  • amsterdam (local isp)

are have same issue.

wget -O - https://packages.adoptium.net/artifactory/api/gpg/key/public | tee /etc/apt/keyrings/adoptium.asc
--2022-11-16 12:15:09--  https://packages.adoptium.net/artifactory/api/gpg/key/public
Resolving packages.adoptium.net (packages.adoptium.net)... 52.27.220.174, 54.148.95.12, 52.33.146.50
Connecting to packages.adoptium.net (packages.adoptium.net)|52.27.220.174|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2022-11-16 12:15:14 ERROR 403: Forbidden.

bump. it happenes again.

have this repo ratelimit? a build about 10 docker images locally and it will fails at 8th image. it sad.

@karianna
Copy link
Contributor

@stamepicmorg It could be rate limiting we'll need to contact the JFrog folks. Have you tried two groups of 5 images with a gap in between and see if that works

@stamepicmorg
Copy link

stamepicmorg commented Jul 26, 2023

@stamepicmorg It could be rate limiting we'll need to contact the JFrog folks. Have you tried two groups of 5 images with a gap in between and see if that works

hello, yes. i tried it but it is not worked. it was passed about 10+ hours between tries and i still catch 403

18.36 Get:5 https://packages.adoptium.net/artifactory/deb buster/main amd64 adoptium-ca-certificates all 1.0.2-1 [2304 B]
19.42 Get:6 https://packages.adoptium.net/artifactory/deb buster/main amd64 temurin-11-jdk amd64 11.0.19.0.0+7 [167 MB]
67.58 Err:7 https://packages.adoptium.net/artifactory/deb buster/main amd64 temurin-11-jre amd64 11.0.19.0.0+7-1
67.58   403  Forbidden [IP: 52.92.227.145 443]
67.59 E: Failed to fetch https://jfrog-prod-usw2-shared-oregon-main.s3.amazonaws.com/aol-adoptium/filestore/d5/d54d3ac3755c9080ede1481fd645d9a41c975f63?X-Artifactory-username=anonymous&X-Artifactory-repoType=local&X-Artifactory-repositoryKey=deb&X-Artifactory-packageType=debian&X-Artifactory-artifactPath=pool/main/t/temurin-11/temurin-11-jre_11.0.19.0.0+7-1_amd64.deb&X-Artifactory-projectKey=temurin&x-jf-traceId=8fd5e66c7d241db3&response-content-type=application/x-debian-package&X-Amz-Security-Token=IQoJb3JpZ2luX2VjEJ7//////////wEaCXVzLXdlc3QtMiJIMEYCIQDyQqI0ooRoSn2H4PXZ9+wiXa1r09Hnl3EBFyGc5HA82AIhAKR2W5ht5Y1XyoOT50s30FkHCLHlaVwp0muPd5yCyF8JKoYFCDcQARoMOTk5OTM0NzkwNDE0IgxBj1cXKNMC6HKFSNUq4wRz1fO+ib0bBjTMZMPV4vXQTYoQbCO982AOH0dJzkzyrUCTLJeiJl1Zt3hVnpeO1nm2chb3XAMm1Sb5mYEOdN15oDuaahvpokoxBD7gQZpA3s/1R1M2wdtQf/YBe/8kaMTBb9heEsg1BW2+df8PKYlifbXWSpowJW1gbI+KjhVFvmBEj1JTIyoyPEb1C3x8NwvxEgiOwIrB/4HwUCgotFHnCoad7n0UqcWJ4MfO2AKJDbn3qGiuPRKYbhzrortyDuFhyrD7zwXcqZz8rSgDOXkju3yDlVl93jF/oXwWnxCWnjfpCblPfcPqjZGePjuKlamflH3nJSB8Rai7SDWgxl9V7CovzTtm+eoXX3Uo/KgJh9tTTsmrwo6hmcZZoThMEzy32MTMaGKQNBNhKLigA1aMbbbbCYJJRLwKGXSsqMhY20KazvZq6NTAWqrqGU4bki2tSUX6VGe7tEOCOal9QQjI2dnOLNn6k60EXm3bWDwf5NDsaYr2OrUMPhY2J0giLIVDHRec42rjNke/0MDHajkhv8piegQHyYZwK8TvRE346ZPZ8DubatEyhEvCH1itPNPLCrdAsjzxL33NSHctGxYW33E9NnAO841R58t8+0K4IFNW3XACsmdw6eK9COXxtxAUzNHPP1u1y0lhIUs4RMEz9HlCbCqzKmILQF7OBAQOB1Tenf55YMib1fDLlWCz/VZExPF69jRaAlV2NI3jgqRzSTf2NX+XT4mYyygSiHE/ADMTpT9/xsrSAsXgta9vdiMGJEb1o44h0zL3yHjyVPHJnm/5swyr09WtgC5yzne49EMEzzD8k4GmBjqZAZ9wht/QtA6Tq1m53zzEZPsztFOuEQOBV4hF0rGSdx3Qh/4YcER7cnir0UPJBBd7BkIGIV8CoswivVZ5Wo4SuZR/JrBkpE+ZY0un/0XN+F5lrj1pKPCie99Bgnkq1AapQKZDZu+OB+6eymfMK+IT201qJZu8hdzOU52c3dDzcnTIYBgIxOIkpFpZlNrdxVTHIuQSrZVkdzqVmA==&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230725T224826Z&X-Amz-SignedHeaders=host&X-Amz-Expires=30&X-Amz-Credential=ASIA6RUGCBMHGY2JQX6Y/20230725/us-west-2/s3/aws4_request&X-Amz-Signature=9b85f3a74f3e62f17a3ba6f04fc071a0f26c153d20ed743283fc1a4520375db7  403  Forbidden [IP: 52.92.227.145 443]
67.59 E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
67.59 Fetched 170 MB in 50s (3392 kB/s)

i am connecting from russia, without any vpns. directly from my local isp. and i have public static ipv4.

@karianna
Copy link
Contributor

@gdams - Can you chat to JFrog when you get a chance, I suspect a geo locale node issue.

@gdams
Copy link
Member

gdams commented Jul 27, 2023

@gdams - Can you chat to JFrog when you get a chance, I suspect a geo locale node issue.

Yup already on it

@st4141
Copy link

st4141 commented Aug 8, 2023

403 problem again today with temurin-8-jdk.
Seems to be ok with temurin-11-jdk and temurin-17-jdk...

I'm in France if this information is relevant.

There is a problem at line Err:3 https://packages.adoptium.net/artifactory/deb bionic/main amd64 temurin-8-jdk amd64 8.0.382.0.0+5
403 Forbidden [IP: 10.27.128.115 5865]

After this operation, 207 MB of additional disk space will be used. Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 p11-kit-modules amd64 0.23.9-2ubuntu0.1 [234 kB] Get:2 https://packages.adoptium.net/artifactory/deb bionic/main amd64 adoptium-ca-certificates all 1.0.2-1 [2 304 B] Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 p11-kit amd64 0.23.9-2ubuntu0.1 [93,2 kB] Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 java-common all 0.68ubuntu1~18.04.1 [14,5 kB] Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 libxtst6 amd64 2:1.2.3-1 [12,8 kB] Get:3 https://packages.adoptium.net/artifactory/deb bionic/main amd64 temurin-8-jdk amd64 8.0.382.0.0+5 [84,8 MB] Err:3 https://packages.adoptium.net/artifactory/deb bionic/main amd64 temurin-8-jdk amd64 8.0.382.0.0+5 403 Forbidden [IP: 10.27.128.115 5865] Fetched 357 kB in 55s (6 486 B/s) E: Failed to fetch https://jfrog-prod-usw2-shared-oregon-main.s3.amazonaws.com/aol-adoptium/filestore/33/330243462a92d4d81506705ab1233d919010792b?X-Artifactory-username=anonymous&X-Artifactory-repoType=local&X-Artifactory-repositoryKey=deb&X-Artifactory-packageType=debian&X-Artifactory-artifactPath=pool/main/t/temurin-8/temurin-8-jdk_8.0.382.0.0+5_amd64.deb&X-Artifactory-projectKey=temurin&x-jf-traceId=38c6a5ba26f1cbe0&response-content-type=application/x-debian-package&X-Amz-Security-Token=IQoJb3JpZ2luX2VjEPj//////////wEaCXVzLXdlc3QtMiJHMEUCIHKLw/l0hDYXUD9ezFBzXfWig6GSAwpIdLeWalqA5mw6AiEAiCP6nDUSlrkjpWq2WienvEsjYTQzIkq5nu3/d3Y98pYqjwUIof//////////ARABGgw5OTk5MzQ3OTA0MTQiDBFne9htDt3CdKDqLSrjBMkFdqKK+H5hSdLXboXJ6BIzRsOrpczD4YxtXjU8U7ggN47xQWym1cVV6PT5cy//zhu1FYbm0tfUPVg2256hn+kneawbdyWvIqIf74R+4mtnauovHe1uGqoxhKe7UDRQTjbs/jGJr92GC5Yb3az0TN4DMA2ZqjxPh3TdfgxgRYvDwrEvxX/os7OqSEeHKNx9RHmu4DuN8rTTaAb7Wy03+1LzrKtf1M3EJ7eDsSGbRWftDDzYibBinCjlAFIaCw40kfUw/S9zCyUhcDuTFpjpQFEs8z+avpuh9obY3PHnyHPm+8vobObU2cZhoQbdOrz6iiKp5+ebxEH2xySr5FTgkfT6Q1F6YbJUmkgho90ZShSs9YFxAHFsOOD2nBty9q4I4E70Bx8hr3apznVoDjxSo3PgvFH5eGimF6fTGTRMgT6ry14IE84L5MpkkDLFIK1cAeLhXYxCrXiyW4IIwwvy/f72g+kLiVPCYBYR0rEam5TjJPqeicVIkRUyLYsL/EM2CmZ1oBaY0wYgwB3ceWNchXW6CMJIi2qgmgLOuXkrrJf0D8Z19+DiP7Yft4ng6c6N9N3rtOyHAZ5wXyl1ee1b7QicnbNkgprFx2S3rmSGcuo2k0/7NgOIHZVYU0O1muklKwgG8Hmp3dWb/mK6tW5+OHLFyK/cu+zF2+J8P6xaHxTt58pAgBQPaJS7o5gEB9K1BemzotBex89geiZbStNoBjXZgStkDyfcVlLE3K2e4gmguyHV4g/cFQq7hrg6dHPdL6AZQvHZg8m0o4bdTnyudspHHgObtA/G64tuVyYwNLH+IGjzML2BzaYGOpoBWPu+nVkr3QJX/9wZ0EOP1R7k+fao0C6izw5Uw0d3I8hzSHG5tOUqMHA0/BG5dKDWIKoWIl9gYR0AQirSm+catnSOFVfBY/0mbA9TyKhqCjmC2i6Ajmep6zXEm4a9H0h/7AxTy+ikpbCBLBCp9idN+w83HwHKReqI+ancgG0Hagh0ygU6g1ebKAa40Srfis4e0j3p2yU6M5EdmQ==&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230809T073318Z&X-Amz-SignedHeaders=host&X-Amz-Expires=30&X-Amz-Credential=ASIA6RUGCBMHOYYMT5JU/20230809/us-west-2/s3/aws4_request&X-Amz-Signature=38b76650af0ee6a043eec4cf6b0b110079719409db84bcfcacc605373bf46ed8 403 Forbidden [IP: 10.27.128.115 5865] E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

@nathan818fr
Copy link

nathan818fr commented Aug 11, 2023

The problem is still the same I explained above (see #632 (comment)).
403 errors are caused by X-Amz-Expires being too low.

Seems configurable in artifactory: signatureExpirySeconds / https://jfrog.com/help/r/jfrog-installation-setup-documentation/amazon-s3-template-parameters

@gdams
Copy link
Member

gdams commented Aug 14, 2023

The problem is still the same I explained above (see #632 (comment)). 403 errors are caused by X-Amz-Expires being too low.

Seems configurable in artifactory: signatureExpirySeconds / https://jfrog.com/help/r/jfrog-installation-setup-documentation/amazon-s3-template-parameters

@nathan818fr I was talking to the JFrog support team today, they have confirmed that the X-Amz-Expires is currently set as 60 seconds. They are in the process of increasing this to 900 seconds (15 minutes).

@gdams
Copy link
Member

gdams commented Aug 24, 2023

The problem is still the same I explained above (see #632 (comment)). 403 errors are caused by X-Amz-Expires being too low.
Seems configurable in artifactory: signatureExpirySeconds / https://jfrog.com/help/r/jfrog-installation-setup-documentation/amazon-s3-template-parameters

@nathan818fr I was talking to the JFrog support team today, they have confirmed that the X-Amz-Expires is currently set as 60 seconds. They are in the process of increasing this to 900 seconds (15 minutes).

@nathan818fr the fix has been rolled out now. Please can you verify if you're still seeing the same issue?

@nathan818fr
Copy link

@gdams It's OK, no more issue (and as long as everything downloads in less than 15 minutes, it will be fine). Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Waiting on OP
Projects
None yet
Development

No branches or pull requests