Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support S3 Access Grants #2885

Open
jornfranke opened this issue Jul 3, 2024 · 1 comment
Open

Support S3 Access Grants #2885

jornfranke opened this issue Jul 3, 2024 · 1 comment
Labels
enhancement New feature or request needs-triage

Comments

@jornfranke
Copy link

jornfranke commented Jul 3, 2024

Is your idea related to a problem? Please describe.
S3 Access Grants are the recommended solution for accessing files in S3 by end users (the target group of AWS SDK for Pandas). This should be supported by AWS SDK for Pandas.

Describe the solution you'd like
When writing code in a notebook and using the AWS SDK for Pandas I want that for any S3 access it automatically requests from a given S3 Access Grant instance the credentials based on the S3 Url I provide.
E.g. when executing the following code

wr.s3.read_parquet(f"s3://{bucket}/parquet/")

I want that AWS SDK for pandas automatically contacts in the background a preconfigured S3 Access Grant instance to obtain a token to be able to access the S3 location.

It may also automatically request, cache, and refreshe temporary credential tokens for all S3 requests that I run in my notebook.

AWS provided recently some libraries and support to enable this in general:

@jornfranke jornfranke added the enhancement New feature or request label Jul 3, 2024
@kukushking
Copy link
Contributor

HI @jornfranke thank you for opening this. Added to the roadmap and up for prioritisation with the team.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request needs-triage
Projects
None yet
Development

No branches or pull requests

2 participants