Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Native] Building Prestissimo on AmazonLinux2 #18919

Open
majetideepak opened this issue Jan 12, 2023 · 6 comments
Open

[Native] Building Prestissimo on AmazonLinux2 #18919

majetideepak opened this issue Jan 12, 2023 · 6 comments
Assignees
Labels
build prestissimo Presto Native Execution

Comments

@majetideepak
Copy link
Collaborator

Amazon Linux 2 is the default distro on Amazon EC2 instances. It will be useful to provide a build script so that users of Amazon cloud can deploy Prestissimo.

@majetideepak majetideepak self-assigned this Jan 12, 2023
@majetideepak majetideepak added the prestissimo Presto Native Execution label Jan 12, 2023
@majetideepak majetideepak changed the title Support Prestissimo build on Amazon Linux 2 [Native] Support Prestissimo build on Amazon Linux 2 Jan 12, 2023
@majetideepak
Copy link
Collaborator Author

majetideepak commented Jan 12, 2023

Velox has a PR to support AL2 here facebookincubator/velox#3568
We need to include the additional Prestissimo dependencies in the build script.

@majetideepak
Copy link
Collaborator Author

With fizz, I see the following build error
‘TCP_ULP’ was not declared in this scope
Reported here
facebookincubator/fizz#85

@wanglinsong
Copy link
Member

I think for OSS community, we can only support CentOS Stream8.

@majetideepak
Copy link
Collaborator Author

@wanglinsong we want to have AmazonLinux2 as part of CI testing. We don't have to provide releases.

@majetideepak majetideepak changed the title [Native] Support Prestissimo build on Amazon Linux 2 [Native] Building Prestissimo on Amazon Linux 2 Feb 1, 2023
@majetideepak
Copy link
Collaborator Author

I posted a potential fix for facebookincubator/fizz#85 there.
The current AWS SDK C++ version "1.9.96" is Velox failed to build as well.
Version "1.9.379" worked.

@majetideepak majetideepak changed the title [Native] Building Prestissimo on Amazon Linux 2 [Native] Building Prestissimo on AmazonLinux2 Feb 1, 2023
@majetideepak
Copy link
Collaborator Author

majetideepak commented Feb 1, 2023

Finally, I encountered random node crashes as reported here facebookincubator/velox#3800 when executing queries which is now fixed.
When executing queries, the SSD cache file writes failed since ODIRECT is not supported on most EC2 instances.
This can be avoided by passing the -ssd_odirect=false flag to Prestissimo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build prestissimo Presto Native Execution
Projects
Status: 🆕 Unprioritized
Development

No branches or pull requests

3 participants