Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Find pyarrow module automatically for Arrow and Parquet #241

Closed
wants to merge 2 commits into from

Conversation

KIwabuchi
Copy link
Member

This PR adds an additional way to find Arrow and Parquet (described as step 3 below).
Here is how Arrow and Parquet are searched once this PR is merged:

  1. If PIP_PYARROW_ROOT is set, try to find Arrow and Parquet installed along with pyarrow by PIP

  2. If Arrow or Parquet is not found, try to find Arrow and Parquet using CMake's find_package()

  3. If Arrow or Parquet is not found still:

    1. Try to find a Python 3 interpreter on the system using CMake's FindPython3 module.

    2. If Python 3 interpreter is found, try to find a pyarrow module by executing a Python 3 script.

    3. If the pyarrow module is found, assign its location to PIP_PYARROW_ROOT (assuming the pyarrow module is installed by PIP) and execute step 1 again.

- Find pyarrow module executing python script if A) PIP_PYARROW_ROOT is not set and B) find_package can't find Parquet or Arrow
@KIwabuchi
Copy link
Member Author

@rogerpearce @steiltre
This PR is ready for review.

@KIwabuchi
Copy link
Member Author

Close this PR as more features were added and need to create a new PR.

@KIwabuchi KIwabuchi closed this Aug 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant