Project Title

Data Extractors

Description

Provides the extraction layer between the providers and a destination db (here Postgres)

Getting Started

Dependencies

• N/A

Installing

• Git clone the project
  • git clone https://github.com/FredGH/extrator.git
• Ensure python3 is pointing to the 3.13
  • Go to https://www.python.org/downloads/ and download Python 3.13.x
  • Go to Visual Studio Code, select the Python Interpreter (Shift+Cmd+P) as Python 3.13.x
• Create the Python Env
  • rm -rf venv/
  • python3 -m venv venv
  • source ./venv/bin/activate
• Install Requirements:
  • python3 -m pip install --upgrade pip
• Build Package:
  • pip3 install -U pip setuptools
  • python3 setup.py sdist bdist_wheel
  • pip3 install -e .
  • [Optional]:
    • In case you get this error, then follows the resolution steps:
      • Error: "[...]Cargo, the Rust package manager, is not installed or is not on PATH. This package requires Rust and Cargo to compile extensions. [...]"
      • Resolution Steps:
        • In the venv terminal:
          • run curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
          • . "$HOME/.cargo/env"
          • pip3 install -e .
• Tag New Release & Push:
  • git tag 0.0.x -m "Release details"
  • git push origin 0.0.x
• Install Package:
  • Go to Settings > Developer Settings > Personal access tokens (classic) > Generate new token with note e.g. "Upload package"
  • Ensure you check the write:packages scope to grant the necessary permissions.
  • Get the generated token, e.g. "12345"
  • Get your Github user name, e.g. "my_user_name"
    • Install the private package using the following:
    • Template:
      • pip install git+https://{{ your access token }}@github.com/{{ username }}/{{ repository name}}.git@{{ tag/version }}#egg={{ package name }}
      • pip install git+https://github.com/{{ username }}/{{ package name }}.git@{{ tag/version }}
    • Example:
      • pip install git+https://github.com/{{ username }}/[email protected]

      * pip install git+https://[email protected]/{{ username }}/[email protected]#egg=extractor

Executing program

• N/A

Help

• N/A

Authors

Contributors names and contact info [email protected]

Version History

• 0.0.1
  • First version only containing stubs
• 0.0.2
  • Initial Release

License

• There is no license.

Acknowledgments

Inspiration, code snippets, etc.

• Create and Release Private Python Package On Github