diff --git a/README.md b/README.md index 80acbd2..63cf45a 100644 --- a/README.md +++ b/README.md @@ -1,9 +1,9 @@ -Scripts for the purposes of scraping Sourcegraph search results. Script `src/json-to-raw-url.sh` extracts raw GitHub file URLs from [src-cli](https://github.com/sourcegraph/src-cli/), and `src/github_downloader.py` downloads all the files from GitHub. +Scripts for the purposes of scraping Sourcegraph search results. Script `scripts/json-to-raw-url.sh` extracts raw GitHub file URLs from [src-cli](https://github.com/sourcegraph/src-cli/), and `scripts/github_downloader.py` downloads all the files from GitHub. ## Example Usage ```sh -$ src search -stream -json '${{github.event.comment.body}} file:.github/workflows COUNT:100000' | ./src/json-to-raw-url.sh | python3 src/github_downloader.py +$ src search -stream -json '${{github.event.comment.body}} file:.github/workflows COUNT:100000' | ./scripts/json-to-raw-url.sh | python3 scripts/github_downloader.py ``` ## Why is this so useful? diff --git a/src/filter_popularity.py b/scripts/filter_popularity.py similarity index 100% rename from src/filter_popularity.py rename to scripts/filter_popularity.py diff --git a/src/github_downloader.py b/scripts/github_downloader.py similarity index 99% rename from src/github_downloader.py rename to scripts/github_downloader.py index f65eee2..8981a8d 100644 --- a/src/github_downloader.py +++ b/scripts/github_downloader.py @@ -4,7 +4,6 @@ import sys from aiopath import AsyncPath - from utils import create_client, setup_logging diff --git a/src/json-to-raw-url.sh b/scripts/json-to-raw-url.sh similarity index 100% rename from src/json-to-raw-url.sh rename to scripts/json-to-raw-url.sh diff --git a/src/utils.py b/scripts/utils.py similarity index 100% rename from src/utils.py rename to scripts/utils.py