Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NextRequest auth #182 Mendo SO #169 #188

Open
wants to merge 6 commits into
base: dev
Choose a base branch
from
Open

NextRequest auth #182 Mendo SO #169 #188

wants to merge 6 commits into from

Conversation

stucka
Copy link
Contributor

@stucka stucka commented Jan 21, 2025

Description

This builds out authentication for NextRequest sites and also builds out a Mendocino County sheriff's office scraper.

Summary of Changes

  • This provides a means for authentication to be handled with NextRequest sites.

  • It provides an initial operating capability for auth data to be included into the metadata.

  • It also builds out Mendocino County Sheriff as more than a one-off.

  • It documents the new auth format in metadata

  • It adds and enables such a format within clean/utils.py

  • It builds out authentication into the scrape_agency functionality

  • Somehow it built out and tested authentication with clean-prefect/flows/assets.py

Related Issues

#182 NextRequest auth handling

#169 Build ca_mendocino_county_sheriff

How to Review

Examples include but are not limited to:

  • Bunch of moving parts on this one. Documentation and asset download functionality are more likely to be problematic than the actual metadata scraper work.

Notes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant