Skip to content

zerofill/GPT-Crawler-Config

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

GPT-Crawler-Config

Replace your config in Builder IO's GPT Cralwer with this one to set the config parameters via command line arguments.

GPT Cralwer: https://github.com/BuilderIO/gpt-crawler

Builder IO seems to have not wanted to bother with the CLI, and I don't want to edit the config every time.

Usage:

npm start url match maxPagesToCrawl outputFileName maxTokens

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published