- Clone repo
- BeautifulSoup? Required? $ pip install beautifulsoup4
- Yaml $ pip install pyyaml
Change the paths in the create-articles.yaml file in configurations folder
$> cd [repo]
$> cd scripts/create-articles/
$> python3 create-articles.py ../../configurations/create-articles.yaml > log.txt
For windows run the following command
python [path to create-articles.yaml file] > [log filename.txt]
This will generate a log.txt file in scripts/create-articles folder
This will generate dataset.yaml in artifacts/articles folder