Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Repository v.s. Package Size -- new workflows to generate extdata artifacts #6

Open
brownag opened this issue Dec 24, 2020 · 1 comment

Comments

@brownag
Copy link
Member

brownag commented Dec 24, 2020

inst/extdata is ignored by .Rbuildignore (i.e. it is not part of the package) -- but is downloaded when one does remotes::install_github -- as this will clone the whole repo. One would be better off doing git clone so at least they could have a repo instance with all the data. This can be slow, and with the recent addition (by the bot) of a bunch of the JSON output, that payload is a bit bigger.

It is pretty handy to be able to get the extdata reasonably quickly -- and not have to run refresh() on data that are not changing frequently. Therefore, I think a fetch_artifacts or similar could be used to obtain gzipped extdata subfolders from GitHub. Then we could .gitignore inst/extdata, perhaps, creating tools for local inspection.

@brownag
Copy link
Member Author

brownag commented Feb 22, 2021

Consider {targets} for Make-like workflows

  • Refactor create_* processes as sets of tar_target()
  • Archive targets for faster / less-redundant processing when inputs are the same as last run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant