Skip to content

Commit

Permalink
Ensure that directories previously created by pipeline are deleted at…
Browse files Browse the repository at this point in the history
… the beginning
  • Loading branch information
pranavanba committed Apr 22, 2024
1 parent 02d884f commit d1781a1
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions scripts/main/sts_synindex_external.R
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,11 @@ replace_equal_with_underscore <- function(directory_path) {
synapser::synLogin(authToken = Sys.getenv('SYNAPSE_AUTH_TOKEN'))
config::get(config = "staging") %>% list2env(envir = .GlobalEnv)

unlink(x = c(AWS_PARQUET_DOWNLOAD_LOCATION,
AWS_ARCHIVE_DOWNLOAD_LOCATION,
PARQUET_FINAL_LOCATION),
recursive = TRUE,
force = TRUE)

# Get STS credentials for input data bucket -------------------------------
token <-
Expand Down

0 comments on commit d1781a1

Please sign in to comment.