Code

Refactor process parquet#124

Code

Open

cbutsko wants to merge 14 commits intocroptypeWorldCereal/presto-worldcereal:croptypefrom refactor_process-parquetWorldCereal/presto-worldcereal:refactor_process-parquetCopy head branch name to clipboard

+150-181

Commits

Commits on Dec 11, 2024

• avoid pandas to_datetime for 12-timesteps case

  

  Butsko Christina

  committed
  97ebb7d

• more generic handling of ts indexing

  

  Butsko Christina

  committed
  3293e75

• refactoring process_parquet

  

  Butsko Christina

  committed
  2d2aa2d

• using all non-feature columns as index; formatting

  

  Butsko Christina

  committed
  b6cd500

• removing lat-lon from required columns

  

  Butsko Christina

  committed
  aac145e

• formatting

  

  Butsko Christina

  committed
  d88124a

Commits on Dec 13, 2024

• better wording in docustring

  

  Butsko Christina

  committed
  ad5f373

• made num_timesteps and min_edge_buffer arguments that can be passed to function

  

  Butsko Christina

  committed
  81b5092

• added latlon and DEM columns to required columns

  

  Butsko Christina

  committed
  0aaa9b6

• neater handling of valid_date/time dichotomy

  

  Butsko Christina

  committed
  5d85e5a

• replaced month-based dates imputing with a more generic one based on inferred observations frequency

  

  Butsko Christina

  committed
  5d93c39

• removed irrelevant check of missing indices since ranking function does not have gaps; also fixed the indexing so that timestamp_ind starts with 0

  

  Butsko Christina

  committed
  b4964b0

• avoiding numpy overhead

  

  Butsko Christina

  committed
  0b9cf8c

• putting filtering under the if

  

  Butsko Christina

  committed
  74c9ae6