S_tables_2418 #1196
Closed
S_tables_2418 #1196
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* US DOL Wages PR Creation * TMCF addition
* Update email notification recipients * Fix formatting * Also send failure notifications to debug list
… automation (datacommonsorg#1102) * Auxilio Brazil Test Data and Readme file added * reverted the changes * Changes for US_PEP_SEX_RACE for automation * Added manisfest.json file * USCensusPEP_By_Sex_Race mode changes done * corrected the changes related to inconsistent data was coming for State 1970-1979 * corrected the changes related to inconsistent data was coming for State 1970-1979 * code fix * changes related to download source files into local * code changes for copyright to 2024 and addin try/catch and f-strings to format --------- Co-authored-by: Ajai <[email protected]>
* modified script in preprocess.py which downloads data and process * modified script preprocess.py and README.md files * Updated README.md file * Updated README.md * Updated test script * Fixed PR comments * USCensusPEP_PopulationEstimatebyRace * USCensusPEP_PopulationEstimatebyRace * USCensusPEP_PopulationEstimatebyRace * USCensusPEP_PopulationEstimatebyRace * updated PR comments * updated PR comments * USCensusPEP_PopulationEstimatebyRace * USCensusPEP_PopulationEstimatebyRace * USCensusPEP_PopulationEstimatebyRace
* Auxilio Brazil Test Data and Readme file added * reverted the changes * added dependency xlsxwriter==3.2.0
…s values (datacommonsorg#1121) * Auxilio Brazil Test Data and Readme file added * reverted the changes * SCHEDULES=cripts/us_census/pep/population_estimate_by_race:USCensusPEP_PopulationEstimatebyRace * Lint errror fixed * Added coments
pep_sex_2024 auto refresh changes
…nsorg#1122) * USCensusPEP_MonthlyPopulation-code changes for Autorefresh * SCHEDULES=scripts/us_census/pep/monthly_population_estimate:USCensusPEP_MonthlyPopulation * added download script * run format check * resolve pr comment v1 * added raw data * changes done * changes done..
* WDI Code Update * WDI Readme Update * Code modification and Auto Refresh * Auto refresh modification * Readme * Addressed PR Comments * Test Script * Lint * Code modification * Core team PR comment * Removed unwanted lines * Corn Schedule
* pep srh changes done * pep_srh changes made * SCHEDULES=scripts/us_census/pep/pep_by_srh:USCensusPEP_By_SexRaceHispanicOrigin * pep_srh_changes 20241119 * pep srh change 20241120 * prp srh change 20241125 * pep srh 20241126 changes * pep srh 20241205 changes made * us_pep_srh 20241209 changes
* Population_Estimates_By_ASR_Changes * Modified README to remove double quotes from --mode * Updated files by removing print and unwanted comments * SCHEDULES=scripts/us_census/pep/population_estimates_by_asr:USCensusPEP_AgeSexRace * SCHEDULES=scripts/us_census/pep/population_estimates_by_asr:USCensusPEP_AgeSexRace * Updated code to remove drop duplicate * Updated code to remove drop duplicate * Updated code to remove drop duplicate * Removed unwanted comment * Addressed comments in PR, modified future_year_url method in process.py, added block of code to save raw input data * Modified state.json to remove 2023 year url and deleted national_2020_2021.py as it is included in national_2020_2029.py * Updated condition in process.py for checking number of files in input folder
* Utils for statvar processor for strng lookup * move statvar files to tools/statvar_importer * fix comments
* Produce import_metadata_mcf in executor * fix * fix
* Add support for shell import scripts in automation * support scripts without extension * lint * comment * comment
* add property-value-mapper utils * fix review comments * merge with statvar copy
* update utils * lint fix * add chardet requirement * fix review comments * fix review comments * fix review comments * add process time, mem counters * lint * add psutil requirement
* Fix lint in tools repo * fix lint in tools/
* Add dataset import differ utility * Addressed reviewer comments
* Use UTC for import metatdata dates * fix * fix
* Remove redundant steps from docker build * Fix cloud build config
…rics. (datacommonsorg#1186) * Adds logs and labels in auto-import jobs to help create log based metrics. * For structured logs, replaced python logging with print
…g#1198) * Add support for wildcard import files in manifest.json * copy source_files to GCS * fix unit tests * fix unit tests
|
closed |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.