Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CAGED] Help with Harmonization Workflow #34

Open
2 of 5 tasks
njlyon0 opened this issue Jan 30, 2025 · 0 comments
Open
2 of 5 tasks

[CAGED] Help with Harmonization Workflow #34

njlyon0 opened this issue Jan 30, 2025 · 0 comments
Assignees
Labels
working-group Synthesis Working Group (SWG) tasks

Comments

@njlyon0
Copy link
Member

njlyon0 commented Jan 30, 2025

Summary

This group is using the ltertools::harmonize (i.e., column key-based) workflow and I am helping them integrate new datasets as they find/vet them. Current process is 'good' data get the data key filled out and are harmonized via the main script while 'bad' data are put in "purgatory" and get special idiosyncratic repair before they are entered into the data key after that initial repair. See below for SMART goals

Starting Tasks

  • Develop first draft of harmonization workflow
  • Advise / develop draft of purgatory workflow
  • Await pings from group to repair purgatory files
    • Add post-purgatory column names to data key
  • Run harmonization workflow with new (non-purgatory) data

Useful links

@njlyon0 njlyon0 self-assigned this Jan 30, 2025
@njlyon0 njlyon0 added the working-group Synthesis Working Group (SWG) tasks label Jan 30, 2025
@njlyon0 njlyon0 moved this to Active Progress in Scientific Computing Tasks Jan 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
working-group Synthesis Working Group (SWG) tasks
Projects
Status: Active Progress
Development

No branches or pull requests

1 participant