Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CDC #321 - Import UDFs #111

Merged
merged 3 commits into from
Jan 3, 2025
Merged

CDC #321 - Import UDFs #111

merged 3 commits into from
Jan 3, 2025

Conversation

dleadbetter
Copy link
Contributor

This pull request fixes a bug that occurs during the import process when all user-defined fields are not included in the CSVs. The import process will overwrite existing values that are not included as columns, resulting in lost data.

The solution here was to update existing records during the transform phase with any user_defined values, and union the existing values with the incoming values from the CSV files using the || operator.

Copy link
Member

@NickLaiacona NickLaiacona left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@dleadbetter dleadbetter added v0.1.67 Issues in v0.1.67 v0.1.68 Issues in v0.1.68 and removed v0.1.67 Issues in v0.1.67 labels Dec 16, 2024
@dleadbetter dleadbetter merged commit 1966f62 into master Jan 3, 2025
@dleadbetter dleadbetter deleted the feature/cdc321_import_udfs branch January 3, 2025 12:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
v0.1.68 Issues in v0.1.68
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants