[source-salesforce] enable changing cursor column #44550
LucasSegersFabro
started this conversation in
Connector Ideas and Features
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Case
I have a case where I sync some objects (Account) but there is a batch process that updates one column (and the default "SystemModstamp")
Thing is: not all the columns that get updated need to be fetched again for my batch
Problem/Possible solution
On salesforce, I can simply configure another modstamp column that only gets updated if the set of columns I chose changes.
If I could use this custom column as a cursor, the syncs would pull MUCH less data and be really quick
BUT
The source-salesforce connector uses the SystemModstamp column as a "source defined crusor", making it impossible for me to configure another column as a cursor other than "SystemModStamp"
It would be nice if I could change the default cursor
Some questions
If I were to attempt to contribute myself, I have some questions before understanding/digging into the airbyte source interfaces:
It seems that the
source-salesforce
connector tries to infer the possible cursorsBeta Was this translation helpful? Give feedback.
All reactions