Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure to insert rows to MySQL #14

Closed
Mythra opened this issue Nov 13, 2018 · 6 comments
Closed

Failure to insert rows to MySQL #14

Mythra opened this issue Nov 13, 2018 · 6 comments

Comments

@Mythra
Copy link
Contributor

Mythra commented Nov 13, 2018

Hello @securityinsanity, @UniversalSuperB made a remark on finding out that some id columns gets padded with 555555. I believe this is why I get the following error when I tried to run this command:

[root@localhost home]# RUST_LOG=info ./target/release/cdl-runner

Error: 
 INFO 2018-11-13T16:42:52Z: cdl_runner: Setting up API Client...
 INFO 2018-11-13T16:42:52Z: cdl_runner: Connecting to RocksDB Store....
 INFO 2018-11-13T16:42:52Z: cdl_runner: Skipping dump: f2861f59-f11c-4c97-8d09-c349e7f4f3f6 
 INFO 2018-11-13T16:42:52Z: cdl_runner: Skipping dump: 259dfc10-69b7-4f9f-bd89-013082e6c1ef due to only final selected
 INFO 2018-11-13T16:42:52Z: cdl_runner: Skipping dump: a8d4271f-2013-4ff0-8813-b8aa79e85e0b due to only final selected
 INFO 2018-11-13T16:42:53Z: cdl_runner: Connecting to the DB
ERROR 2018-11-13T16:50:35Z: cdl_runner::db_client: insert error
ERROR 2018-11-13T16:50:35Z: cdl_runner::db_client: MySqlError { ERROR 1264 (22003): Out of range value for column 'position' at row 1 }
ERROR 2018-11-13T16:50:35Z: cdl_runner::importer: process -> for line in finalized_string -> !is_volatile -> ins_res -> is_err
ERROR 2018-11-13T16:50:35Z: cdl_runner::importer: Error(MysqlErr, State { next_error: None, backtrace: None })
 INFO 2018-11-13T16:50:35Z: cdl_runner: Done!

My question is: Is there a fix for this?

Originally posted by @latifatbraimah in #6 (comment)

@Mythra
Copy link
Contributor Author

Mythra commented Nov 13, 2018

Sorry for directing you back to that issue. Seems there was a mix up in filing a github issue. We'll talk about it here @latifatbraimah . The canvas-data-loader itself does not pad any values. Are these values present in the source dumps? (e.g. if you download them manually from the UI do you find these padded values).

@latifatbraimah
Copy link

latifatbraimah commented Nov 13, 2018

No. When I perform a manual download and unpack, upload is pretty straightforward. But it's also very tedious especially with 80+ relations. This is why I'm using canvas-data-loader

@Mythra
Copy link
Contributor Author

Mythra commented Nov 13, 2018

How are you uploading? Again we don't do any padding on our end, so I feel like this is coming from the source data. Can you look through the source data for these 5's? A simple grep should be all that's needed.

@latifatbraimah
Copy link

I use LOAD DATA LOCAL INFILE and No. Just checked my downloads, no padding with 5s

@Mythra
Copy link
Contributor Author

Mythra commented Nov 14, 2018

Hmm canvas data loader should pretty much be doing the same thing. Can you let me know what school your with so I can check your data? Also what version of MySQL are you using?

If you don't feel comfortable giving out school info on this public forum you can always file a support case by emailing [email protected] ,and we can work through it there as well.

@Mythra
Copy link
Contributor Author

Mythra commented Jan 28, 2019

I'm going to close this because there hasn't been a response. I'm assuming you have filed a support case, and it was resolved. If this still isn't resolved feel free to comment again, and it should automatically reopen.

@Mythra Mythra closed this as completed Jan 28, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants