View Issue Details
ID | Project | Category | View Status | Date Submitted | Last Update |
---|---|---|---|---|---|
0003804 | SymmetricDS | Bug | public | 2018-11-26 14:24 | 2019-08-26 12:53 |
Reporter | Nick | Assigned To | admin | ||
Priority | urgent | ||||
Status | closed | Resolution | unable to reproduce | ||
Product Version | 3.9.14 | ||||
Summary | 0003804: Missing INSERT | ||||
Description | In tmp/store-001/incoming/000/0000001478.done I see: --------- nodeid,000 binary,HEX channel,user batch,1478 catalog, schema, table,WITS_USER_SETTINGS keys,user_id,name columns,user_id,name,wellbore_id,value,form_id,shared,update_time old,"71","UIGlobal",,"<ui> <planshets> <viewsize axis=\"TIME\">7200</viewsize> <viewsize axis=\"DEPTH\">100</viewsize> </planshets> </ui>",,"0","2018-11-25 11:00:06" update,"71","UIGlobal",,"<ui> <planshets> <viewsize axis=\"TIME\">14400</viewsize> <viewsize axis=\"DEPTH\">100</viewsize> </planshets> </ui>",,"0","2018-11-25 12:13:50","71","UIGlobal" old,"71","UIGlobal",,"<ui> <planshets> <viewsize axis=\"TIME\">7200</viewsize> <viewsize axis=\"DEPTH\">100</viewsize> </planshets> </ui>",,"0","2018-11-25 11:00:06" update,"71","UIGlobal",,"<ui> <planshets> <viewsize axis=\"TIME\">14400</viewsize> <viewsize axis=\"DEPTH\">100</viewsize> </planshets> </ui>",,"0","2018-11-25 12:13:50","71","UIGlobal" catalog, schema, table,comment keys,id columns,id,user_id,wellbore_id,log_id,log_depth,log_date,mnemonic,text,shared,created_date,modified_date,removed,sync_guid,update_time insert,"53325","71","464","1",,"2018-11-25 12:13:50","CHKP","41.24 кгс/см²","1","2018-11-25 12:13:54","2018-11-25 12:13:54","0","17f5a591-d91d-4536-b281-a5eb879e2129","2018-11-25 12:13:54" commit,1478 ------------- But there is no record with id 53325 in "comment" table. There is no errors in log file, update table WITS_USER_SETTINGS is OK. Another insert is OK ex.: ------ tmp/store-001/incoming/000/0000001237.done nodeid,000 binary,HEX channel,user batch,1237 catalog, schema, table,comment keys,id columns,id,user_id,wellbore_id,log_id,log_depth,log_date,mnemonic,text,shared,created_date,modified_date,removed,sync_guid,update_time insert,"53291","41","553","11",,"2018-11-25 07:19:45","TVT","83.56 м³","1","2018-11-25 06:48:42","2018-11-25 06:48:42","0","b9139bbb-9558-4321-addb-8faadeb9ce8c","2018-11-25 06:48:42" commit,1237 -------- mysql> select * from sym_incoming_batch where batch_id = 1478\G; *************************** 1. row *************************** batch_id: 1478 node_id: 000 channel_id: user status: OK error_flag: 0 sql_state: NULL sql_code: 0 sql_message: NULL last_update_hostname: tsserver last_update_time: 2018-11-25 07:14:00 create_time: 2018-11-25 07:14:00 summary: wits_user_settings, comment ignore_count: 0 byte_count: 1374 load_flag: 0 extract_count: 1 sent_count: 1 load_count: 0 reload_row_count: 0 other_row_count: 0 data_row_count: 3 extract_row_count: 3 load_row_count: 2 data_insert_row_count: 1 data_update_row_count: 2 data_delete_row_count: 0 extract_insert_row_count: 1 extract_update_row_count: 2 extract_delete_row_count: 0 load_insert_row_count: 0 load_update_row_count: 2 load_delete_row_count: 0 network_millis: 0 filter_millis: 0 load_millis: 3 router_millis: 4 extract_millis: 3 transform_extract_millis: 0 transform_load_millis: 0 load_id: -1 common_flag: 1 fallback_insert_count: 0 fallback_update_count: 0 ignore_row_count: 0 missing_delete_count: 0 skip_count: 0 failed_row_number: 0 failed_line_number: 0 failed_data_id: 0 1 row in set (0.00 sec) | ||||
Tags | data sync | ||||
|
Nick, thanks for reaching out. Here are some things to check: 1) When your insert happens on the source database, there should be an entry for it in sym_data. Note the data_id for that sym_data entry for your row. 2) Once the routing job runs, there should be an outgoing batch on the source with your insert. You can see what batch your data is in like this: select * from sym_outgoing_batch b where b.batch_id = (select e.batch_id from sym_data_event e where e.data_id = ?) 3) Is that batch routed to the node you expect (ie, what's the node_id value)? 4) When the batch status is OK, can compare the CSV in the outgoing directory on the source, and the incoming directory on the target. I would suggest posting your findings from these steps on the symmetric ds open source forum - I think you'll get more responsive help there. https://sourceforge.net/p/symmetricds/discussion/739236/ If you narrow the situation down to a specific bug case then it would make sense to post a bug here. |
|
One interesting bit is in the batch statistics. It has data_row_count and extract_row_count of 3, but the load_row_count is 2. Looking at the load counts, the load_update_row_count is 2 and the load_insert_row_count is 0. So the stats are saying it captured and extracted the row for comment, but it was not loaded. Do you have a load filter or a load transform on the comments table? |
|
Closing, no feedback to troubleshoot or reproduce. |
Date Modified | Username | Field | Change |
---|---|---|---|
2018-11-26 14:24 | Nick | New Issue | |
2018-12-05 16:54 | mmichalek | Note Added: 0001361 | |
2019-04-25 15:06 | elong | Assigned To | => elong |
2019-04-25 15:06 | elong | Status | new => feedback |
2019-04-25 15:06 | elong | Assigned To | elong => |
2019-04-25 15:06 | elong | Tag Attached: data sync | |
2019-06-01 00:03 | elong | Note Added: 0001516 | |
2019-08-26 12:53 | admin | Assigned To | => admin |
2019-08-26 12:53 | admin | Status | feedback => closed |
2019-08-26 12:53 | admin | Resolution | open => unable to reproduce |
2019-08-26 12:53 | admin | Note Added: 0001594 |