View Issue Details

IDProjectCategoryView StatusLast Update
0003804SymmetricDSBugpublic2019-08-26 12:53
ReporterNick Assigned Toadmin  
Priorityurgent 
Status closedResolutionunable to reproduce 
Product Version3.9.14 
Summary0003804: Missing INSERT
DescriptionIn tmp/store-001/incoming/000/0000001478.done I see:
---------
nodeid,000
binary,HEX
channel,user
batch,1478
catalog,
schema,
table,WITS_USER_SETTINGS
keys,user_id,name
columns,user_id,name,wellbore_id,value,form_id,shared,update_time
old,"71","UIGlobal",,"<ui>
  <planshets>
    <viewsize axis=\"TIME\">7200</viewsize>
    <viewsize axis=\"DEPTH\">100</viewsize>
  </planshets>
</ui>",,"0","2018-11-25 11:00:06"
update,"71","UIGlobal",,"<ui>
  <planshets>
    <viewsize axis=\"TIME\">14400</viewsize>
    <viewsize axis=\"DEPTH\">100</viewsize>
  </planshets>
</ui>",,"0","2018-11-25 12:13:50","71","UIGlobal"
old,"71","UIGlobal",,"<ui>
  <planshets>
    <viewsize axis=\"TIME\">7200</viewsize>
    <viewsize axis=\"DEPTH\">100</viewsize>
  </planshets>
</ui>",,"0","2018-11-25 11:00:06"
update,"71","UIGlobal",,"<ui>
  <planshets>
    <viewsize axis=\"TIME\">14400</viewsize>
    <viewsize axis=\"DEPTH\">100</viewsize>
  </planshets>
</ui>",,"0","2018-11-25 12:13:50","71","UIGlobal"
catalog,
schema,
table,comment
keys,id
columns,id,user_id,wellbore_id,log_id,log_depth,log_date,mnemonic,text,shared,created_date,modified_date,removed,sync_guid,update_time
insert,"53325","71","464","1",,"2018-11-25 12:13:50","CHKP","41.24 кгс/см²","1","2018-11-25 12:13:54","2018-11-25 12:13:54","0","17f5a591-d91d-4536-b281-a5eb879e2129","2018-11-25 12:13:54"
commit,1478
-------------

But there is no record with id 53325 in "comment" table.
There is no errors in log file, update table WITS_USER_SETTINGS is OK.

Another insert is OK ex.:
------
tmp/store-001/incoming/000/0000001237.done
nodeid,000
binary,HEX
channel,user
batch,1237
catalog,
schema,
table,comment
keys,id
columns,id,user_id,wellbore_id,log_id,log_depth,log_date,mnemonic,text,shared,created_date,modified_date,removed,sync_guid,update_time
insert,"53291","41","553","11",,"2018-11-25 07:19:45","TVT","83.56 м³","1","2018-11-25 06:48:42","2018-11-25 06:48:42","0","b9139bbb-9558-4321-addb-8faadeb9ce8c","2018-11-25 06:48:42"
commit,1237
--------

mysql> select * from sym_incoming_batch where batch_id = 1478\G;
*************************** 1. row ***************************
                batch_id: 1478
                 node_id: 000
              channel_id: user
                  status: OK
              error_flag: 0
               sql_state: NULL
                sql_code: 0
             sql_message: NULL
    last_update_hostname: tsserver
        last_update_time: 2018-11-25 07:14:00
             create_time: 2018-11-25 07:14:00
                 summary: wits_user_settings, comment
            ignore_count: 0
              byte_count: 1374
               load_flag: 0
           extract_count: 1
              sent_count: 1
              load_count: 0
        reload_row_count: 0
         other_row_count: 0
          data_row_count: 3
       extract_row_count: 3
          load_row_count: 2
   data_insert_row_count: 1
   data_update_row_count: 2
   data_delete_row_count: 0
extract_insert_row_count: 1
extract_update_row_count: 2
extract_delete_row_count: 0
   load_insert_row_count: 0
   load_update_row_count: 2
   load_delete_row_count: 0
          network_millis: 0
           filter_millis: 0
             load_millis: 3
           router_millis: 4
          extract_millis: 3
transform_extract_millis: 0
   transform_load_millis: 0
                 load_id: -1
             common_flag: 1
   fallback_insert_count: 0
   fallback_update_count: 0
        ignore_row_count: 0
    missing_delete_count: 0
              skip_count: 0
       failed_row_number: 0
      failed_line_number: 0
          failed_data_id: 0
1 row in set (0.00 sec)
Tagsdata sync

Activities

mmichalek

2018-12-05 16:54

administrator   ~0001361

Nick, thanks for reaching out. Here are some things to check:
1) When your insert happens on the source database, there should be an entry for it in sym_data. Note the data_id for that sym_data entry for your row.
2) Once the routing job runs, there should be an outgoing batch on the source with your insert. You can see what batch your data is in like this:
select * from sym_outgoing_batch b where b.batch_id = (select e.batch_id from sym_data_event e where e.data_id = ?)
3) Is that batch routed to the node you expect (ie, what's the node_id value)?
4) When the batch status is OK, can compare the CSV in the outgoing directory on the source, and the incoming directory on the target.

I would suggest posting your findings from these steps on the symmetric ds open source forum - I think you'll get more responsive help there.
https://sourceforge.net/p/symmetricds/discussion/739236/

If you narrow the situation down to a specific bug case then it would make sense to post a bug here.

elong

2019-06-01 00:03

developer   ~0001516

One interesting bit is in the batch statistics. It has data_row_count and extract_row_count of 3, but the load_row_count is 2. Looking at the load counts, the load_update_row_count is 2 and the load_insert_row_count is 0. So the stats are saying it captured and extracted the row for comment, but it was not loaded. Do you have a load filter or a load transform on the comments table?

admin

2019-08-26 12:53

administrator   ~0001594

Closing, no feedback to troubleshoot or reproduce.

Issue History

Date Modified Username Field Change
2018-11-26 14:24 Nick New Issue
2018-12-05 16:54 mmichalek Note Added: 0001361
2019-04-25 15:06 elong Assigned To => elong
2019-04-25 15:06 elong Status new => feedback
2019-04-25 15:06 elong Assigned To elong =>
2019-04-25 15:06 elong Tag Attached: data sync
2019-06-01 00:03 elong Note Added: 0001516
2019-08-26 12:53 admin Assigned To => admin
2019-08-26 12:53 admin Status feedback => closed
2019-08-26 12:53 admin Resolution open => unable to reproduce
2019-08-26 12:53 admin Note Added: 0001594