View Issue Details

IDProjectCategoryView StatusLast Update
0003886SymmetricDSImprovementpublic2019-03-14 08:48
ReporterelongAssigned Toelong 
Prioritynormal 
Status closedResolutionfixed 
Product Version3.10.0 
Target Version3.10.0Fixed in Version3.10.0 
Summary0003886: Initial load foreign key error auto resolve
DescriptionWhen sending an initial load or reload batches, the data loader may receive a foreign key exception for missing rows. This can happen when changes are happening on a busy database, since each table extraction is happening at different times. The normal auto resolution for change data capture relies on the acknowledge service using sym_data for the row in error and the source database for FK references to send reload batches to fix. This doesn't work when the error is already on the reload channel and when there is nothing in sym_data to query for row data.

Instead, use the reverse logic of the dataloader service using the target database for the FK references and send a script to the source node that sends reloads on the config channel. Enabled with parameter auto.resolve.foreign.key.violation.reverse.reload=true.
TagsNo tags attached.

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.10 323e00b5

2019-03-07 13:15:42

elong

Details Diff
0003886: Initial load foreign key error auto resolve
0003886
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/IDataService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/AcknowledgeService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataLoaderService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataService.java Diff File
mod - symmetric-core/src/main/resources/symmetric-default.properties Diff File

SymmetricDS: 3.10 8e823078

2019-03-08 10:21:10

admin

Details Diff
0003886: Initial load foreign key error auto resolve
0003886
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataService.java Diff File

Issue History

Date Modified Username Field Change
2019-03-07 13:14 elong New Issue
2019-03-07 13:14 elong Status new => assigned
2019-03-07 13:14 elong Assigned To => elong
2019-03-07 13:18 elong Status assigned => resolved
2019-03-07 13:18 elong Resolution open => fixed
2019-03-07 13:18 elong Fixed in Version => 3.10.0
2019-03-07 14:00 elong Changeset attached => SymmetricDS 3.10 323e00b5
2019-03-08 11:00 admin Changeset attached => SymmetricDS 3.10 8e823078
2019-03-14 08:48 admin Status resolved => closed