View Issue Details

IDProjectCategoryView StatusLast Update
0004140SymmetricDSBugpublic2019-11-05 17:00
ReporterelongAssigned Toelong 
Prioritynormal 
Status resolvedResolutionfixed 
Product Version3.11.0 
Target Version3.11.0Fixed in Version3.11.0 
Summary0004140: Purge job performance with offline nodes
DescriptionOffline nodes prevent batches from purging and slows down the purge job. The purge job continually scans ID ranges in sym_data, sym_data_event, and sym_outgoing_batch each time it runs. After an extended period of time, it slows down scanning the same ID ranges even though it can't delete the data yet.

Modify purge to record the last ID used in sym_context, so it only scans a range of IDs once. Add a special routine that purges by batch any of the lingering batches from offline nodes. See attached design document.
TagsNo tags attached.

Activities

elong

2019-11-05 10:09

developer  

Purge Modification.pdf (43,276 bytes)

Related Changesets

SymmetricDS: 3.11 c91252d2

2019-11-05 10:37:12

admin

Details Diff
0004140: Purge job performance with offline nodes
0004140
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/AbstractSymmetricEngine.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ContextConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/PurgeService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/PurgeServiceSqlMap.java Diff File
mod - symmetric-core/src/main/resources/symmetric-default.properties Diff File

Issue History

Date Modified Username Field Change
2019-11-05 10:09 elong New Issue
2019-11-05 10:09 elong Status new => assigned
2019-11-05 10:09 elong Assigned To => elong
2019-11-05 10:09 elong File Added: Purge Modification.pdf
2019-11-05 16:10 elong Status assigned => resolved
2019-11-05 16:10 elong Resolution open => fixed
2019-11-05 16:10 elong Fixed in Version => 3.11.0
2019-11-05 17:00 admin Changeset attached => SymmetricDS 3.11 c91252d2