View Issue Details

IDProjectCategoryView StatusLast Update
0006279SymmetricDSImprovementpublic2024-04-19 15:46
Reporterpmarzullo Assigned Topmarzullo  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.15.0 
Target Version3.15.4Fixed in Version3.15.4 
Summary0006279: Make File Sync Tracker transactions smaller to minimize locking collision problems
DescriptionFile Sync Tracker writes all file changes to sym_file_snapshot in one database transaction.
When the number of changes found are very large, this can put a lot of stress on the database and causing lockout problems in sym_data because the sym_file_snapshot changes are captured into sym_data.
This can cause data extractor and router to have problems accessing sym_data.

To fix:
Define a new parameter that specifies the number of changes in one database transaction.
Change FileSyncService.save(...) to use this new parameter to limit the number of changes in the database per transaction.
Additional Information# Parameter
filesynctracker.max.rows.before.commit=10000
Tagsfile sync

Activities

pmarzullo

2024-03-08 17:12

developer   ~0002420

The File Sync Fast Scan uses the parameter dataloader.max.rows.before.commit for the max changes before commit value.
Let's make it use the new parameter filesynctracker.max.rows.before.commit.

Related Changesets

SymmetricDS: 3.15 35d6d1e1

2024-03-11 15:52:56

pmarzullo

Details Diff
0006279: Make File Sync Tracker transactions smaller to minimize locking
collision problems
Affected Issues
0006279
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/FileSyncService.java Diff File
mod - symmetric-core/src/main/resources/symmetric-default.properties Diff File

Issue History

Date Modified Username Field Change
2024-03-07 19:31 pmarzullo New Issue
2024-03-07 19:31 pmarzullo Status new => assigned
2024-03-07 19:31 pmarzullo Assigned To => pmarzullo
2024-03-07 19:31 pmarzullo Tag Attached: file sync
2024-03-08 17:12 pmarzullo Note Added: 0002420
2024-03-11 15:53 pmarzullo Status assigned => resolved
2024-03-11 15:53 pmarzullo Resolution open => fixed
2024-03-11 15:53 pmarzullo Fixed in Version => 3.15.4
2024-03-19 16:20 admin Status resolved => closed
2024-04-19 15:46 pmarzullo Changeset attached => SymmetricDS 3.15 35d6d1e1