View Issue Details

IDProjectCategoryView StatusLast Update
0004219SymmetricDSImprovementpublic2020-01-02 09:42
Reporterelong Assigned Toelong  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.11.0 
Target Version3.11.3Fixed in Version3.11.3 
Summary0004219: Routing should use transaction and batch mode to insert multiple sym_outgoing_batch rows
DescriptionPotential bottleneck in routing when it commits after each sym_outgoing_batch row. Instead, it should use a transaction and batch mode JDBC to insert all rows and then commit. Performance is noticeable when using a thousand nodes with default routing. Also, add separate statistics for inserts and updates to sym_outgoing_batch that are logged during a long run. Add separate parameter for flush size of sym_outgoing_batch versus sym_data_event.
TagsNo tags attached.

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.11 82027ade

2019-12-31 11:08:50

admin

Details Diff
0004219: Routing should use transaction to insert multiple
sym_outgoing_batch rows
Affected Issues
0004219
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/route/ChannelRouterContext.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/RouterService.java Diff File

SymmetricDS: 3.11 f543133d

2019-12-31 15:24:00

admin

Details Diff
0004219: Routing should use transaction and batch mode to insert
multiple sym_outgoing_batch rows
Affected Issues
0004219
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/route/ChannelRouterContext.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/IOutgoingBatchService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/OutgoingBatchService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/RouterService.java Diff File
mod - symmetric-core/src/main/resources/symmetric-default.properties Diff File

SymmetricDS: 3.11 6db9fd03

2019-12-31 16:20:21

admin

Details Diff
0004219: Routing should use transaction and batch mode to insert
multiple sym_outgoing_batch rows
Affected Issues
0004219
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/RouterService.java Diff File

Issue History

Date Modified Username Field Change
2019-12-31 10:29 elong New Issue
2019-12-31 10:29 elong Status new => assigned
2019-12-31 10:29 elong Assigned To => elong
2019-12-31 11:09 elong Status assigned => resolved
2019-12-31 11:09 elong Resolution open => fixed
2019-12-31 11:09 elong Fixed in Version => 3.11.3
2019-12-31 12:00 admin Changeset attached => SymmetricDS 3.11 82027ade
2019-12-31 15:20 elong Summary Routing should use transaction to insert multiple sym_outgoing_batch rows => Routing should use transaction and batch mode to insert multiple sym_outgoing_batch rows
2019-12-31 15:20 elong Description Updated View Revisions
2019-12-31 16:00 admin Changeset attached => SymmetricDS 3.11 f543133d
2019-12-31 17:00 admin Changeset attached => SymmetricDS 3.11 6db9fd03
2020-01-02 09:42 admin Status resolved => closed