View Issue Details

IDProjectCategoryView StatusLast Update
0005450SymmetricDSImprovementpublic2022-10-04 15:15
Reporterelong Assigned Toelong  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.14.0 
Target Version3.14.2Fixed in Version3.14.2 
Summary0005450: Routing default batch algorithm protection against large transactions
DescriptionProtect against a large transaction that greatly exceeds the max batch size of the channel. There have been multiple instances where an entire table is updated or a batch process commits all at once. The default batch algorithm will exceed the channel's max batch size to put the complete transaction in the same batch.

Some cases seen on support:
1) User was confused what routing was doing and why it was taking so long, when it was just working on creating such large batches.
2) The batch had trouble sending across a flaky network that kept timing out.
3) The data loader struggled to apply and commit all rows on the smaller target database.
Tagsrouting

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.14 4697850a

2022-09-08 14:48:22

admin

Details Diff
0005450: Routing default batch algorithm protection against large
transactions
Affected Issues
0005450
mod - symmetric-assemble/src/asciidoc/configuration/channels.ad Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/route/DefaultBatchAlgorithm.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/route/SimpleRouterContext.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/RouterService.java Diff File
mod - symmetric-core/src/main/resources/symmetric-default.properties Diff File

SymmetricDS: 3.14 217bdaf2

2022-09-08 19:45:08

admin

Details Diff
0005450: Routing default batch algorithm protection against large
transactions
Affected Issues
0005450
mod - symmetric-core/src/test/java/org/jumpmind/symmetric/service/impl/AbstractRouterServiceTest.java Diff File

Issue History

Date Modified Username Field Change
2022-09-07 20:29 elong New Issue
2022-09-07 20:29 elong Status new => assigned
2022-09-07 20:29 elong Assigned To => elong
2022-09-07 20:29 elong Tag Attached: routing
2022-09-08 14:48 elong Status assigned => resolved
2022-09-08 14:48 elong Resolution open => fixed
2022-09-08 14:48 elong Fixed in Version => 3.14.2
2022-09-08 15:00 admin Changeset attached => SymmetricDS 3.14 4697850a
2022-09-08 20:00 admin Changeset attached => SymmetricDS 3.14 217bdaf2
2022-10-04 15:15 admin Status resolved => closed