View Issue Details

IDProjectCategoryView StatusLast Update
0005489SymmetricDSImprovementpublic2022-10-04 15:10
Reporterelong Assigned Toelong  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.12.0 
Target Version3.12.19Fixed in Version3.12.19 
Summary0005489: Backport support snapshot improvements
DescriptionMake some improvements to support snapshot, based on trouble we've seen on support:

- Get table definitions for tables that are loaded into, supporting variables and transforms
- Sort NOT OK batches by batch_id or create_time, OK batches sorted descending
- Add batch summary files, grouping by node_id and channel_id
- Add log summary file, based on errors and warnings from log
- Limit number of log files to current log plus 3 more
- Filter parameters that should be secret
- Use double quote escaping in CSV files so they open easily in spreadsheet tools
- Limit number of files in directory listings
- Separate directory listing of software from staging listing
- Staging directory listing for just current node, not multi-homed nodes
- Add parameters for limits on number of files, batches, and statistics
- Add purging of old snapshot files, with parameter for retention period
- Get staging directory location from staging manager, in case user has relocated it
- Only record node channel and host stats if they are non-zero to reduce size of tables
- Use of try-with-resources
- Logging of each step
- sorted properties doesn't always sort
- file timestamp printed twice in directory listings
- staging directory should not also be in directory listing
- show next run time for jobs
TagsNo tags attached.

Relationships

related to 0005231 closedelong SymmetricDS Pro Support snapshot file improvements 
related to 0005488 closedelong SymmetricDS Support snapshot fixes 

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.12 03616ea8

2022-09-30 21:21:04

admin

Details Diff
0005489: Backport support snapshot improvements Affected Issues
0005489
mod - symmetric-client/src/main/java/org/jumpmind/symmetric/util/SnapshotUtil.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/ITriggerRouterService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/TriggerRouterService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/TriggerRouterServiceSqlMap.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/util/LogSummaryAppenderUtils.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/util/SymmetricUtils.java Diff File
mod - symmetric-core/src/main/resources/symmetric-default.properties Diff File
mod - symmetric-io/src/main/java/org/jumpmind/symmetric/io/stage/IStagingManager.java Diff File
mod - symmetric-io/src/main/java/org/jumpmind/symmetric/io/stage/StagingManager.java Diff File

Issue History

Date Modified Username Field Change
2022-09-30 21:19 elong New Issue
2022-09-30 21:19 elong Status new => assigned
2022-09-30 21:19 elong Assigned To => elong
2022-09-30 21:19 elong Relationship added related to 0005231
2022-09-30 21:19 elong Relationship added related to 0005488
2022-09-30 21:21 elong Status assigned => resolved
2022-09-30 21:21 elong Resolution open => fixed
2022-09-30 21:21 elong Fixed in Version => 3.12.19
2022-09-30 22:00 admin Changeset attached => SymmetricDS 3.12 03616ea8
2022-10-04 15:10 admin Status resolved => closed