View Issue Details

IDProjectCategoryView StatusLast Update
0006095SymmetricDSImprovementpublic2023-11-06 20:00
Reporterelong Assigned Toelong  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.14.0 
Target Version3.14.11Fixed in Version3.14.11 
Summary0006095: Contains big LOB check can be fooled by commas in data
DescriptionThe channel has a contains_big_lob setting that is usually disabled and allows the extractor to quickly extract data under the varchar limit. If data exceeds the varchar limit, it tries to detect it by counting the number of fields versus columns on the table. It does a quick comma count check, but it can be fooled if there are commas in the data. Wait for a Protocol Violation Exception to return on a batch (sql code -888) before doing extra processing of parsing the row data and checking data matches columns.

[DefaultDatabaseWriter] [client-2-dataloader-2] Failed to process update event in batch server-2299 on channel 'test1'.
Failed pk data was: "20"
Failed old data was: "20","fTuZqvknNchOBrkZdoPIX","O ","893429","2019-08-01 21:19:20.327"
org.jumpmind.exception.ParseException: The (mytest1) table's column count (6) does not match the data's column count (5)
    at org.jumpmind.symmetric.io.data.writer.AbstractDatabaseWriter.write(AbstractDatabaseWriter.java:155)
    at org.jumpmind.symmetric.io.data.writer.NestedDataWriter.write(NestedDataWriter.java:62)
    at org.jumpmind.symmetric.model.ProcessInfoDataWriter.write(ProcessInfoDataWriter.java:84)
    at org.jumpmind.symmetric.io.data.writer.NestedDataWriter.write(NestedDataWriter.java:62)
    at org.jumpmind.symmetric.io.data.writer.TransformWriter.write(TransformWriter.java:186)
    at org.jumpmind.symmetric.io.data.DataProcessor.forEachDataInTable(DataProcessor.java:194)
    at org.jumpmind.symmetric.io.data.DataProcessor.forEachTableInBatch(DataProcessor.java:160)
    at org.jumpmind.symmetric.io.data.DataProcessor.process(DataProcessor.java:108)
    at org.jumpmind.symmetric.service.impl.DataLoaderService$LoadIntoDatabaseOnArrivalListener$2.call(DataLoaderService.java:1069)
    at org.jumpmind.symmetric.service.impl.DataLoaderService$LoadIntoDatabaseOnArrivalListener$2.call(DataLoaderService.java:1)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:750)
Tagsdialect: oracle, large objects

Relationships

related to 0006096 closedelong Contains big LOB check can be fooled by commas in data 

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.14 66d4673f

2023-11-06 19:55:38

admin

Details Diff
0006095: Contains big LOB check can be fooled by commas in data Affected Issues
0006095
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/extract/SelectFromSymDataSource.java Diff File

SymmetricDS: 3.15 e817d29a

2023-11-06 19:55:38

admin

Details Diff
0006095: Contains big LOB check can be fooled by commas in data Affected Issues
0006095
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/extract/SelectFromSymDataSource.java Diff File

Issue History

Date Modified Username Field Change
2023-11-06 19:45 elong New Issue
2023-11-06 19:45 elong Status new => assigned
2023-11-06 19:45 elong Assigned To => elong
2023-11-06 19:45 elong Tag Attached: dialect: oracle
2023-11-06 19:45 elong Tag Attached: large objects
2023-11-06 19:56 elong Status assigned => resolved
2023-11-06 19:56 elong Resolution open => fixed
2023-11-06 19:56 elong Fixed in Version => 3.14.11
2023-11-06 19:57 elong Issue cloned: 0006096
2023-11-06 19:57 elong Relationship added related to 0006096
2023-11-06 20:00 admin Changeset attached => SymmetricDS 3.14 66d4673f
2023-11-06 20:00 admin Changeset attached => SymmetricDS 3.15 e817d29a
2023-12-16 01:56 admin Status resolved => closed