View Issue Details

IDProjectCategoryView StatusLast Update
0002783SymmetricDSBugpublic2023-09-13 17:49
Reportergatokino Assigned To 
Prioritynormal 
Status closedResolutionwon't fix 
Product Version3.8.3 
Summary0002783: PostgresqBulk is failling with org.postgresql.util.PSQLException invalid UTF-8 sequence
Descriptioninitial load with postgres_bulk is failling agains a postgres database that is in UNICODE character set using a symmetricds in a virtual java machine with another character encoding
Additional Informationthe fault is comming because bytes are sent in the java String default encoding instead of database encoding

byte[] dataToLoad = formattedData.getBytes();
copyIn.writeToCopy(dataToLoad, 0, dataToLoad.length);


A solution is to use unicode encoding in COPY FROM command and sending the data in UTF-8 format


changes are:
line 105: byte[] dataToLoad = formattedData.getBytes("UTF-8");
line 231: sql.append("FROM STDIN with delimiter ',' csv quote '''' ENCODING 'UNICODE'");


Tagsbulk, dialect: postgresql

Relationships

related to 0002257 closed Loading TEXT field with postgres_bulk loader: invalid byte sequence for encoding "UTF8": 0x00 

Activities

gatokino

2016-09-09 18:59

reporter  

admin

2016-09-30 14:28

administrator   ~0000875

Re-opening. Was accidentally closed when performing the release.

Issue History

Date Modified Username Field Change
2016-09-09 18:59 gatokino New Issue
2016-09-09 18:59 gatokino File Added: PostgresBulkDatabaseWriter.java
2016-09-30 01:01 admin Status new => closed
2016-09-30 14:28 admin Status closed => new
2016-09-30 14:28 admin Note Added: 0000875
2019-04-24 13:10 elong Tag Attached: bulk
2019-04-24 13:10 elong Tag Attached: dialect: postgresql
2022-09-09 21:29 elong Relationship added related to 0002257
2023-09-13 17:49 emiller Status new => closed
2023-09-13 17:49 emiller Resolution open => won't fix