View Issue Details

IDProjectCategoryView StatusLast Update
0003609SymmetricDSNew Featurepublic2018-06-21 15:16
Reporterjosh-a-hicksAssigned Tojosh-a-hicks 
Prioritynormal 
Status closedResolutionfixed 
Product Version3.9.9 
Target Version3.9.9Fixed in Version3.9.9 
Summary0003609: Kafka support as a load only node
DescriptionSetup a Kafka node through the engine properties file similar to a load only node with some additional options for sending messages. Support for messages to be sent in XML, Json, Avro, or CSV. Can also send messages by batch or by row. Control over the topic of the message by channel or by table of the change.

kafka.producer
kafka.format (Values: XML, JSON, AVRO, CSV)
kafka.message.by (Values : BATCH, ROW)
kafka.topic.by (Values : CHANNEL, TABLE)

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.9 ae87fc60

2018-06-20 09:30:43

josh-a-hicks

Details Diff
0003609: Kafka support as a load only node
0003609
mod - symmetric-client/src/main/java/org/jumpmind/symmetric/ClientSymmetricEngine.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/load/DefaultDataLoaderFactory.java Diff File
add - symmetric-core/src/main/java/org/jumpmind/symmetric/load/KafkaWriterFilter.java Diff File
mod - symmetric-db/src/main/java/org/jumpmind/db/platform/DatabaseNamesConstants.java Diff File
mod - symmetric-db/src/main/java/org/jumpmind/db/platform/cassandra/CassandraSqlTemplate.java Diff File
add - symmetric-db/src/main/java/org/jumpmind/db/platform/kafka/KafkaDdlBuilder.java Diff File
add - symmetric-db/src/main/java/org/jumpmind/db/platform/kafka/KafkaDdlReader.java Diff File
add - symmetric-db/src/main/java/org/jumpmind/db/platform/kafka/KafkaPlatform.java Diff File
add - symmetric-db/src/main/java/org/jumpmind/db/platform/kafka/KafkaSqlTemplate.java Diff File
add - symmetric-db/src/main/java/org/jumpmind/db/sql/AbstractJavaDriverSqlTemplate.java Diff File
add - symmetric-io/src/main/java/org/jumpmind/symmetric/io/data/writer/KafkaWriter.java Diff File
mod - symmetric-server/src/main/java/org/jumpmind/symmetric/web/SymmetricEngineHolder.java Diff File

SymmetricDS: 3.9 4a10d0a7

2018-06-21 08:16:40

josh-a-hicks

Details Diff
0003609: Kafka support as a load only node
0003609
mod - symmetric-assemble/common.gradle Diff File
mod - symmetric-assemble/src/asciidoc/appendix/databases.ad Diff File
add - symmetric-assemble/src/asciidoc/appendix/kafka.ad Diff File
mod - symmetric-assemble/src/asciidoc/examples.ad Diff File
add - symmetric-assemble/src/asciidoc/images/appendix/kafka-advanced-settings.png Diff File
add - symmetric-assemble/src/asciidoc/images/appendix/kafka-node-setup.png Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/load/KafkaWriterFilter.java Diff File

Issue History

Date Modified Username Field Change
2018-06-20 09:30 josh-a-hicks New Issue
2018-06-20 09:30 josh-a-hicks Status new => assigned
2018-06-20 09:30 josh-a-hicks Assigned To => josh-a-hicks
2018-06-21 09:00 josh-a-hicks Changeset attached => SymmetricDS 3.9 4a10d0a7
2018-06-21 09:00 josh-a-hicks Changeset attached => SymmetricDS 3.9 ae87fc60
2018-06-21 14:52 josh-a-hicks Status assigned => resolved
2018-06-21 14:52 josh-a-hicks Resolution open => fixed
2018-06-21 14:52 josh-a-hicks Fixed in Version => 3.9.9
2018-06-21 15:16 admin Status resolved => closed