View Issue Details

IDProjectCategoryView StatusLast Update
0005612SymmetricDS ProBugpublic2022-12-15 21:11
Reporternacyolsa Assigned To 
Priorityhigh 
Status closedResolutionno change required 
Product Version3.14.2 
Summary0005612: Node registration randomly takes a few hours
DescriptionI'm experiencing issue with registration between 3.14.2 (central node) and 3.9.8 nodes. Sometimes it takes a few hours to complete the registration. It occurs randomly. I can make a few attempts of registration from scratch of the same node and the issue will occur or not.

I'm debugging this issue and added a few custom logs. Logs in central node:
INFO [central-node-000] [ConcurrentConnectionManager] [qtp1783568981-33586] Reserving connection for /sync/central-node-000/registration 11-1111
INFO [central-node-000] [RegistrationService] [qtp1783568981-33586] Just opened registration for external id of 11-1111 and a node group of in-store and a node id of 11-1111
INFO [central-node-000] [RegistrationService] [qtp1783568981-33586] Completed registration of node in-store:11-1111:11-1111
...
INFO [central-node-000] [ConcurrentConnectionManager] [qtp1783568981-33023] Reserving connection for /sync/central-node-000/registration 11-1111
INFO [central-node-000] [ConcurrentConnectionManager] [qtp1783568981-33023] Existing reservation: nodeId: 11-1111, channelId: 0, timeToLiveInMs: 9223372036854775807, createTime: 1670006934798, type: HARD, identifier: 11-1111
INFO [central-node-000] [ConcurrentConnectionManager] [qtp1783568981-33023] Node '11-1111' Channel 'null' requested a /sync/central-node-000/registration connection, but was rejected because it already has one
...
INFO [central-node-000] [ConcurrentConnectionManager] [qtp1783568981-33634] Reserving connection for /sync/central-node-000/registration 11-1111
INFO [central-node-000] [ConcurrentConnectionManager] [qtp1783568981-33634] Existing reservation: nodeId: 11-1111, channelId: 0, timeToLiveInMs: 9223372036854775807, createTime: 1670006934798, type: HARD, identifier: 11-1111
INFO [central-node-000] [ConcurrentConnectionManager] [qtp1783568981-33634] Node '11-1111' Channel 'null' requested a /sync/central-node-000/registration connection, but was rejected because it already has one
....a few hours later it will stop repeating and it's starting working


Logs which are repeating in child node:
[DataLoaderService] [node-11-1111-job-2] Using registration URL of http://url...
[RegistrationService] [node-11-1111-job-2] The request to register was rejected by the server. Either the server node is not started, the server is not configured properly or the registration url is incorrect
[RegistrationService] [node-11-1111-job-2] Could not register. Sleeping for 6000ms before attempting again.
Tagsregistration

Activities

nacyolsa

2022-12-04 21:23

reporter   ~0002226

It's issue in standard version not in PRO. By mistake I create it in the wrong project.

nacyolsa

2022-12-04 22:55

reporter   ~0002227

In the childe node there is also this exception:

[node-11-1111] [RegistrationService] [node-11-1111-job-2] Unexpected error during registration: Read timed out StackTraceKey.init [SocketTimeoutException:3526151396]
java.net.SocketTimeoutException: Read timed out
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
    at java.net.SocketInputStream.read(SocketInputStream.java:171)
    at java.net.SocketInputStream.read(SocketInputStream.java:141)
    at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
    at sun.security.ssl.InputRecord.read(InputRecord.java:503)
    at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
    at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
    at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
    at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
    at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
    at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
    at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
    at org.jumpmind.symmetric.transport.http.HttpIncomingTransport.openConnectionCheckRedirects(HttpIncomingTransport.java:159)
    at org.jumpmind.symmetric.transport.http.HttpIncomingTransport.openStream(HttpIncomingTransport.java:99)
    at org.jumpmind.symmetric.transport.http.HttpIncomingTransport.openReader(HttpIncomingTransport.java:125)
    at org.jumpmind.symmetric.service.impl.DataLoaderService.loadDataFromTransport(DataLoaderService.java:568)
    at org.jumpmind.symmetric.service.impl.DataLoaderService.loadDataFromPull(DataLoaderService.java:295)
    at org.jumpmind.symmetric.service.impl.DataLoaderService.loadDataFromPull(DataLoaderService.java:251)
    at org.jumpmind.symmetric.service.impl.RegistrationService.attemptToRegisterWithServer(RegistrationService.java:482)
    at org.jumpmind.symmetric.service.impl.RegistrationService.registerWithServer(RegistrationService.java:458)
    at org.jumpmind.symmetric.service.impl.PullService.pullData(PullService.java:89)
    at org.jumpmind.symmetric.job.PullJob.doJob(PullJob.java:48)
    at org.jumpmind.symmetric.job.AbstractJob.invoke(AbstractJob.java:226)
    at org.jumpmind.symmetric.job.AbstractJob.run(AbstractJob.java:297)
    at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:748)

nacyolsa

2022-12-07 15:58

reporter   ~0002228

Can be closed.

Issue History

Date Modified Username Field Change
2022-12-04 21:21 nacyolsa New Issue
2022-12-04 21:21 nacyolsa Tag Attached: registration
2022-12-04 21:23 nacyolsa Note Added: 0002226
2022-12-04 22:55 nacyolsa Note Added: 0002227
2022-12-07 15:58 nacyolsa Note Added: 0002228
2022-12-15 21:11 elong Status new => closed
2022-12-15 21:11 elong Resolution open => no change required