Menu

Simple one-directional synchronization not working

Help
Bangassou
2018-05-02
2018-08-29
  • Bangassou

    Bangassou - 2018-05-02

    Hello,

    I am pretty new to SymmetricDS. I configured a simple one-directional sync from [simis-sirdi] to [simis-cito] for two tables and it was working for a while. Now it is no longer synchronizing and I don't know why. I restarted the service and attached the log below. There is no warning given. I have only two nodes, one channel and two triggers using MS SQL Server. Source and target databases have the same structure and scheme ... anybody able to detect the problem from the attached log file? Both nodes pick the same server id 'SIMISMAIN' - is this correct?

    2018-04-24 00:19:01,205 INFO [startup] [SymmetricWebServer] [main] About to start SymmetricDS web server on host:port 0.0.0.0:31415
    2018-04-24 00:19:01,735 INFO [startup] [/] [main] Initializing Spring root WebApplicationContext
    2018-04-24 00:19:01,798 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Initializing connection to database
    2018-04-24 00:19:01,798 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Initializing connection to database
    2018-04-24 00:19:02,328 INFO [simis-cito] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-0] Detected database 'Microsoft SQL Server', version '11', protocol 'jtds'
    2018-04-24 00:19:02,344 INFO [simis-cito] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-0] The IDatabasePlatform being used is org.jumpmind.db.platform.mssql.MsSql2008DatabasePlatform
    2018-04-24 00:19:02,344 INFO [simis-sirdi] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-1] Detected database 'Microsoft SQL Server', version '10', protocol 'jtds'
    2018-04-24 00:19:02,344 INFO [simis-sirdi] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-1] The IDatabasePlatform being used is org.jumpmind.db.platform.mssql.MsSql2008DatabasePlatform
    2018-04-24 00:19:02,453 INFO [simis-sirdi] [MsSqlSymmetricDialect] [symmetric-engine-startup-1] The DbDialect being used is org.jumpmind.symmetric.db.mssql.MsSqlSymmetricDialect
    2018-04-24 00:19:02,469 INFO [simis-sirdi] [ExtensionService] [symmetric-engine-startup-1] Found 0 extension points from the database that will be registered
    2018-04-24 00:19:02,484 INFO [simis-sirdi] [StagingManager] [symmetric-engine-startup-1] The staging directory was initialized at the following location: C:\symmetric-server-3.8.29\tmp\simis-sirdi
    2018-04-24 00:19:02,500 INFO [simis-sirdi] [ClusterService] [symmetric-engine-startup-1] This node picked a server id of SIMISMAIN
    2018-04-24 00:19:02,921 INFO [simis-cito] [MsSqlSymmetricDialect] [symmetric-engine-startup-0] The DbDialect being used is org.jumpmind.symmetric.db.mssql.MsSqlSymmetricDialect
    2018-04-24 00:19:02,968 INFO [startup] [/] [main] Initializing Spring FrameworkServlet 'rest'
    2018-04-24 00:19:02,999 INFO [simis-sirdi] [ExtensionService] [symmetric-engine-startup-1] Found 0 extension points from the database that will be registered
    2018-04-24 00:19:02,999 INFO [simis-sirdi] [ClientExtensionService] [symmetric-engine-startup-1] Found 7 extension points from spring that will be registered
    2018-04-24 00:19:03,015 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Initializing SymmetricDS database
    2018-04-24 00:19:03,015 INFO [simis-sirdi] [MsSqlSymmetricDialect] [symmetric-engine-startup-1] Checking if SymmetricDS tables need created or altered
    2018-04-24 00:19:03,108 INFO [simis-cito] [ExtensionService] [symmetric-engine-startup-0] Found 0 extension points from the database that will be registered
    2018-04-24 00:19:03,108 INFO [simis-cito] [StagingManager] [symmetric-engine-startup-0] The staging directory was initialized at the following location: C:\symmetric-server-3.8.29\tmp\simis-cito
    2018-04-24 00:19:03,108 INFO [simis-cito] [ClusterService] [symmetric-engine-startup-0] This node picked a server id of SIMISMAIN
    2018-04-24 00:19:03,171 INFO [startup] [SymmetricWebServer] [main] Starting JMX HTTP console on port 31416
    2018-04-24 00:19:03,202 INFO [startup] [SymmetricWebServer] [main] Joining the web server main thread
    2018-04-24 00:19:03,264 INFO [simis-cito] [ExtensionService] [symmetric-engine-startup-0] Found 0 extension points from the database that will be registered
    2018-04-24 00:19:03,264 INFO [simis-cito] [ClientExtensionService] [symmetric-engine-startup-0] Found 7 extension points from spring that will be registered
    2018-04-24 00:19:03,295 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Initializing SymmetricDS database
    2018-04-24 00:19:03,295 INFO [simis-cito] [MsSqlSymmetricDialect] [symmetric-engine-startup-0] Checking if SymmetricDS tables need created or altered
    2018-04-24 00:19:12,375 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Done initializing SymmetricDS database
    2018-04-24 00:19:12,375 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] SymmetricDS database version : 3.8.29
    2018-04-24 00:19:12,375 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] SymmetricDS software version : 3.8.29
    2018-04-24 00:19:12,406 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Starting registered node [group=simis-sirdi, id=000, externalId=000]
    2018-04-24 00:19:12,406 INFO [simis-sirdi] [TriggerRouterService] [symmetric-engine-startup-1] Synchronizing triggers
    2018-04-24 00:19:12,468 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Done initializing SymmetricDS database
    2018-04-24 00:19:12,468 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] SymmetricDS database version : 3.8.29
    2018-04-24 00:19:12,468 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] SymmetricDS software version : 3.8.29
    2018-04-24 00:19:12,812 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Starting registered node [group=simis-cito, id=000, externalId=000]
    2018-04-24 00:19:12,812 INFO [simis-cito] [TriggerRouterService] [symmetric-engine-startup-0] Synchronizing triggers
    2018-04-24 00:19:13,373 INFO [simis-sirdi] [TriggerRouterService] [symmetric-engine-startup-1] Done synchronizing triggers
    2018-04-24 00:19:13,373 INFO [simis-sirdi] [RouterJob] [symmetric-engine-startup-1] Starting job.routing on periodic schedule: every 5000ms with the first run at Tue Apr 24 00:19:23 CST 2018
    2018-04-24 00:19:13,389 INFO [simis-sirdi] [PushJob] [symmetric-engine-startup-1] Starting job.push on periodic schedule: every 10000ms with the first run at Tue Apr 24 00:19:23 CST 2018
    2018-04-24 00:19:13,389 INFO [simis-sirdi] [PullJob] [symmetric-engine-startup-1] Starting job.pull on periodic schedule: every 10000ms with the first run at Tue Apr 24 00:19:23 CST 2018
    2018-04-24 00:19:13,389 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.offline.push not configured for auto start
    2018-04-24 00:19:13,389 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.offline.pull not configured for auto start
    2018-04-24 00:19:13,389 INFO [simis-sirdi] [OutgoingPurgeJob] [symmetric-engine-startup-1] Starting job.purge.outgoing with cron expression: 0 0 0 * . Next scheduled time is: Wed Apr 25 00:00:00 CST 2018
    2018-04-24 00:19:13,389 INFO [simis-sirdi] [IncomingPurgeJob] [symmetric-engine-startup-1] Starting job.purge.incoming with cron expression: 0 0 0 * . Next scheduled time is: Wed Apr 25 00:00:00 CST 2018
    2018-04-24 00:19:13,389 INFO [simis-sirdi] [StatisticFlushJob] [symmetric-engine-startup-1] Starting job.stat.flush with cron expression: 0 0/5 * * . Next scheduled time is: Tue Apr 24 00:20:00 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [SyncTriggersJob] [symmetric-engine-startup-1] Starting job.synctriggers with cron expression: 0 0 0 * . Next scheduled time is: Wed Apr 25 00:00:00 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [HeartbeatJob] [symmetric-engine-startup-1] Starting job.heartbeat on periodic schedule: every 900000ms with the first run at Tue Apr 24 00:19:23 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [WatchdogJob] [symmetric-engine-startup-1] Starting job.watchdog on periodic schedule: every 3600000ms with the first run at Tue Apr 24 00:19:23 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [StageManagementJob] [symmetric-engine-startup-1] Starting job.stage.management with cron expression: 0 0 * * . Next scheduled time is: Tue Apr 24 01:00:00 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.refresh.cache not configured for auto start
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.file.sync.tracker not configured for auto start
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.file.sync.pull not configured for auto start
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.file.sync.push not configured for auto start
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [InitialLoadExtractorJob] [symmetric-engine-startup-1] Starting job.initial.load.extract on periodic schedule: every 10000ms with the first run at Tue Apr 24 00:19:23 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [MonitorJob] [symmetric-engine-startup-1] Starting job.monitor on periodic schedule: every 60000ms with the first run at Tue Apr 24 00:19:23 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.report.status not configured for auto start
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [SyncConfigJob] [symmetric-engine-startup-1] Starting job.sync.config with cron expression: 0 0/10 1 * . Next scheduled time is: Tue Apr 24 01:00:00 CST 2018
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Started SymmetricDS
    2018-04-24 00:19:13,404 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] SymmetricDS: type=server, name=simis-sirdi, version=3.8.29, groupId=simis-sirdi, externalId=000, databaseName=Microsoft SQL Server, databaseVersion=10.50, driverName=jTDS Type 4 JDBC Driver for MS SQL Server and Sybase, driverVersion=1.2.8
    2018-04-24 00:19:19,738 INFO [simis-cito] [TriggerRouterService] [symmetric-engine-startup-0] Done synchronizing triggers
    2018-04-24 00:19:19,738 INFO [simis-cito] [RouterJob] [symmetric-engine-startup-0] Starting job.routing on periodic schedule: every 5000ms with the first run at Tue Apr 24 00:19:29 CST 2018
    2018-04-24 00:19:19,738 INFO [simis-cito] [PushJob] [symmetric-engine-startup-0] Starting job.push on periodic schedule: every 10000ms with the first run at Tue Apr 24 00:19:29 CST 2018
    2018-04-24 00:19:19,738 INFO [simis-cito] [PullJob] [symmetric-engine-startup-0] Starting job.pull on periodic schedule: every 10000ms with the first run at Tue Apr 24 00:19:29 CST 2018
    2018-04-24 00:19:19,738 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.offline.push not configured for auto start
    2018-04-24 00:19:19,738 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.offline.pull not configured for auto start
    2018-04-24 00:19:19,738 INFO [simis-cito] [OutgoingPurgeJob] [symmetric-engine-startup-0] Starting job.purge.outgoing with cron expression: 0 0 0 * . Next scheduled time is: Wed Apr 25 00:00:00 CST 2018
    2018-04-24 00:19:19,738 INFO [simis-cito] [IncomingPurgeJob] [symmetric-engine-startup-0] Starting job.purge.incoming with cron expression: 0 0 0 * . Next scheduled time is: Wed Apr 25 00:00:00 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [StatisticFlushJob] [symmetric-engine-startup-0] Starting job.stat.flush with cron expression: 0 0/5 * * . Next scheduled time is: Tue Apr 24 00:20:00 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [SyncTriggersJob] [symmetric-engine-startup-0] Starting job.synctriggers with cron expression: 0 0 0 * . Next scheduled time is: Wed Apr 25 00:00:00 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [HeartbeatJob] [symmetric-engine-startup-0] Starting job.heartbeat on periodic schedule: every 900000ms with the first run at Tue Apr 24 00:19:29 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [WatchdogJob] [symmetric-engine-startup-0] Starting job.watchdog on periodic schedule: every 3600000ms with the first run at Tue Apr 24 00:19:29 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [StageManagementJob] [symmetric-engine-startup-0] Starting job.stage.management with cron expression: 0 0 * * . Next scheduled time is: Tue Apr 24 01:00:00 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.refresh.cache not configured for auto start
    2018-04-24 00:19:19,754 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.file.sync.tracker not configured for auto start
    2018-04-24 00:19:19,754 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.file.sync.pull not configured for auto start
    2018-04-24 00:19:19,754 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.file.sync.push not configured for auto start
    2018-04-24 00:19:19,754 INFO [simis-cito] [InitialLoadExtractorJob] [symmetric-engine-startup-0] Starting job.initial.load.extract on periodic schedule: every 10000ms with the first run at Tue Apr 24 00:19:29 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [MonitorJob] [symmetric-engine-startup-0] Starting job.monitor on periodic schedule: every 60000ms with the first run at Tue Apr 24 00:19:29 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.report.status not configured for auto start
    2018-04-24 00:19:19,754 INFO [simis-cito] [SyncConfigJob] [symmetric-engine-startup-0] Starting job.sync.config with cron expression: 0 0/10 1 * . Next scheduled time is: Tue Apr 24 01:00:00 CST 2018
    2018-04-24 00:19:19,754 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Started SymmetricDS
    2018-04-24 00:19:19,754 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] SymmetricDS: type=server, name=simis-cito, version=3.8.29, groupId=simis-cito, externalId=000, databaseName=Microsoft SQL Server, databaseVersion=11.0, driverName=jTDS Type 4 JDBC Driver for MS SQL Server and Sybase, driverVersion=1.2.8
    2018-04-24 00:19:23,201 INFO [simis-sirdi] [NodeCommunicationService] [simis-sirdi-job-3] pull will use 10 threads
    2018-04-24 00:19:23,201 INFO [simis-sirdi] [DataGapFastDetector] [simis-sirdi-job-1] Full gap analysis is running
    2018-04-24 00:19:23,217 INFO [simis-sirdi] [DataGapFastDetector] [simis-sirdi-job-1] Querying data in gaps from database took 16 ms
    2018-04-24 00:19:23,217 INFO [simis-sirdi] [DataGapFastDetector] [simis-sirdi-job-1] Full gap analysis is done after 16 ms
    2018-04-24 00:19:28,256 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-10] The 'heartbeat' channel is NOT in common batch mode
    2018-04-24 00:19:28,349 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-10] Routed 1 data events in 109 ms
    2018-04-24 00:19:29,597 INFO [simis-cito] [NodeCommunicationService] [simis-cito-job-3] pull will use 10 threads
    2018-04-24 00:19:29,597 INFO [simis-cito] [DataGapFastDetector] [simis-cito-job-1] Full gap analysis is running
    2018-04-24 00:19:29,691 INFO [simis-cito] [DataGapFastDetector] [simis-cito-job-1] Querying data in gaps from database took 94 ms
    2018-04-24 00:19:29,691 INFO [simis-cito] [DataGapFastDetector] [simis-cito-job-1] Full gap analysis is done after 94 ms
    2018-04-24 00:19:29,831 INFO [simis-cito] [RouterService] [simis-cito-job-1] The 'heartbeat' channel is NOT in common batch mode
    2018-04-24 00:19:30,486 INFO [simis-cito] [RouterService] [simis-cito-job-1] Routed 1 data events in 889 ms

     
  • Klementina Chirico

    Hi Bangassou,

    Could you provide more information on your node configuration (.properties) as well as your configuration for your triggers and channel?

    Thanks,
    Klementina

     
  • Maxwell Pettit

    Maxwell Pettit - 2018-05-09

    Hello,

    This log appears to be fine. The message about the server id is normal and shouldn't be part of the issue. Is this the latest output from your log? Note the date on the output is from 2018-04-24. If this is the latest output, this would suggest that the SymmetricDS service has been stopped and is no longer running. This might be the cause of your issue. Could you verify that your service is still running and give us the most recent output of your log?

    Thanks,
    Max

     
  • Bangassou

    Bangassou - 2018-07-25

    Hi, sorry for not being present for a while.

    I have the service running on both servers (right?). I am replicating one table only (for the beginning) which is called DeliveryTons, the channel has the name . If I insert a new column to this table on the source DB, I find a record in the SYM_OUTGOING_BATCH for the DELIVERY_TONS channel. This seems to be correct. The source node's log says:

    2018-07-25 02:07:07,233 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-14] The 'DeliveryTons' channel is NOT in common batch mode
    2018-07-25 02:07:07,233 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-14] Routed 1 data events in 0 ms

    But on my target server's DB I have nothing in the SYM_INCOMING_BATCH table. Also, there is nothing written to the target server's log file.

    Here come the two logs. The Source Node's log:
    2018-07-25 02:03:16,150 INFO [startup] [AbstractCommandLauncher] [main] Option: name=max-idle-time, value={90000}
    2018-07-25 02:03:16,150 INFO [startup] [AbstractCommandLauncher] [main] Option: name=no-log-console, value={}
    2018-07-25 02:03:16,228 INFO [startup] [SymmetricWebServer] [main] About to start SymmetricDS web server on host:port 0.0.0.0:31415
    2018-07-25 02:03:16,727 INFO [startup] [/] [main] Initializing Spring root WebApplicationContext
    2018-07-25 02:03:16,805 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Initializing connection to database
    2018-07-25 02:03:16,805 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Initializing connection to database
    2018-07-25 02:03:17,023 INFO [simis-sirdi] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-1] Detected database 'Microsoft SQL Server', version '10', protocol 'jtds'
    2018-07-25 02:03:17,039 INFO [simis-sirdi] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-1] The IDatabasePlatform being used is org.jumpmind.db.platform.mssql.MsSql2008DatabasePlatform
    2018-07-25 02:03:17,164 INFO [simis-sirdi] [MsSqlSymmetricDialect] [symmetric-engine-startup-1] The DbDialect being used is org.jumpmind.symmetric.db.mssql.MsSqlSymmetricDialect
    2018-07-25 02:03:17,195 INFO [simis-sirdi] [ExtensionService] [symmetric-engine-startup-1] Found 0 extension points from the database that will be registered
    2018-07-25 02:03:17,195 INFO [simis-sirdi] [StagingManager] [symmetric-engine-startup-1] The staging directory was initialized at the following location: tmp\simis-sirdi
    2018-07-25 02:03:17,211 INFO [simis-cito] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-0] Detected database 'Microsoft SQL Server', version '11', protocol 'jtds'
    2018-07-25 02:03:17,211 INFO [simis-cito] [JdbcDatabasePlatformFactory] [symmetric-engine-startup-0] The IDatabasePlatform being used is org.jumpmind.db.platform.mssql.MsSql2008DatabasePlatform
    2018-07-25 02:03:17,226 INFO [simis-sirdi] [ClusterService] [symmetric-engine-startup-1] This node picked a server id of SIMISMAIN
    2018-07-25 02:03:17,710 INFO [simis-cito] [MsSqlSymmetricDialect] [symmetric-engine-startup-0] The DbDialect being used is org.jumpmind.symmetric.db.mssql.MsSqlSymmetricDialect
    2018-07-25 02:03:17,866 INFO [simis-cito] [ExtensionService] [symmetric-engine-startup-0] Found 0 extension points from the database that will be registered
    2018-07-25 02:03:17,881 INFO [simis-cito] [StagingManager] [symmetric-engine-startup-0] The staging directory was initialized at the following location: tmp\simis-cito
    2018-07-25 02:03:17,881 INFO [simis-cito] [ClusterService] [symmetric-engine-startup-0] This node picked a server id of SIMISMAIN
    2018-07-25 02:03:17,991 INFO [simis-sirdi] [ExtensionService] [symmetric-engine-startup-1] Found 0 extension points from the database that will be registered
    2018-07-25 02:03:17,991 INFO [simis-sirdi] [ClientExtensionService] [symmetric-engine-startup-1] Found 7 extension points from spring that will be registered
    2018-07-25 02:03:18,022 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Initializing SymmetricDS database
    2018-07-25 02:03:18,022 INFO [simis-sirdi] [MsSqlSymmetricDialect] [symmetric-engine-startup-1] Checking if SymmetricDS tables need created or altered
    2018-07-25 02:03:18,225 INFO [simis-cito] [ExtensionService] [symmetric-engine-startup-0] Found 0 extension points from the database that will be registered
    2018-07-25 02:03:18,225 INFO [simis-cito] [ClientExtensionService] [symmetric-engine-startup-0] Found 7 extension points from spring that will be registered
    2018-07-25 02:03:18,240 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Initializing SymmetricDS database
    2018-07-25 02:03:18,240 INFO [simis-cito] [MsSqlSymmetricDialect] [symmetric-engine-startup-0] Checking if SymmetricDS tables need created or altered
    2018-07-25 02:03:18,474 INFO [startup] [/] [main] Initializing Spring FrameworkServlet 'rest'
    2018-07-25 02:03:18,849 INFO [startup] [SymmetricWebServer] [main] Starting JMX HTTP console on port 31416
    2018-07-25 02:03:18,895 INFO [startup] [SymmetricWebServer] [main] Joining the web server main thread
    2018-07-25 02:03:24,636 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Done initializing SymmetricDS database
    2018-07-25 02:03:24,636 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] SymmetricDS database version : 3.8.29
    2018-07-25 02:03:24,636 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] SymmetricDS software version : 3.8.29
    2018-07-25 02:03:24,667 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Starting registered node [group=simis-sirdi, id=000, externalId=000]
    2018-07-25 02:03:24,667 INFO [simis-sirdi] [TriggerRouterService] [symmetric-engine-startup-1] Synchronizing triggers
    2018-07-25 02:03:25,213 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Done initializing SymmetricDS database
    2018-07-25 02:03:25,213 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] SymmetricDS database version : 3.8.29
    2018-07-25 02:03:25,213 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] SymmetricDS software version : 3.8.29
    2018-07-25 02:03:25,307 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Starting registered node [group=simis-cito, id=000, externalId=000]
    2018-07-25 02:03:25,307 INFO [simis-cito] [TriggerRouterService] [symmetric-engine-startup-0] Synchronizing triggers
    2018-07-25 02:03:27,023 INFO [simis-sirdi] [TriggerRouterService] [symmetric-engine-startup-1] Done synchronizing triggers
    2018-07-25 02:03:27,023 INFO [simis-sirdi] [RouterJob] [symmetric-engine-startup-1] Starting job.routing on periodic schedule: every 5000ms with the first run at Wed Jul 25 02:03:36 CST 2018
    2018-07-25 02:03:27,039 INFO [simis-sirdi] [PushJob] [symmetric-engine-startup-1] Starting job.push on periodic schedule: every 10000ms with the first run at Wed Jul 25 02:03:36 CST 2018
    2018-07-25 02:03:27,039 INFO [simis-sirdi] [PullJob] [symmetric-engine-startup-1] Starting job.pull on periodic schedule: every 10000ms with the first run at Wed Jul 25 02:03:36 CST 2018
    2018-07-25 02:03:27,039 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.offline.push not configured for auto start
    2018-07-25 02:03:27,039 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.offline.pull not configured for auto start
    2018-07-25 02:03:27,163 INFO [simis-sirdi] [OutgoingPurgeJob] [symmetric-engine-startup-1] Starting job.purge.outgoing with cron expression: 0 0 0 * . Next scheduled time is: Thu Jul 26 00:00:00 CST 2018
    2018-07-25 02:03:27,163 INFO [simis-sirdi] [IncomingPurgeJob] [symmetric-engine-startup-1] Starting job.purge.incoming with cron expression: 0 0 0 * . Next scheduled time is: Thu Jul 26 00:00:00 CST 2018
    2018-07-25 02:03:27,163 INFO [simis-sirdi] [StatisticFlushJob] [symmetric-engine-startup-1] Starting job.stat.flush with cron expression: 0 0/5 * * . Next scheduled time is: Wed Jul 25 02:05:00 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [SyncTriggersJob] [symmetric-engine-startup-1] Starting job.synctriggers with cron expression: 0 0 0 * . Next scheduled time is: Thu Jul 26 00:00:00 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [HeartbeatJob] [symmetric-engine-startup-1] Starting job.heartbeat on periodic schedule: every 900000ms with the first run at Wed Jul 25 02:03:36 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [WatchdogJob] [symmetric-engine-startup-1] Starting job.watchdog on periodic schedule: every 3600000ms with the first run at Wed Jul 25 02:03:36 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [StageManagementJob] [symmetric-engine-startup-1] Starting job.stage.management with cron expression: 0 0 * * . Next scheduled time is: Wed Jul 25 03:00:00 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.refresh.cache not configured for auto start
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.file.sync.tracker not configured for auto start
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.file.sync.pull not configured for auto start
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.file.sync.push not configured for auto start
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [InitialLoadExtractorJob] [symmetric-engine-startup-1] Starting job.initial.load.extract on periodic schedule: every 10000ms with the first run at Wed Jul 25 02:03:36 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [MonitorJob] [symmetric-engine-startup-1] Starting job.monitor on periodic schedule: every 60000ms with the first run at Wed Jul 25 02:03:36 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [JobManager] [symmetric-engine-startup-1] Job job.report.status not configured for auto start
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [SyncConfigJob] [symmetric-engine-startup-1] Starting job.sync.config with cron expression: 0 0/10 1 * . Next scheduled time is: Thu Jul 26 01:00:00 CST 2018
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] Started SymmetricDS
    2018-07-25 02:03:27,179 INFO [simis-sirdi] [AbstractSymmetricEngine] [symmetric-engine-startup-1] SymmetricDS: type=server, name=simis-sirdi, version=3.8.29, groupId=simis-sirdi, externalId=000, databaseName=Microsoft SQL Server, databaseVersion=10.50, driverName=jTDS Type 4 JDBC Driver for MS SQL Server and Sybase, driverVersion=1.2.8
    2018-07-25 02:03:29,831 INFO [simis-cito] [TriggerRouterService] [symmetric-engine-startup-0] Done synchronizing triggers
    2018-07-25 02:03:29,831 INFO [simis-cito] [RouterJob] [symmetric-engine-startup-0] Starting job.routing on periodic schedule: every 5000ms with the first run at Wed Jul 25 02:03:39 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [PushJob] [symmetric-engine-startup-0] Starting job.push on periodic schedule: every 10000ms with the first run at Wed Jul 25 02:03:39 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [PullJob] [symmetric-engine-startup-0] Starting job.pull on periodic schedule: every 10000ms with the first run at Wed Jul 25 02:03:39 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.offline.push not configured for auto start
    2018-07-25 02:03:29,847 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.offline.pull not configured for auto start
    2018-07-25 02:03:29,847 INFO [simis-cito] [OutgoingPurgeJob] [symmetric-engine-startup-0] Starting job.purge.outgoing with cron expression: 0 0 0 * . Next scheduled time is: Thu Jul 26 00:00:00 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [IncomingPurgeJob] [symmetric-engine-startup-0] Starting job.purge.incoming with cron expression: 0 0 0 * . Next scheduled time is: Thu Jul 26 00:00:00 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [StatisticFlushJob] [symmetric-engine-startup-0] Starting job.stat.flush with cron expression: 0 0/5 * * . Next scheduled time is: Wed Jul 25 02:05:00 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [SyncTriggersJob] [symmetric-engine-startup-0] Starting job.synctriggers with cron expression: 0 0 0 * . Next scheduled time is: Thu Jul 26 00:00:00 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [HeartbeatJob] [symmetric-engine-startup-0] Starting job.heartbeat on periodic schedule: every 900000ms with the first run at Wed Jul 25 02:03:39 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [WatchdogJob] [symmetric-engine-startup-0] Starting job.watchdog on periodic schedule: every 3600000ms with the first run at Wed Jul 25 02:03:39 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [StageManagementJob] [symmetric-engine-startup-0] Starting job.stage.management with cron expression: 0 0 * * . Next scheduled time is: Wed Jul 25 03:00:00 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.refresh.cache not configured for auto start
    2018-07-25 02:03:29,847 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.file.sync.tracker not configured for auto start
    2018-07-25 02:03:29,847 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.file.sync.pull not configured for auto start
    2018-07-25 02:03:29,847 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.file.sync.push not configured for auto start
    2018-07-25 02:03:29,847 INFO [simis-cito] [InitialLoadExtractorJob] [symmetric-engine-startup-0] Starting job.initial.load.extract on periodic schedule: every 10000ms with the first run at Wed Jul 25 02:03:39 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [MonitorJob] [symmetric-engine-startup-0] Starting job.monitor on periodic schedule: every 60000ms with the first run at Wed Jul 25 02:03:39 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [JobManager] [symmetric-engine-startup-0] Job job.report.status not configured for auto start
    2018-07-25 02:03:29,847 INFO [simis-cito] [SyncConfigJob] [symmetric-engine-startup-0] Starting job.sync.config with cron expression: 0 0/10 1 * . Next scheduled time is: Thu Jul 26 01:00:00 CST 2018
    2018-07-25 02:03:29,847 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] Started SymmetricDS
    2018-07-25 02:03:29,847 INFO [simis-cito] [AbstractSymmetricEngine] [symmetric-engine-startup-0] SymmetricDS: type=server, name=simis-cito, version=3.8.29, groupId=simis-cito, externalId=000, databaseName=Microsoft SQL Server, databaseVersion=11.0, driverName=jTDS Type 4 JDBC Driver for MS SQL Server and Sybase, driverVersion=1.2.8
    2018-07-25 02:03:36,804 INFO [simis-sirdi] [NodeCommunicationService] [simis-sirdi-job-3] pull will use 10 threads
    2018-07-25 02:03:36,804 INFO [simis-sirdi] [DataGapFastDetector] [simis-sirdi-job-1] Full gap analysis is running
    2018-07-25 02:03:36,804 INFO [simis-sirdi] [DataGapFastDetector] [simis-sirdi-job-1] Querying data in gaps from database took 0 ms
    2018-07-25 02:03:36,804 INFO [simis-sirdi] [DataGapFastDetector] [simis-sirdi-job-1] Full gap analysis is done after 0 ms
    2018-07-25 02:03:39,659 INFO [simis-cito] [NodeCommunicationService] [simis-cito-job-3] pull will use 10 threads
    2018-07-25 02:03:39,690 INFO [simis-cito] [DataGapFastDetector] [simis-cito-job-1] Full gap analysis is running
    2018-07-25 02:03:39,753 INFO [simis-cito] [DataGapFastDetector] [simis-cito-job-1] Querying data in gaps from database took 63 ms
    2018-07-25 02:03:39,753 INFO [simis-cito] [DataGapFastDetector] [simis-cito-job-1] Full gap analysis is done after 63 ms
    2018-07-25 02:03:39,862 INFO [simis-cito] [RouterService] [simis-cito-job-1] The 'heartbeat' channel is NOT in common batch mode
    2018-07-25 02:03:40,767 INFO [simis-cito] [RouterService] [simis-cito-job-1] Routed 1 data events in 1077 ms
    2018-07-25 02:03:41,827 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-5] The 'heartbeat' channel is NOT in common batch mode
    2018-07-25 02:03:41,890 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-5] Routed 1 data events in 63 ms
    2018-07-25 02:07:07,233 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-14] The 'DeliveryTons' channel is NOT in common batch mode
    2018-07-25 02:07:07,233 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-14] Routed 1 data events in 0 ms
    2018-07-25 02:18:38,361 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-3] Routed 1 data events in 31 ms
    2018-07-25 02:18:41,777 INFO [simis-cito] [RouterService] [simis-cito-job-6] Routed 1 data events in 655 ms
    2018-07-25 02:33:39,777 INFO [simis-sirdi] [RouterService] [simis-sirdi-job-14] Routed 1 data events in 31 ms
    2018-07-25 02:33:42,757 INFO [simis-cito] [RouterService] [simis-cito-job-20] Routed 1 data events in 577 ms

    The destination node's log:
    2018-07-25 01:38:44,817 INFO [startup] [SymmetricWebServer] [main] About to start SymmetricDS web server on host:port 0.0.0.0:31415
    2018-07-25 01:38:45,114 INFO [startup] [/] [main] Initializing Spring root WebApplicationContext
    2018-07-25 01:38:45,942 INFO [startup] [/] [main] Initializing Spring FrameworkServlet 'rest'
    2018-07-25 01:38:46,083 INFO [startup] [SymmetricWebServer] [main] Starting JMX HTTP console on port 31416
    2018-07-25 01:38:46,130 INFO [startup] [SymmetricWebServer] [main] Joining the web server main thread
    2018-07-25 01:44:09,272 INFO [startup] [AbstractCommandLauncher] [main] Option: name=max-idle-time, value={90000}
    2018-07-25 01:44:09,272 INFO [startup] [AbstractCommandLauncher] [main] Option: name=no-log-console, value={}
    2018-07-25 01:44:09,319 INFO [startup] [SymmetricWebServer] [main] About to start SymmetricDS web server on host:port 0.0.0.0:31415
    2018-07-25 01:44:09,616 INFO [startup] [/] [main] Initializing Spring root WebApplicationContext
    2018-07-25 01:44:10,397 INFO [startup] [/] [main] Initializing Spring FrameworkServlet 'rest'
    2018-07-25 01:44:10,522 INFO [startup] [SymmetricWebServer] [main] Starting JMX HTTP console on port 31416
    2018-07-25 01:44:10,538 INFO [startup] [SymmetricWebServer] [main] Joining the web server main thread

    The source engine:

    engine.name=simis-sirdi
    db.driver=net.sourceforge.jtds.jdbc.Driver
    db.url=jdbc:jtds:sqlserver://SIMISMAIN;useCursors=true;bufferMaxMemory=10240;lobBuffer=5242880;
    db.user=xx
    db.password=xxxx
    registration.url=
    sync.url=http://localhost:8082/sync/simis-sirdi
    group.id=simis-sirdi
    external.id=000
    auto.registration=true
    job.purge.period.time.ms=7200000
    job.routing.period.time.ms=5000
    job.push.period.time.ms=10000
    job.pull.period.time.ms=10000
    initial.load.create.first=true

    The dest engine:
    engine.name=simis-cito
    db.driver=net.sourceforge.jtds.jdbc.Driver
    db.url=jdbc:jtds:sqlserver://10.1.2.17;useCursors=true;bufferMaxMemory=10240;lobBuffer=5242880
    db.user=xx
    db.password=xx
    registration.url=http://localhost:31415/sync/simis-sirdi
    sync.url=http://10.1.2.17:8082/sync/simis-cito
    group.id=simis-cito
    external.id=000
    job.purge.period.time.ms=7200000
    job.routing.period.time.ms=5000
    job.push.period.time.ms=10000
    job.pull.period.time.ms=10000
    initial.load.create.first=true

     
  • Maxwell Pettit

    Maxwell Pettit - 2018-07-25

    Hello,

    It looks like there may be somme confusion with your node/server setup.

    If both of your nodes are on the same machine, (and both of your engines files are in the same directory), then you do not need to have 2 SymmetricDS servers running.

    Note that in your first log, there is logging from the simis-cito node. This would indicate that you have 2 engines files in the SymmetricDS installation for the source node. If you want to host both nodes on the same machine then you only need 1 SymmetricDS installation.

    Please read the following docs for more details:
    https://www.symmetricds.org/doc/3.9/html/user-guide.html#_add_node

    Thanks,
    Max

     
  • Bangassou

    Bangassou - 2018-08-01

    Hi,
    No, I work with two different servers. And I have SymmetricDS installed on both servers. But the destination server's engine file has to be available on the source server's folder, right? Maybe the line

    registration.url=http://localhost:31415/sync/simis-sirdi

    in dest server engine file is wrong as it has to point to the source node server and from the point of view of the dest server a "localhost" is not pointing to an outside server?

     
  • Mark Michalek

    Mark Michalek - 2018-08-29

    Bangassou, each server should only have its own engine file. They communicate with each other only through the registration.url and sync.url properties.

     

Log in to post a comment.