Time Sync issue 800xA PM866 contoller with external Galleon Time Server

Dear AKS,


Hopefully you can help us with the following issue:


We having a time sync issue on our 800xA system. The PM866 controller won’t synchronize anymore with our external Galleon time server.



If we are looking at the controller log the time was synchronized in the past:



I 2016-12-09 21:20:33.689 SNTP: Synch by Time Server 10.230.80.101


I 2016-12-09 21:20:33.689 SNTP: External Time Reference is GPS


I 2016-12-09 21:20:33.690 SNTP: Stratum is 1


W 2016-12-12 07:54:15.078 SNTP: No reply , Server 10.230.80.101 dropped 1


I 2016-12-12 07:54:48.247 SNTP: Synch by Time Server 10.230.80.101



But now the log file shows the following alarm:



W 2017-04-13 14:19:15.957 SNTP: No accepted time server found, 2


I 2017-04-13 14:19:26.969 SNTP: Server 10.230.80.101 not synchronized (Alarm)



Why does it say: No accepted time server found?


Does this mean the time is not reliable or doesn’t sees the controller the time server at all?


If we PING form the timeserver to controller it replies.





See also the enclosed document

 Time Sync Issues 800.docx


Add New Comment


jeroenaks   

asked 15 days ago
Closed



Best Answer

2

Probably, the controller does not find the source reliable.

Try recording the NTP traffic (UDP port 123) - here below I have inserted two examples (tcpdump and Wireshark) of a controller (172.16.80.102) successfully reading time off the reference (172.16.4.254) which in turn is synchronized by ABB corporate network time:

# tcpdump -vvv -i xl0 udp port 123
tcpdump: listening on xl0, link-type EN10MB

(the request)
13:39:58.768095 172.16.80.102.1030 > 172.16.4.254.ntp: [udp sum ok] v1 client strat 0 poll 0 prec 0 dist 0.000000 disp 0.000000 ref (unspec)@0.000000000 orig 0.000000000 rec -0.000000000 xmt +1501846798.178713202 [tos 0xfc] (ttl 63, id 37119, len 76)

(the reply)
13:39:58.768175 172.16.4.254.ntp > 172.16.80.102.1030: [udp sum ok] v1 server strat 6 poll 0 prec -6 dist 0.015197 disp 0.000000 ref de-s-nme0001.de.abb.com@3710834770.393064022 orig 1501846798.178713202 rec -2085978495.410569071 xmt -2085978495.410559058 [tos 0x10] (ttl 64, id 22107, len 76)

Look at the stratum value (6 in my case).

Stefan Stromqvist   

answered 14 days ago


 


By jeroenaks on 8/4/2017 | Like (0) | Report

On which system do we have to run Wireshark
We run it on an engineerclient connected to the control network. But we don't see any NTP traffic


By Stefan Stromqvist on 8/4/2017 | Like (0) | Report

You must run wireshark or tcpview on a node where the NTP traffic is passing, e.g. the connectivity server (if the NTP server is on the client server network).

If the NTP server is one SAME network as the controller, you must use tap the traffic in the switch (it must support Port Mirroring or SPAN).

If your switch is not supporting port mirroring you can put a hub between the NTP server and the control network and connect a PC with wireshark to the hub and record traffic off the hub.


Add New Comment


Answers

2

Probably, the controller does not find the source reliable.

Try recording the NTP traffic (UDP port 123) - here below I have inserted two examples (tcpdump and Wireshark) of a controller (172.16.80.102) successfully reading time off the reference (172.16.4.254) which in turn is synchronized by ABB corporate network time:

# tcpdump -vvv -i xl0 udp port 123
tcpdump: listening on xl0, link-type EN10MB

(the request)
13:39:58.768095 172.16.80.102.1030 > 172.16.4.254.ntp: [udp sum ok] v1 client strat 0 poll 0 prec 0 dist 0.000000 disp 0.000000 ref (unspec)@0.000000000 orig 0.000000000 rec -0.000000000 xmt +1501846798.178713202 [tos 0xfc] (ttl 63, id 37119, len 76)

(the reply)
13:39:58.768175 172.16.4.254.ntp > 172.16.80.102.1030: [udp sum ok] v1 server strat 6 poll 0 prec -6 dist 0.015197 disp 0.000000 ref de-s-nme0001.de.abb.com@3710834770.393064022 orig 1501846798.178713202 rec -2085978495.410569071 xmt -2085978495.410559058 [tos 0x10] (ttl 64, id 22107, len 76)

Look at the stratum value (6 in my case).

Stefan Stromqvist   

answered 14 days ago


 


By jeroenaks on 8/4/2017 | Like (0) | Report

On which system do we have to run Wireshark
We run it on an engineerclient connected to the control network. But we don't see any NTP traffic


By Stefan Stromqvist on 8/4/2017 | Like (0) | Report

You must run wireshark or tcpview on a node where the NTP traffic is passing, e.g. the connectivity server (if the NTP server is on the client server network).

If the NTP server is one SAME network as the controller, you must use tap the traffic in the switch (it must support Port Mirroring or SPAN).

If your switch is not supporting port mirroring you can put a hub between the NTP server and the control network and connect a PC with wireshark to the hub and record traffic off the hub.


Add New Comment


0

We tested this on a different location with the same timesync issue

Enclosed the result of WireShark

10.230.96.101 is the TimerServer

10.230.96.151 is the PM866 controller

 ResultWireShark1.pdf

jeroenaks   

answered 11 days ago


 


Add New Comment


0

I assume you noticed the problem???

The external clock is exposing a bad quality which causes the AC 800M controller to reject it. Also, have a look at the time stamps it provided - they are way off...

Compare with the capture I made.

The AC 800M NTP *client* is indeed using a strange "Transmit Timestamp" which the server returns in the "Origin" time field, however in my capture the server returns with valid data (Reference Timestamp) and a good stratum.

In your case, the server response is all bad data and a zero (bad) stratum.

Stefan Stromqvist   

answered 11 days ago


 


By jeroenaks on 8/9/2017 | Like (0) | Report

We found and solved the problem.
The problem has to do with rate limiting the abb client by the Galleon time server because of newer version of NTPd.

Thank you for helping us solving the problem!


Add New Comment


0



Why does the PM866 a request to the timeserver with ‘strange’ timestamps in the first place?  year 2083 and 1970?


jeroenaks   

answered 11 days ago


 


Add New Comment



Get weekly AKS updates


Partner Exclusive Webinars

 

> – Login to the partner portal to register



Points Redemption Program - Redeem your points for ABB training, Bluetooth speakers and mugs. Terms and conditions >


Earn points when you refer a friend
AKS Referral Program is "Live" - Learn more



AKS Experts


avatar
Ask nikismith   

Rank: 258

I have been a part of the Recording & Control Factory team for 17 years in total, having spent a number of years as a repairs technician withi the manufacturing department, but being in my current role for 9 years now.


avatar
Ask kstoilov   

Rank: 22

Control System Engineer: 800xA, Compact 800, AC500, AC31-50, Advant Master, Simatic, AC&DC Drives 11 years worked for ABB - Control Systems


avatar
Ask Harsha.D   

Rank: 5

Tech.Support,software and commisioning engineer with Proficient knowledge in 800xA and its products, RNRP,Networking in general.


avatar
Ask Rob Lyon   

Rank: 3

info@lymac.co.nz I'm an independent DCS software and commissioning engineer with extensive experience in 800xA and other ABB products. I've worked in almost every corner of the world and still haven't seen it all.


avatar
Ask Flavio Mussolin   

Rank: 6

ABB AVP, Senior Electronic and Automation Engineer with over 30 years of experience in the field of process automation automotive, pharmaceutical, hollow glass, steel and rolling.


avatar
Ask MMM   

Rank: 4

ABB PA CT Technical Support


avatar
Ask Govindaraj   

Rank: 10

Working in ABB India Operation Center. Have Project engineering and commissioning experience in ABB 800xA, Freelance, AC500.


avatar
Ask Stefan Stromqvist   

Rank: 1

I joined ABB in the year of 1994 and has since 1999 been working as a Service & Support Engineer at BU Control Technologies in Västerås, Sweden. My areas of expertise are: 800xA Base, 800xA for Advant Master, Information Management, operating systems, RNRP and Ethernet comms/networking in general.


avatar
Ask Sumit Gargav   

Rank: 2

I have worked with Freelance in majority, with 800xA FD and Melody system partly. Also had opportunity to work with Protocols - HART,Profibus,FF & Modbus.


avatar
Ask Dieter Henkel   

Rank: 24