Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I'm very glad I switched to IQFeed. It's working perfectly with no lag, even during fast market conditions." - Comment from Andy via Email
"I used to have *******, but they are way more money for the same thing. I have had no probs with data from DTN since switching over." - Comment from Public Forum Post
"I had always used ******* but for the past 2 weeks have been trying DTN IQFeed. Customer support has been extraordinary. They call just to make sure your problem hasn't recurred." - Comment from Public Forum
"I just wanted to let you know how fast and easy I found it to integrate IQFeed into our existing Java code using your JNI client. In my experience, such things almost never go so smoothly - great job!" - Comment from Nate
"Boy, probably spent a thousand hours trying to get ******* API to work right. And now two hours to have something running with IQFeed. Hmmm, guess I was pretty stupid to fight rather than switch all this time. And have gotten more customer service from you guys already than total from them… in five years." - Comment from Jim
"This is an excellent value, the system is generous (allowing for 500 stocks) and stable (and really is tick-by-tick), and the support is fantastic." - Comment from Shirin via Email
"IQ feed is brilliant. The support is mind-bending. What service!" - Comment from Public Forum Post
"Everything is working amazing now. I'm already impressed with the true-tick feed of IQFeed and it's ability to support my 480 symbol layout." - Comment from Tyler via Email
"You are much better than lawyers or the phone company because you answer the phone when I call! I just love your customer service." - Comment from Isreal
"My broker in Davenport suggested I give you a try as he uses your service and says its the best." - Comment from Bill via RT Chat
Home  Search  Register  Login  Blogs Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTN_IQFeed on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Product Support »DTN.IQ Client Software Support »Temporary recurring delays in stream data
Author Topic: Temporary recurring delays in stream data (8 messages, Page 1 of 1)

Norbert
-Interested User-
Posts: 5
Joined: Feb 8, 2018


Posted: Feb 8, 2018 01:00 PM          Msg. 1 of 8
Hi, I have the following issue: it seems that sometimes strem live data comes a bit delayed. The more symbols I watch the more I see delays on data comming in.

For example I am watching 10 symbols only. I only process lvl1 update messages.
I am comparing the Most_Recent_Trade_Time and my computer time (which I sync with NTP every 15 min getting a time drift of around 10ms only)
Most data comes within 150 ms, but once in a while the difference between my time and exchange last trade time grows up to 500 miliseconds or more! This happens for 2-3 seconds every 2 minutes or so (in average).
I don't understand this, as my network is quite stable and has almost no variation in roundtrip time to your IPs:

Ping statistics for 66.112.148.211: Packets: Sent = 390, Received = 389, Lost = 1 (0% loss),
Approximate round trip times in milli-seconds: Minimum = 125ms, Maximum = 130ms, Average = 125ms

Ping statistics for 204.11.56.48: Packets: Sent = 112, Received = 112, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds: Minimum = 134ms, Maximum = 136ms, Average = 135ms

If I increase the number of symbols, I see larger delays - up to more than 1 second when watching 500 symbols. All data comes delayed during this intervals.

It can't be from my application as it is doing very little processing and when data comes in time it is always processed well (e.g. outside these intervals). CPU is under 3% at any time. Memory also plenty free and using very little in my App (<10MB).
I use async sockets and process data right away. The only thing I do is to check the time difference (the delay) and write to console if higher than 400ms.
As you see above network is quite stable as well, I check the netowrk during this delay intervals and there is no difference in latency.

There is no data queued on IqConnect as I see in the Diagnostic utility - even when watching 500 symbols.

My question is why do I see these delays, is there a reason on your side for this? Specially when I watch 10 symbols there should be absolutely no delays unless they are caused by the exchange or something like this.

Thank you!

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Feb 8, 2018 01:59 PM          Msg. 2 of 8
Good afternoon,

It sounds like you have looked at everything on your end that I would have mentioned, and servers look solid today, so the other place that data could be delayed is when your connection is not ready to receive more data, it will queue up on our servers.

But, I can only see this at a moment in time, and currently there is nothing of interest there. No dropped data and queue is minimal. If you can load the app with a very high symbol count and re-create the delay, if you let me know when it gets delayed by something along the lines of 10 seconds and then I can try to catch it while it is happening.

There is a small buffer on the client side socket that could be in play here when the delays are subsecond, but Windows hides this buffer so I can't view what might be happening there.

Can you try and open up the IQWatchQuote app alongside your own to compare the delays that you seen in your app vs watchquote and let us know what happens there, it might provide some clues.

Tim

Norbert
-Interested User-
Posts: 5
Joined: Feb 8, 2018


Posted: Feb 8, 2018 02:58 PM          Msg. 3 of 8
I have been testing again now with 100 symbols, and the behaviour has become worse actually: the delays start almost immediately and they start piling up from 0.5sec and get to around 35 seconds!

I started testing approx: 15:55:30
The time I stopped testing: 15:57:00
The delay at this time was around: 29 seconds
These are exchange times.

If I run IQWatchQuote with SPY I see same dealy in Bid/Ask time

Norbert
-Interested User-
Posts: 5
Joined: Feb 8, 2018


Posted: Feb 8, 2018 03:14 PM          Msg. 4 of 8
Just realised someone was streaming netflix on my modest 45 Mbps connection, this could affect the IQFeed data streaming and therefore get these very bad results in test, I assume. I will need to repeat the tests tomorrow.
But it would be interesting to see if the data is queueing at your end, that could explain some of it.

But even with Netflix there are still 36Mbps of bandwidth left (I did a speed test).

A speed test to NebraskaLink (Omaha, NE) says about 9Mbps Download and 8Mbps Upload (Netflix still on), would this should enough?
Edited by Norbert on Feb 8, 2018 at 03:20 PM

Norbert
-Interested User-
Posts: 5
Joined: Feb 8, 2018


Posted: Feb 9, 2018 09:51 AM          Msg. 5 of 8
Can you please check between 10:48:51 and 10:48:54 (Exchange time)?
I re-ran the tests today 09 Feb 2018 with 100 symbols. During that time period the delay was 500-1100ms

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Feb 9, 2018 10:07 AM          Msg. 6 of 8
In order for me to check, I have to look at your connection when it is happening, so if you want to come into developer chat and we can coordinate the test I would be happy to do that for you.

In looking at your connection currently, I can see you are watching a fair number of symbols, with no data queued on this side currently and what appears to he a healthy connection. Are things better this morning on your end?

When you say we are delayed, what are you comparing your reception time to?
You said bids and asks are delayed in IQWatchQuote, by how much? Were other things on time?

Tim

Norbert
-Interested User-
Posts: 5
Joined: Feb 8, 2018


Posted: Feb 9, 2018 10:23 AM          Msg. 7 of 8
It is not happening all the time, it is happening every few minutes and lasts for a few seconds. I can't go to chat now, I need to leave for a while. Maybe we can schedule a chat later when I am back in a few hours. Last few times I tried chat there was no reply so I wrote here.

When I watched IQWatchQuote I could see the data there was also delayed just like the other streamed data. I could see bid/ask dates, that's why I mentioned them, but I guess all the info was delayed.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Feb 9, 2018 10:35 AM          Msg. 8 of 8
Ok, I have some meetings later today, but if you see me online when you get back, please track me down. There is very little that I can do to see or resolve sub-second delays as most are masked by the operating system. But, we will certainly do what we can to help.

Tim
 

 

Time: Sat October 20, 2018 1:52 PM CFBB v1.2.0 31 ms.
© AderSoftware 2002-2003