Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"Thanks for all of your help. Great customer service deserves to be recognized which one the reasons I've been a customer of DTN for over 10 years!" - Comment from Stuart
"I've been using IQFeed 4 in a multi-threaded situation for the last week or two on 2600 symbols or so with 100 simultaneous daily charts, and I have had 100% responsiveness." - Comment from Scott
"I just wanted to tell you what a fine job you have been doing. While *******, from what I hear, has been down and out, off and on, IQ feed has held like a champ this week." - Comment from Shirin
"As a past ******* customer(and not a happy one), IQ Feed by DTN is a much better and cheaper product with great customer support. I have had no problems at all since switching over." - Comment from Public Forum
"I started a trial a few weeks back before the market went wild. DTN.IQ didn’t miss anything and beat my other provider. I decided to stay with you because of the great service through all the volatility." - Comment from Mike
"You have an excellent feed. Very few spikes for Spot Forex." - Comment from Public Forum Post
"I use IQ Feed, Great stuff as far as data analysis information, storage and retrieval is concerned." - Comment from Public Forum
"I used to have *******, but they are way more money for the same thing. I have had no probs with data from DTN since switching over." - Comment from Public Forum Post
"Everything is working great with the API. I love it." - Comment from Calvin
"I'm satisfied with IQFeed. It's the most reliable and fastest quote feed I have ever used. Although I'm a resident in China, it's still very fast!" - Comment from Xiaofei
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »IQFeed Developer »IQFeed Developer Support »Market snapshot error on EDS / 5MS command
Author Topic: Market snapshot error on EDS / 5MS command (11 messages, Page 1 of 1)

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 19, 2019 09:31 PM          Msg. 1 of 11
I am testing out this command:

EDS,2,14,20190919,EDS_TODAY

And recieve this from the server (at 20:27 EDT)

EDS_TODAY,E,Incomplete file from server. 534364/23476219,
EDS_TODAY,!ENDMSG!,
EDS_TODAY,!ENDMSG!,

Not sure why the file is incomplete so late at night. Also, i am seeing TWO !endmsg!

I see the same error with the 5MS command at the same time period:

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

DTN_Gary_Stephen
-Interested User-
Posts: 52
Joined: Jul 3, 2019


Posted: Sep 20, 2019 10:26 AM          Msg. 2 of 11
Larry,

I will begin looking into this now. I was just able to run that command with no difficulties, so this may be a time-of-day thing.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 20, 2019 02:02 PM          Msg. 3 of 11
Update: I just saw this error in the DAY @ 13:15:46 EDT.

[lastMsg=5MS,2,14,5MS_10_2_14_20190920]

13:15:46.744 [nioEventLoopGroup-2-2] msg=5MS_10_2_14_20190920,E,Incomplete file from server. 534364/23566744,,

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 23, 2019 11:42 AM          Msg. 4 of 11
Hi Gary. Any updates on this?

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 30, 2019 09:48 PM          Msg. 5 of 11
Any updates?

DTN_Gary_Stephen
-Interested User-
Posts: 52
Joined: Jul 3, 2019


Posted: Oct 1, 2019 04:27 PM          Msg. 6 of 11
Larry,

I haven't been able to reproduce this behavior, and I'm not aware of any other reports of it. What I'd like you to do, if possible, is create a log file. In the Diagnostics app, go to the Logging tab, check Lookup Error in the Lookups section, and Save Changes. If this happens again, go to the same place and click Open Logfile to collect the file. You can send it to me at developer@iqfeed.net for investigation.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

altmany
-Interested User-
Posts: 45
Joined: Jul 30, 2018

IQML - IQFeed-MATLAB connector


Posted: Dec 21, 2019 10:00 AM          Msg. 7 of 11
Another report of this problem: http://forums.dtn.com/index.cfm?page=topic&topicID=5678

I have also gotten an unrelated independent report on this exact same problem for NASDAQ summary data.

It seems to be a problem that multiple people who use multiple different platforms have experienced. Please look into this matter.

Yair Altman
IQML - IQFeed-MATLAB connector
https://UndocumentedMatlab.com/IQML

I am not a DTN employee; my post reflects my personal opinion

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 01:36 PM          Msg. 8 of 11
I logged the error and sent it to developer@iqfeed.net. I am also willing to provide some simple c++ code to demonstrate the issue if necessary. Hopefully this will lead to a diagnosis and solution.

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 04:57 PM          Msg. 9 of 11
This may be a clue: I modified my code to not stop after the NASDAQ Market Summary fails. The application now goes ahead and attempts to download the OPERA Market Summary file. Both resulted in "E,Incomplete file from server. [received]/[expected]. In both cases, the received number was 525628, and the expected number was different.

So perhaps the received number being the same could lead to a cause. Fingers crossed.

DTN_Gary_Stephen
-Interested User-
Posts: 52
Joined: Jul 3, 2019


Posted: Jan 7, 2020 02:06 PM          Msg. 10 of 11
All,

We've had a handful of reports of this issue now, and I'm getting an official ticket raised to the development team. My notes about the issue so far:

- This behavior has been very rare. But when it does happen, it can be reproduced.
- So far, only attempts to retrieve the NASDAQ and OPERA exchanges seem to be affected.
- Both 5MS and EDS commands are affected.
- Each time it is reproduced, the number of bits of the failed file is the exactly same (varying slightly by the day it happens and/or exchange). This suggests a corrupt file-type problem as opposed to a connection problem.
- Wine log shows nothing out of the ordinary. All functions appear to work normally until failure point.
- IQFeed log shows an immediate (within 6 seconds) response of 1,E,Incomplete file from server.
- Which means that IQFeed isn't reading through the file, and then reaching a failure point. If so the parts of the file up to the failure point would be in the log.
- Oddly, this Incomplete File From Server message is sent twice, which parallels the report that !END_MSG! appears twice.
- Do not suspect a server issue. In reviewing our logs, affected users connected to a large number of different servers in our load balancing pool.
- I had an affected user (John Jones) see if a basic telnet connection would reproduce the problem. It did. So the issue seems linked to hardware or connection, not the program being run.

If there are any other observations, please add them to this thread. Due to the rarity of the problem, we may not have uncovered everything yet, and any examples will be helpful to have.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 7, 2020 03:21 PM          Msg. 11 of 11
In my case, it may be caused by virtualization. I am using Ubuntu 18.04 with a basic installation of wine. I have also tested Windows 10 running in VMWare Workstation 15 Player. Both environments fail with the "Incomplete file from server".

I then attempted the same on a Windows 10 machine (no virtualization) and was not able to reproduce the problem.

Returning to my Ubuntu machine, both "virtual" environments continue to fail. I am happy to help with any other testing you wish me to perform.
 

 

Time: Wed April 8, 2020 10:23 AM CFBB v1.2.0 32 ms.
© AderSoftware 2002-2003