Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I just wanted to tell you what a fine job you have been doing. While *******, from what I hear, has been down and out, off and on, IQ feed has held like a champ this week." - Comment from Shirin
"Just a thank you for the very helpful and prompt assistance and services. You provided me with noticeably superior service in my setup compared to a couple of other options I had looked at." - Comment from John
"I am keeping IQFeed, much better reliabilty than *******. I may refer a few other people in the office to switch as well." - Comment from Don
"I will tell others who want to go into trading that DTN ProphetX is an invaluable tool, I don't think anyone can trade without it..." - Comment from Luther
"Version 4.0.0.2 has been working well for me and I appreciate that it is now a much tighter client to work with. I feel I can go to press with my own application and rely on a stable platform" - Comment from David in IA.
"There is no doubt that IQFeed is the best data provider. I am very satisfied with your services. And IQFeed is the only one that I would recommend to my friends. Now, most of them are using your product in China." - Comment from Zhezhe
"I just wanted to say how happy I am with your service. I was able to download the API docs last week and I was able to replicate Interactive Brokers historical bar queries and realtime bar queries over the weekend. That was about one of the fastest integrations that I've ever done and it works perfectly!!!!" - Comment from Jason via Email
"My broker in Davenport suggested I give you a try as he uses your service and says its the best." - Comment from Bill via RT Chat
"The people at Nirvana have very nice things to say about your company and I can see why! Price and service is a potent combination." - Comment from Ed
"I started a trial a few weeks back before the market went wild. DTN.IQ didn’t miss anything and beat my other provider. I decided to stay with you because of the great service through all the volatility." - Comment from Mike
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »IQFeed Developer Support »Market snapshot error on EDS / 5MS command
Author Topic: Market snapshot error on EDS / 5MS command (11 messages, Page 1 of 1)

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 19, 2019 09:31 PM          Msg. 1 of 11
I am testing out this command:

EDS,2,14,20190919,EDS_TODAY

And recieve this from the server (at 20:27 EDT)

EDS_TODAY,E,Incomplete file from server. 534364/23476219,
EDS_TODAY,!ENDMSG!,
EDS_TODAY,!ENDMSG!,

Not sure why the file is incomplete so late at night. Also, i am seeing TWO !endmsg!

I see the same error with the 5MS command at the same time period:

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Sep 20, 2019 10:26 AM          Msg. 2 of 11
Larry,

I will begin looking into this now. I was just able to run that command with no difficulties, so this may be a time-of-day thing.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 20, 2019 02:02 PM          Msg. 3 of 11
Update: I just saw this error in the DAY @ 13:15:46 EDT.

[lastMsg=5MS,2,14,5MS_10_2_14_20190920]

13:15:46.744 [nioEventLoopGroup-2-2] msg=5MS_10_2_14_20190920,E,Incomplete file from server. 534364/23566744,,

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 23, 2019 11:42 AM          Msg. 4 of 11
Hi Gary. Any updates on this?

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 30, 2019 09:48 PM          Msg. 5 of 11
Any updates?

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Oct 1, 2019 04:27 PM          Msg. 6 of 11
Larry,

I haven't been able to reproduce this behavior, and I'm not aware of any other reports of it. What I'd like you to do, if possible, is create a log file. In the Diagnostics app, go to the Logging tab, check Lookup Error in the Lookups section, and Save Changes. If this happens again, go to the same place and click Open Logfile to collect the file. You can send it to me at developer@iqfeed.net for investigation.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

altmany
-Interested User-
Posts: 73
Joined: Jul 30, 2018

IQML - IQFeed-MATLAB connector


Posted: Dec 21, 2019 10:00 AM          Msg. 7 of 11
Another report of this problem: http://forums.dtn.com/index.cfm?page=topic&topicID=5678

I have also gotten an unrelated independent report on this exact same problem for NASDAQ summary data.

It seems to be a problem that multiple people who use multiple different platforms have experienced. Please look into this matter.

Yair Altman
IQML - IQFeed-MATLAB connector
https://UndocumentedMatlab.com/IQML

I am not a DTN employee; my post reflects my personal opinion

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 01:36 PM          Msg. 8 of 11
I logged the error and sent it to developer@iqfeed.net. I am also willing to provide some simple c++ code to demonstrate the issue if necessary. Hopefully this will lead to a diagnosis and solution.

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 04:57 PM          Msg. 9 of 11
This may be a clue: I modified my code to not stop after the NASDAQ Market Summary fails. The application now goes ahead and attempts to download the OPERA Market Summary file. Both resulted in "E,Incomplete file from server. [received]/[expected]. In both cases, the received number was 525628, and the expected number was different.

So perhaps the received number being the same could lead to a cause. Fingers crossed.

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Jan 7, 2020 02:06 PM          Msg. 10 of 11
All,

We've had a handful of reports of this issue now, and I'm getting an official ticket raised to the development team. My notes about the issue so far:

- This behavior has been very rare. But when it does happen, it can be reproduced.
- So far, only attempts to retrieve the NASDAQ and OPERA exchanges seem to be affected.
- Both 5MS and EDS commands are affected.
- Each time it is reproduced, the number of bits of the failed file is the exactly same (varying slightly by the day it happens and/or exchange). This suggests a corrupt file-type problem as opposed to a connection problem.
- Wine log shows nothing out of the ordinary. All functions appear to work normally until failure point.
- IQFeed log shows an immediate (within 6 seconds) response of 1,E,Incomplete file from server.
- Which means that IQFeed isn't reading through the file, and then reaching a failure point. If so the parts of the file up to the failure point would be in the log.
- Oddly, this Incomplete File From Server message is sent twice, which parallels the report that !END_MSG! appears twice.
- Do not suspect a server issue. In reviewing our logs, affected users connected to a large number of different servers in our load balancing pool.
- I had an affected user (John Jones) see if a basic telnet connection would reproduce the problem. It did. So the issue seems linked to hardware or connection, not the program being run.

If there are any other observations, please add them to this thread. Due to the rarity of the problem, we may not have uncovered everything yet, and any examples will be helpful to have.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 7, 2020 03:21 PM          Msg. 11 of 11
In my case, it may be caused by virtualization. I am using Ubuntu 18.04 with a basic installation of wine. I have also tested Windows 10 running in VMWare Workstation 15 Player. Both environments fail with the "Incomplete file from server".

I then attempted the same on a Windows 10 machine (no virtualization) and was not able to reproduce the problem.

Returning to my Ubuntu machine, both "virtual" environments continue to fail. I am happy to help with any other testing you wish me to perform.
 

 

Time: Tue April 23, 2024 6:48 AM CFBB v1.2.0 9 ms.
© AderSoftware 2002-2003