Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I cannot believe what a difference it makes trading with ProphetX!" - Comment from Bruce in Los Angeles
"Just a quick one to say I'm very impressed so far :) The documentation for developers is excellent and I've quickly managed to get an app written to do historical downloads. The system is very robust and pretty quick considering the extent of data that's available. The support guys have been very helpful too, in combination with the forums it's been plain sailing so far!" - Comment from Adam
"Everything is working great with the API. I love it." - Comment from Calvin
"My broker in Davenport suggested I give you a try as he uses your service and says its the best." - Comment from Bill via RT Chat
"I just wanted to say how happy I am with your service. I was able to download the API docs last week and I was able to replicate Interactive Brokers historical bar queries and realtime bar queries over the weekend. That was about one of the fastest integrations that I've ever done and it works perfectly!!!!" - Comment from Jason via Email
"I was on the phone with a friend who uses CQG and right after the Fed announcement, CQG was as much as 30 seconds behind DTN.IQ. Some quotes were off by as much as 15-18 cents. Your feed never missed a beat." - Comment from Roger
"Interactive Brokers tick data was inconsistent, so I have switched to using DTN exclusively. It is great to no longer have to worry about my datafeed all day long." - Comment from Philippe
"Thanks for the great product and support. During this week of high volume trading, my QuoteTracker + IQ Feed setup never missed a beat. Also, thanks for your swiftness in responding to data issues. I was on ******* for a few years before I made the switch over early this year, and wish I had done it a long time ago." - Comment from Ken
"I've been using IQFeed 4 in a multi-threaded situation for the last week or two on 2600 symbols or so with 100 simultaneous daily charts, and I have had 100% responsiveness." - Comment from Scott
"This beats the pants off CQG, I am definitely switching to the ProphetX 3.0!" - Comment from Stephen
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »IQFeed Developer »IQFeed Developer Support »Market snapshot error on EDS / 5MS command
Author Topic: Market snapshot error on EDS / 5MS command (11 messages, Page 1 of 1)

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 19, 2019 09:31 PM          Msg. 1 of 11
I am testing out this command:

EDS,2,14,20190919,EDS_TODAY

And recieve this from the server (at 20:27 EDT)

EDS_TODAY,E,Incomplete file from server. 534364/23476219,
EDS_TODAY,!ENDMSG!,
EDS_TODAY,!ENDMSG!,

Not sure why the file is incomplete so late at night. Also, i am seeing TWO !endmsg!

I see the same error with the 5MS command at the same time period:

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

DTN_Gary_Stephen
-Interested User-
Posts: 96
Joined: Jul 3, 2019


Posted: Sep 20, 2019 10:26 AM          Msg. 2 of 11
Larry,

I will begin looking into this now. I was just able to run that command with no difficulties, so this may be a time-of-day thing.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 20, 2019 02:02 PM          Msg. 3 of 11
Update: I just saw this error in the DAY @ 13:15:46 EDT.

[lastMsg=5MS,2,14,5MS_10_2_14_20190920]

13:15:46.744 [nioEventLoopGroup-2-2] msg=5MS_10_2_14_20190920,E,Incomplete file from server. 534364/23566744,,

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 23, 2019 11:42 AM          Msg. 4 of 11
Hi Gary. Any updates on this?

Larry jag
-Interested User-
Posts: 30
Joined: Dec 28, 2015


Posted: Sep 30, 2019 09:48 PM          Msg. 5 of 11
Any updates?

DTN_Gary_Stephen
-Interested User-
Posts: 96
Joined: Jul 3, 2019


Posted: Oct 1, 2019 04:27 PM          Msg. 6 of 11
Larry,

I haven't been able to reproduce this behavior, and I'm not aware of any other reports of it. What I'd like you to do, if possible, is create a log file. In the Diagnostics app, go to the Logging tab, check Lookup Error in the Lookups section, and Save Changes. If this happens again, go to the same place and click Open Logfile to collect the file. You can send it to me at developer@iqfeed.net for investigation.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

altmany
-Interested User-
Posts: 49
Joined: Jul 30, 2018

IQML - IQFeed-MATLAB connector


Posted: Dec 21, 2019 10:00 AM          Msg. 7 of 11
Another report of this problem: http://forums.dtn.com/index.cfm?page=topic&topicID=5678

I have also gotten an unrelated independent report on this exact same problem for NASDAQ summary data.

It seems to be a problem that multiple people who use multiple different platforms have experienced. Please look into this matter.

Yair Altman
IQML - IQFeed-MATLAB connector
https://UndocumentedMatlab.com/IQML

I am not a DTN employee; my post reflects my personal opinion

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 01:36 PM          Msg. 8 of 11
I logged the error and sent it to developer@iqfeed.net. I am also willing to provide some simple c++ code to demonstrate the issue if necessary. Hopefully this will lead to a diagnosis and solution.

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 04:57 PM          Msg. 9 of 11
This may be a clue: I modified my code to not stop after the NASDAQ Market Summary fails. The application now goes ahead and attempts to download the OPERA Market Summary file. Both resulted in "E,Incomplete file from server. [received]/[expected]. In both cases, the received number was 525628, and the expected number was different.

So perhaps the received number being the same could lead to a cause. Fingers crossed.

DTN_Gary_Stephen
-Interested User-
Posts: 96
Joined: Jul 3, 2019


Posted: Jan 7, 2020 02:06 PM          Msg. 10 of 11
All,

We've had a handful of reports of this issue now, and I'm getting an official ticket raised to the development team. My notes about the issue so far:

- This behavior has been very rare. But when it does happen, it can be reproduced.
- So far, only attempts to retrieve the NASDAQ and OPERA exchanges seem to be affected.
- Both 5MS and EDS commands are affected.
- Each time it is reproduced, the number of bits of the failed file is the exactly same (varying slightly by the day it happens and/or exchange). This suggests a corrupt file-type problem as opposed to a connection problem.
- Wine log shows nothing out of the ordinary. All functions appear to work normally until failure point.
- IQFeed log shows an immediate (within 6 seconds) response of 1,E,Incomplete file from server.
- Which means that IQFeed isn't reading through the file, and then reaching a failure point. If so the parts of the file up to the failure point would be in the log.
- Oddly, this Incomplete File From Server message is sent twice, which parallels the report that !END_MSG! appears twice.
- Do not suspect a server issue. In reviewing our logs, affected users connected to a large number of different servers in our load balancing pool.
- I had an affected user (John Jones) see if a basic telnet connection would reproduce the problem. It did. So the issue seems linked to hardware or connection, not the program being run.

If there are any other observations, please add them to this thread. Due to the rarity of the problem, we may not have uncovered everything yet, and any examples will be helpful to have.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 7, 2020 03:21 PM          Msg. 11 of 11
In my case, it may be caused by virtualization. I am using Ubuntu 18.04 with a basic installation of wine. I have also tested Windows 10 running in VMWare Workstation 15 Player. Both environments fail with the "Incomplete file from server".

I then attempted the same on a Windows 10 machine (no virtualization) and was not able to reproduce the problem.

Returning to my Ubuntu machine, both "virtual" environments continue to fail. I am happy to help with any other testing you wish me to perform.
 

 

Time: Mon July 13, 2020 10:09 PM CFBB v1.2.0 16 ms.
© AderSoftware 2002-2003