Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I will tell others who want to go into trading that DTN ProphetX is an invaluable tool, I don't think anyone can trade without it..." - Comment from Luther
"With HUGE volume on AAPL and RIMM for 2 days, everyone in a trading room was whining about freezes, crashes and lag with *******, RealTick, TS and Cyber. InvestorRT with IQFeed was rock solid. I mean SOLID!" - Comment from Public IRC Chat
"I just wanted to let you know how fast and easy I found it to integrate IQFeed into our existing Java code using your JNI client. In my experience, such things almost never go so smoothly - great job!" - Comment from Nate
"The people at Nirvana have very nice things to say about your company and I can see why! Price and service is a potent combination." - Comment from Ed
"If you want customer service that answers the phone, your best bet is IQFeed. I cannot stop praising them or their technical support. They are always there for you, and they are quick. I have used ****** too but the best value is IQFeed." - Comment from Public Forum
"I just wanted to say how happy I am with your service. I was able to download the API docs last week and I was able to replicate Interactive Brokers historical bar queries and realtime bar queries over the weekend. That was about one of the fastest integrations that I've ever done and it works perfectly!!!!" - Comment from Jason via Email
"I'm very glad I switched to IQFeed. It's working perfectly with no lag, even during fast market conditions." - Comment from Andy via Email
"I've been using IQFeed 4 in a multi-threaded situation for the last week or two on 2600 symbols or so with 100 simultaneous daily charts, and I have had 100% responsiveness." - Comment from Scott
"The service is great, I see a noticeable improvement in my volume profiles over [broker]'s data feed" - Comment from Larry
"I would just like to say that IQFeed version 4 is running very well and I am very happy with its performance. I would also like to extend a big thanks for the fast and efficient help that I always receive. My questions and concerns are always addressed promptly. Way to go!" - Comment from Josh in CO.
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »Data and Content Support »historical data files containing large gaps
Author Topic: historical data files containing large gaps (5 messages, Page 1 of 1)

Lav2018
-Interested User-
Posts: 10
Joined: Mar 15, 2018


Posted: Sep 29, 2018 12:11 PM          Msg. 1 of 5
I am very happy with the live data that IQfeed provides, but the historical data appears to have major issues.

How are historical files maintained and checked for accuracy? I tried downloading 25 symbols (minute bars from September 3 to September 28), and 14 out of 25 files were missing the entire trading day of September 20. I can't say all other bars were present, but missing an entire day was obvious.

The symbols missing data were:
SMM#
STG#
STM#
STN#
STO#
@XAB#
@XAE#
@XAF#
@XAI#
@XAK#
@XAP#
@XAU#
@XAV#
@XAY#

I brought up the missing data for @XAE# to support staff, and they have since fixed it. However, the symbols SMM, STG, STM, STN, STO all remain incomplete.

Is there an easy explanation for the errors? I would like to think that I can rely on the data, but right now I feel responsible for finding gaps and reporting them to you. I am not in the best position to find gaps, and therefore worry that many others may exist in the data.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Oct 1, 2018 04:56 AM          Msg. 2 of 5
Good morning,

All of the underlying data does appear to be here on our servers, but there appears to be some issues with the roll dates for these continuous contracts. You can see this on SMMU18 and SMMZ18. We will try and get those things addressed for you so the data will show on the # and #C contracts later today.

Tim

Lav2018
-Interested User-
Posts: 10
Joined: Mar 15, 2018


Posted: Oct 1, 2018 09:13 AM          Msg. 3 of 5
Thanks.

Will it be possible for your team to identify other days and other contracts that have this same problem? I was only checking 25 symbols for 1 month. I think it is likely that this happens with other contracts and on other roll dates.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Oct 1, 2018 09:48 AM          Msg. 4 of 5
The issue with these is that the expiration date was sent by the exchange and was correctly being used, but Eurex has contracts that will settle, but not have intra-day activity on the date of expiration (daily charts had no gap).

In some cases, especially on very thinly traded contracts, we would not want to change this default behavior so we have to look at each individually when someone asks. We are more than happy to discuss though and will evaluate these if you see any others that you feel are configured incorrectly.

Tim

Lav2018
-Interested User-
Posts: 10
Joined: Mar 15, 2018


Posted: Oct 1, 2018 08:35 PM          Msg. 5 of 5
Sounds reasonable. I will let you know if I find others. Thanks.
 

 

Time: Fri April 26, 2024 9:47 AM CFBB v1.2.0 9 ms.
© AderSoftware 2002-2003