Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I'm satisfied with IQFeed. It's the most reliable and fastest quote feed I have ever used. Although I'm a resident in China, it's still very fast!" - Comment from Xiaofei
"Its working FABULOUSLY for me!! Holy cow...there has been so much I've been missing lately, and with this feed and Linnsoft software...I'm in the game now." - Comment from Chris R.
"For anyone considering using DTN.IQ for a data feed, my experience with the quality of data and the tech support has been very positive." - Comment from Public Forum
"I ran your IQFeed DDE vs. my broker vs. a level II window for some slow-moving options. I would see the level II quote change, then your feed update instantaneously. My broker's DDE, however, would take as much as 30 seconds to update. I am not chasing milliseconds, but half a minute is unacceptable." - Comment from Rob
"Everything is working amazing now. I'm already impressed with the true-tick feed of IQFeed and it's ability to support my 480 symbol layout." - Comment from Tyler via Email
"Everything is working great with the API. I love it." - Comment from Calvin
"IQ feed works very well, does not have all of the normal interruptions I have grown used to on *******" - Comment from Mark
"I've been using Neoticker RT with IQFeed for two months, and I'm very happy with both of the products (I've had IQFeed for two years with very few complaints). The service from both companies is exceptional." - Comment from Public Forum
"As a past ******* customer(and not a happy one), IQ Feed by DTN is a much better and cheaper product with great customer support. I have had no problems at all since switching over." - Comment from Public Forum
"I have been using IQFeed now for a few years in MultiCharts and I have zero complaints. Very, very rare to have any data hiccups or anything at all go wrong." - Comment from Public Forum
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »IQFeed Developer »IQFeed Developer Support »Too many simultaneous history requests
Author Topic: Too many simultaneous history requests (14 messages, Page 1 of 1)

Zeruel
-Interested User-
Posts: 29
Joined: Feb 22, 2012


Posted: Dec 21, 2020 06:31 PM          Msg. 1 of 14
I'm currently using IQ Feed version 6.1.0.20 and pulling historical data via the API. At the end of each day I request the latest daily, weekly and monthly historical price data. My software automatically figures out what the last date of data I have for each symbol and then requests the delta from DTN. This code has been working for a number of years (over 9 years now) but as of today I started getting thousands of "Too many simultaneous history requests".

Normally I throttle my requests to a maximum of 8 simultaneous threads / requests but going anything over 1 is failing now. I can't even get 2 simultaneous requests without getting bombarded with "Too many simultaneous history requests" rejections from the API.

Is there a change to the way simultaneous historical requests work? Thanks!

wmarka
-Interested User-
Posts: 7
Joined: Jan 5, 2012


Posted: Dec 21, 2020 06:40 PM          Msg. 2 of 14
Same issue for me. Long time user, also using v6.1.0.20.

RAKESH
-Interested User-
Posts: 4
Joined: Dec 21, 2020


Posted: Dec 21, 2020 10:45 PM          Msg. 3 of 14
Same issue for Here. Using v6.1.0.20. I have been using IQfeed for 5 years. Never had this problem. I have been always been open 12 connections simultaneously.

RA

mjafari
-Interested User-
Posts: 3
Joined: Apr 4, 2020


Posted: Dec 22, 2020 01:01 AM          Msg. 4 of 14
I'm having the same issue as well was using the same code last week w/ no issues. Please help!

DTN_Stephen
-DTN Guru-
Posts: 443
Joined: Aug 22, 2014


Posted: Dec 22, 2020 06:28 AM          Msg. 5 of 14
We are currently looking into this with our development teams. We will post more information shortly.

Thank you for your patience.

Stephen Shockey
Senior Customer Support Representative and Product Support Specialist

DTN
800-779-7299
support@iqfeed.net

DTN_Gary_Stephen
-DTN Guru-
Posts: 267
Joined: Jul 3, 2019


Posted: Dec 22, 2020 08:44 AM          Msg. 6 of 14
All,

This is caused by a recent change to how IQFeed handles simultaneous history requests. See this post for a full explanation:

http://forums.iqfeed.net/index.cfm?page=topic&topicID=5832

In brief: IQFeed now imposes a limit of 25 history requests per second, regardless of how long each request takes to run. Previously, the limit was 15 history requests per second, but when a request completed returning data it no longer counted against your limit. So if your app makes a lot of small history requests - which would exceed the new limit but not the new one - you may have started getting this error message the last couple days. The solution is to limit history requests to 25 per second, regardless of length.


Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

Edited by DTN_Gary_Stephen on Dec 22, 2020 at 09:03 AM

wmarka
-Interested User-
Posts: 7
Joined: Jan 5, 2012


Posted: Dec 22, 2020 09:09 AM          Msg. 7 of 14
Wouldn't it be appropriate to restore the old policy at least for a week or so (or until after the holidays?), so that we aren't forced to immediately address this just-announced, new iQFeed policy? We have other demands on our time this week -- it seems unnecessary to force us to prioritize changing our code immediately. Thanks.

RAKESH
-Interested User-
Posts: 4
Joined: Dec 21, 2020


Posted: Dec 22, 2020 09:57 AM          Msg. 8 of 14
Can you post a code example to handle it effectively?

RA

mjafari
-Interested User-
Posts: 3
Joined: Apr 4, 2020


Posted: Dec 22, 2020 12:50 PM          Msg. 9 of 14
Correct me if I’m wrong but making the limit to 25 requests every second will drastically slow down any history gathering one tries to make (especially options symbols). This change also makes it difficult to programmatically limit requests to 25 a second. At least when parallelizing a request you can limit your connections. Have you done speed comparisons to see if this is an efficient change moving forward? Thank you in advance for your answer.

DTN_Gary_Stephen
-DTN Guru-
Posts: 267
Joined: Jul 3, 2019


Posted: Dec 22, 2020 01:21 PM          Msg. 10 of 14
We're actually discussing some of these questions now. I'll post an update as soon as I have any more news.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

mjafari
-Interested User-
Posts: 3
Joined: Apr 4, 2020


Posted: Dec 22, 2020 01:32 PM          Msg. 11 of 14
Thank you so much Gary.

RAKESH
-Interested User-
Posts: 4
Joined: Dec 21, 2020


Posted: Dec 22, 2020 02:53 PM          Msg. 12 of 14
I totally agree with mjafari, Its so slow and frustrating to use after implementing to 25 requests per second. Especially in the circumstances, IQfeed don't have batch requests for multiple symbols. I am disappointed. Hope you have some solution soon, that be a life saver. Thank you!

RA

RAKESH
-Interested User-
Posts: 4
Joined: Dec 21, 2020


Posted: Dec 22, 2020 03:47 PM          Msg. 13 of 14
Ok guys, I take it back.

After carefully implementing the simultaneous requests into the rolling average of 25 history requests per second at time. It seems to be working fine, I didn't receive any error. There seems to be slight improvement in performance since the number of simultaneous connections are now allowed to be 25 instead of 15.

My apologies for my earlier disappointment, but a slight code change seems to fix the problem.

Thank you!

RA

DTN_Gary_Stephen
-DTN Guru-
Posts: 267
Joined: Jul 3, 2019


Posted: Dec 28, 2020 09:55 AM          Msg. 14 of 14
We have increased the number of requests allowed from 25 to 50 per second.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist
 

 

Time: Sun August 14, 2022 6:47 AM CFBB v1.2.0 46 ms.
© AderSoftware 2002-2003