Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I cannot believe what a difference it makes trading with ProphetX!" - Comment from Bruce in Los Angeles
"The people at Nirvana have very nice things to say about your company and I can see why! Price and service is a potent combination." - Comment from Ed
"There is no doubt that IQFeed is the best data provider. I am very satisfied with your services. And IQFeed is the only one that I would recommend to my friends. Now, most of them are using your product in China." - Comment from Zhezhe
"After all the anxiety I had with my previous data provider it is a relief not to have to worry about data speed and integrity." - Comment from Eamonn
"Version 4.0.0.2 has been working well for me and I appreciate that it is now a much tighter client to work with. I feel I can go to press with my own application and rely on a stable platform" - Comment from David in IA.
"My broker in Davenport suggested I give you a try as he uses your service and says its the best." - Comment from Bill via RT Chat
"Just a quick one to say I'm very impressed so far :) The documentation for developers is excellent and I've quickly managed to get an app written to do historical downloads. The system is very robust and pretty quick considering the extent of data that's available. The support guys have been very helpful too, in combination with the forums it's been plain sailing so far!" - Comment from Adam
"Its working FABULOUSLY for me!! Holy cow...there has been so much I've been missing lately, and with this feed and Linnsoft software...I'm in the game now." - Comment from Chris R.
"I was with ******* for 4 years at $230 a month, this is a huge savings for me, GOD BLESS YOU PEOPLE," - Comment from T.S. via Email
"I use IQ Feed, Great stuff as far as data analysis information, storage and retrieval is concerned." - Comment from Public Forum
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »IQFeed Developer Support »Too many simultaneous history requests
Author Topic: Too many simultaneous history requests (8 messages, Page 1 of 1)

dk_brad
-Interested User-
Posts: 12
Joined: May 11, 2014


Posted: May 16, 2014 01:02 AM          Msg. 1 of 8
Given the latency of requesting historical data on a per-port basis, it is necessary to spread requests over a number of ports and aggregate the results as highlighted in the post:

http://forums.iqfeed.net/index.cfm?page=topic&topicID=3193

When doing so, i am encountering an error response of "Too many simultaneous history requests.". The post referenced above indicated that there were no specific limits in place at that time. Clearly this has since changed, but I am unable to find out where this has been documented.

It's not clear from testing what specifically is triggering the response (e.g. rate limit on request submission, limit on outstanding number of requests, etc.) but it seems only loosely related to the number of connections. For example, it is triggered (sporadically) by simply requesting 100 day bars for 100 symbols using 10 connections.

Please provide details of the exact restrictions in place so that we may manage our requests to ensure they work.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: May 16, 2014 07:17 AM          Msg. 2 of 8
Hello,

You can only have up to 15 simultaneous requests being processed on any one connection at any one time. You can either limit the number of requests that are sent at any one time, or on this kind of error, re-request the data again.

Tim

dk_brad
-Interested User-
Posts: 12
Joined: May 11, 2014


Posted: May 16, 2014 07:36 AM          Msg. 3 of 8
Hi Tim,

That doesn't concur with the results that I was seeing. Sending 100 requests over 20 connections in round-robin fashion (i.e 5 requests per connection) was triggering this error response.

Conversely, sending the same 100 requests over 5 connections (i.e. 20 requests per connection) does not trigger the error.

In both cases, the requests are all sent upfront before the first results come in.

I am unable to check again at the moment as the feed is currently in use, but I shall try to replicate over the weekend and revert. FWIW, I have a log of the 5 connection test, so I am certain of that result.

Cheers.
Edited by dk_brad on May 16, 2014 at 07:38 AM

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: May 16, 2014 07:39 AM          Msg. 4 of 8
I'll check with the server team, I may remember incorrectly, it could be 15 in total, not per connection, and let you know.

Tim

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: May 16, 2014 08:03 AM          Msg. 5 of 8
Sorry, it is 15 just connections and it should take care of this. I'll look into updating the documentation as well to cover this.

Tim
Edited by DTN_Tim Walter on May 16, 2014 at 08:13 AM

dk_brad
-Interested User-
Posts: 12
Joined: May 11, 2014


Posted: May 16, 2014 08:16 AM          Msg. 6 of 8
I still need some additional clarification here.

As I understand it, each IQConnect connection buffers requests locally and only sends a single to the server at a time (per connection). Since each connection processes requests in a serial fashion, is it safe to assume that there only ever be one outstanding request per connection under this definition? (I am assuming the restriction is on the server side, not the client side)

Looking at my prior example, sending 20 requests each to 5 connections doesn't trigger an error. I presume that IQConnect is only effectively processing 5 requests simultaneously.

If this is the case, then limiting the code to a maximum of 15 connections processing history requests at any one time would seem to be the solution.

EDIT:
This post doesn't make much sense post your edit. I see you've removed the 1 req/connection text so I'm guessing that it's just 15 connections and IQConnect will take care of buffering multiple requests per connection
Edited by dk_brad on May 16, 2014 at 08:20 AM
Edited by dk_brad on May 16, 2014 at 08:21 AM

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: May 16, 2014 08:30 AM          Msg. 7 of 8
Correct, my apologies.

dk_brad
-Interested User-
Posts: 12
Joined: May 11, 2014


Posted: May 16, 2014 08:37 AM          Msg. 8 of 8
Great, thanks.

I'd also be very keen to see possible error returns added to the documentation. It's a bit of a trial and error process at the moment, where new undocumented error returns are discovered and added to the list of possible received messages (e.g. this one, valid protocol already set, invalid # of params etc.)
 

 

Time: Tue May 7, 2024 12:29 PM CFBB v1.2.0 12 ms.
© AderSoftware 2002-2003