Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"Thanks for following up with me. You guys do a great job in tech support." - Comment from Phelps
"Very impressed with the quality of your feed - ******* is a real donkey in comparison." - Comment from A.C. via Email
"You have an excellent feed. Very few spikes for Spot Forex." - Comment from Public Forum Post
"There is no doubt that IQFeed is the best data provider. I am very satisfied with your services. And IQFeed is the only one that I would recommend to my friends. Now, most of them are using your product in China." - Comment from Zhezhe
"I just wanted to let you know how fast and easy I found it to integrate IQFeed into our existing Java code using your JNI client. In my experience, such things almost never go so smoothly - great job!" - Comment from Nate
"If someone needs the best quality data and backfill beyond what their broker provides at a rate that is the best in the industry, I highly recommend IQFeed." - Comment from Josh via Public Forum
"I noticed that ******* quotes locked up shortly after the interest rate announcement yesterday while yours stayed stable." - Comment from Ron in Utah
"I use IQ Feed, Great stuff as far as data analysis information, storage and retrieval is concerned." - Comment from Public Forum
"For anyone considering using DTN.IQ for a data feed, my experience with the quality of data and the tech support has been very positive." - Comment from Public Forum
"I ran your IQFeed DDE vs. my broker vs. a level II window for some slow-moving options. I would see the level II quote change, then your feed update instantaneously. My broker's DDE, however, would take as much as 30 seconds to update. I am not chasing milliseconds, but half a minute is unacceptable." - Comment from Rob
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »DTN.IQ Client Software Support »Streaming bars with multiple symbols and intervals
Author Topic: Streaming bars with multiple symbols and intervals (8 messages, Page 1 of 1)

sweigner
-Interested User-
Posts: 7
Joined: Sep 26, 2017


Posted: Dec 15, 2017 09:55 AM          Msg. 1 of 8
It is my understanding that streaming bars need multiple connections to the derivative port to handle multiple intervals. I want to watch a few hundred stocks on 1, 5, 10, and 60 minute intervals. Can I use 4 connections to the derivative port or is it one per interval per stock? (I would need lots of connections then!)

Scott

DTN_Steve_S
-DTN Guru-
Posts: 2093
Joined: Nov 21, 2005


Posted: Dec 15, 2017 10:46 AM          Msg. 2 of 8
The streaming bars can actually handle multiple intervals of the same symbol and it can also handle multiple symbols (of the same or differing intervals) on the same connection as well.

You simply need to specify a unique value in the RequestID on each of your bar watch requests (so submit 4 bar watch requests for each symbol, each with a unique RequestID).

With that said, you might run into some issues dealing with performance based on your description of what you need if you put everything on a single socket. Since it's entirely hardware dependent, I can't say for sure if you will run into problems but I just mention it so you're aware that it could come up. If you do have issues, and assuming you aren't saturating all cores on the CPU, you will need to spread your symbols across multiple connections to streaming bars. Streaming bars is multithreaded on a per client basis so each connection you make to streaming bars will be handled on it's own thread. If that becomes an issue, make sure you keep all intervals of a single symbol on the same connection for maximum performance.

sweigner
-Interested User-
Posts: 7
Joined: Sep 26, 2017


Posted: Dec 15, 2017 11:01 AM          Msg. 3 of 8
The reason I thought it could only handle 1 interval was a response Tim Walter made to somone's question:

"Streaming bars can only handle one interval per symbol, so multiple connections to the derivative port will be needed to achieve what you are looking for. "

I am currently seeing some bars dropped so that is why I ask the question. It seemed to have been working before then I added a couple more intervals and noticed bars being dropped. CPU usage was staying around 50%.

Scott

sweigner
-Interested User-
Posts: 7
Joined: Sep 26, 2017


Posted: Dec 15, 2017 12:16 PM          Msg. 4 of 8
So are you recommending one connection per stock with all the intervals on that connection? Or one connection per interval?

Scott

DTN_Steve_S
-DTN Guru-
Posts: 2093
Joined: Nov 21, 2005


Posted: Dec 15, 2017 12:31 PM          Msg. 5 of 8
Can you give an example of the dropped bars issue?

No, I wouldn't split this out the extent of one per symbol. I would try to get it working with a single connection first and then only scale it out if you need to, starting with 2-4 connections and working from there.

sweigner
-Interested User-
Posts: 7
Joined: Sep 26, 2017


Posted: Dec 15, 2017 12:39 PM          Msg. 6 of 8
Originally things were working with 1 connection. I was using 200 stocks with intervals of 1,2,3,4,5,10,20,and 60 minute bars. I then added in another 100 stocks and additional intervals of 30,40, and 50. That's when I noticed some bars were missing. For example, on AAPL today, it got the 11:10 and 11:20 bars but there was no 11:15 bar. It seems to be intermittent and across all stocks and intervals.

Scott

DTN_Steve_S
-DTN Guru-
Posts: 2093
Joined: Nov 21, 2005


Posted: Dec 15, 2017 01:08 PM          Msg. 7 of 8
In that case, I would try splitting to up to 2 connections with 150 symbols each or 3 connections with 100 symbols each and see if the problem goes away.

sweigner
-Interested User-
Posts: 7
Joined: Sep 26, 2017


Posted: Dec 15, 2017 01:11 PM          Msg. 8 of 8
I will try that. Thanks for the awesome support and quick responses!

Scott
 

 

Time: Thu April 25, 2024 12:02 PM CFBB v1.2.0 14 ms.
© AderSoftware 2002-2003