Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »IQFeed Developer Support »IQfeed goes into a state where it gobbles up 90% of CPU time, but only if there is >15 symbols ...
Author Topic: IQfeed goes into a state where it gobbles up 90% of CPU time, but only if there is >15 symbols ... (3 messages, Page 1 of 1)

smt52
-Interested User-
Posts: 31
Joined: Feb 23, 2009


Posted: Jul 30, 2010 03:20 PM          Msg. 1 of 3
We would like some advice on how to fix an issue with IQfeed which results in it crashing one or twice per day. By "crash", I mean that it starts to gobble up 90% of CPU time (up from 10%), which means that nothing else has any CPU time to do anything.

Setup:

1. Amazon EC2.
2. 1.7GB of RAM.
3. 1 EC2 compute unit (equivalent to a 1.0-1.2 GHz 2007 Opteron).
4. Operating system is Windows Server 2008.

How to reproduce the problem:
1. Subscribe to 20 symbols.
2. CPU usage is consistently ~10% or less.
3. Wait until there is lots of market activity (i.e. 4:15pm).
4. At some point during the day, under higher load, the IQfeed driver goes from 10% CPU usage to 90% CPU usage. This problem occurs 1 to 2 times per day.
5. As the IQfeed driver has effectively crashed, the rest of the system has no CPU time to do anything, so the entire system grinds to a halt.

Hypothesis:
1. Perhaps the buffers are filling up internally - how can we check to see if this is happening, to guard against this happening?

DTN_LorenF
-DTN Technical Support-
Posts: 228
Joined: May 11, 2004


Posted: Jul 30, 2010 03:38 PM          Msg. 2 of 3
smt52
it does sound like resource issues
Here is what is recommend for hardware now on the systems for:

(Recommended Computer Requirements)
Windows 2000/XP Home/XP PRO/Vista
(Win95, Win98, WinME, WinNT are not supported)


Pentium Processor
The faster the better. If watching 50 active symbols (such as eminis) we recommend a minimum of 3.0ghz processor. We recommend a dual core processor if watching more than 300 symbols. 1000+ symbols will require a top of the Line PC with a dual-quad core processor with 2+MB Cache.)


1GB Ram


High Speed Internet
(500Kps min.)

DTN Brian Wood
-Interested User-
Posts: 17
Joined: Jun 2, 2004


Posted: Jul 30, 2010 03:48 PM          Msg. 3 of 3
What symbols are you trying to watch?

It could be that you are not keeping up with the feed. Frequently we see people not processing the data fast enough so it backs up and they see delays and find that the CPU usage has gone high. IQFeed will queue up the incoming data until you run out of memory. Look at IQFeed running in task manager and see if you see it’s memory increasing, if so, it means that you are not processing the incoming data quickly enough and it is beginning to back up. Remember the feed depending on what is happening in the market may surge 5 times or more during some sort of announcement. The flow of data is not constant and you may experience sudden surges in the amount of data received.

The hardware you are running is also very low end now days, so improving your hardware might also help your preformance.

Visit our new online forums! DTN employees actively monitor the forums to provide you the highest level of support in the industry. Our forums also has an announcements area where you can learn about new features or changes within DTN. You can even use the forums to exchange trading ideas or tips and tricks on how you use your DTN data to be more profitable.

Go to http://forums.dtniq.com now to start sharing information with fellow DTN subscribers!
 

 

Time: Thu October 17, 2024 9:10 PM CFBB v1.2.0 7 ms.
© AderSoftware 2002-2003