Reply

 

Thread Tools Display Modes
  #1  
Old 09-14-2009, 03:43 PM
vivithemage vivithemage is offline
Senior Member
 
Join Date: Jul 2009
Posts: 103
Smile [COMPLETE] speed up poll time?
I am not sure if it's just me, but it seems to take a while for servers/VPS's to
get polled. Any way of speeding that process up?

I am very glad it works, but it seems to take 15-25 seconds sometimes :

Script Execution: 20.77706secs
Reply With Quote
  #2  
Old 09-14-2009, 03:48 PM
Rob Rob is offline
Administrator
 
Join Date: Jun 2009
Posts: 21
Default
I have an idea why it's going so slow (each status call uses separate ssh processes), and I'm pretty sure I could reduce that speed by changing a few things around (namely: using one shared SSH connection).

Thanks for the suggestion, we'll definitely look into it.
Reply With Quote
  #3  
Old 09-17-2009, 01:35 AM
Rob Rob is offline
Administrator
 
Join Date: Jun 2009
Posts: 21
Default
I did some benchmarking to see whether or not the SSH calls or the database update was causing the slowdown. It was definitely the SSH. I managed to get the SSH master connection set up. It didn't really speed a whole lot up, though.

I'm going to make the status_update_all() threaded in it's calls to SSH, and see how that works out. The master call was definitely a good start at getting this sped up though, so no wasted work has been done

Just wanted to keep you informed that I am actively working on fixing this bug.
Reply With Quote
  #4  
Old 09-17-2009, 02:01 AM
Rob Rob is offline
Administrator
 
Join Date: Jun 2009
Posts: 21
Default
Wow! Threading cut the speed a TON. This feature will be available in the next release.

EDIT: It seems to be faster for certain connections, but slightly slower for others. I'm going to keep drilling into this to make sure it's not an issue with the threading.
Reply With Quote
  #5  
Old 09-17-2009, 02:33 AM
Rob Rob is offline
Administrator
 
Join Date: Jun 2009
Posts: 21
Default
Okay so here's what happened. I put in some debug code to do the benchmarking and forgot to take it out. This debug code reported that ALL servers were up and running on the development box when in fact they weren't.

On our development, in order to test worst case scenarios, we have a connection to a laptop that is running a VirtualBox install of CentOS with OpenVZ that is on a standard home ISP. This computer was off.

So basically, I told it to send out 30 SSH calls to a server that was reported by the system as "up", when in fact it was down. This is why it was slower (12 seconds compared to 1.5 seconds).

We'll test on this setup once that computer is turned back on .

So for now, it appears this feature will be GREATLY improved in the next release.
Reply With Quote
  #6  
Old 09-17-2009, 06:01 PM
vivithemage vivithemage is offline
Senior Member
 
Join Date: Jul 2009
Posts: 103
Default
Amazing, thank you very much for explaining what you were doing to find out what was causing it too.

I think the next release will have some needed bug fixes I am looking forward to...this, and being able to use my created templates properly.
Reply With Quote
  #7  
Old 10-10-2009, 09:54 PM
Mike Mike is offline
Administrator
 
Join Date: Jun 2009
Posts: 328
Default
This has been completed in 1.0.5
Reply With Quote
Reply
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 03:55 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.