Skip to Content.
Sympa Menu

sm-sorcery-bugs - [SM-Sorcery-Bugs] [Bug 9391] summon seems to take forever

sm-sorcery-bugs AT lists.ibiblio.org

Subject: Bugs for Sorcery are reported here

List archive

Chronological Thread  
  • From: bugzilla-daemon AT bugs.sourcemage.org
  • To: sm-sorcery-bugs AT lists.ibiblio.org
  • Subject: [SM-Sorcery-Bugs] [Bug 9391] summon seems to take forever
  • Date: Tue, 2 Aug 2005 22:10:33 -0700 (PDT)

http://bugs.sourcemage.org/show_bug.cgi?id=9391





------- Additional Comments From acedit AT armory.com 2005-08-02 22:10 -------
okay, with change 63635 I got what will likely be 90% of the speedups. I
included the get_prefix update and added another condition to verify a prefix
exists, this fixes the 'Custom' problem. I removed forking from url_is_valid
which speeds it up immensly. I sped up url_expand_urls and url_get_valid_urls
as
I described. I also truncate the url list at 20.

Running the following (this is what summon calls, copied verbatim from debug
log)
download_src_args "cpufrequtils-0.3.tar.bz2"
"ftp://ftp.kernel.org/pub/linux/utils/kernel/cpufreq/cpufrequtils-0.3.tar.bz2";
""
takes about 8 to 10 seconds on my machine with, around 5-7 of which is
downloading. Without the url truncation it takes 40 seconds including
download.
I think thats a big improvement over the 3 minutes initially reported. Id like
to get further since 5 seconds of overhead is still too much.

Doing some back of the envelope math shows that url expanding is taking
.0075s/url, and url validation+bucketizing takes about .0675s/url. I get that
from 5=500X+20Y and 35=500X+500Y, where X is the time to expand and Y is time
to
validate+bucketize. 500 is about the number of urls we expand the kernel url
to.
In the common case we're spending 3.75 seconds expanding (to 500) urls and
1.25
seconds processing the 20 that matter.

We have both ftp and http mirrors for practically every country or region.
Many
of the http and ftp sites are the same machine. I dont see a whole lot of use
in
keeping both in the list, if people really care, they have the Custom option.
Next theres probably some in that list that are not pingable or not up to
date,
those should be removed. Im expecting to cull down to 200 mirrors from about
500. That would take the 3.75 expansion time to 1.5 seconds.

I think after that i'll dig into making all the hot api functions use return
by
reference.

--
Configure bugmail: http://bugs.sourcemage.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.




Archive powered by MHonArc 2.6.24.

Top of Page