Bugs for Sorcery are reported here

[bugzilla-daemon AT bugs.sourcemage.org]

http://bugs.sourcemage.org/show_bug.cgi?id=9391





------- Additional Comments From acedit AT armory.com  2005-08-02 22:10 -------
okay, with change 63635 I got what will likely be 90% of the speedups. I
included the get_prefix update and added another condition to verify a prefix
exists, this fixes the 'Custom' problem. I removed forking from url_is_valid
which speeds it up immensly. I sped up url_expand_urls and url_get_valid_urls 
as
I described. I also truncate the url list at 20.

Running the following (this is what summon calls, copied verbatim from debug 
log)
download_src_args "cpufrequtils-0.3.tar.bz2"
"ftp://ftp.kernel.org/pub/linux/utils/kernel/cpufreq/cpufrequtils-0.3.tar.bz2";
 ""
takes about 8 to 10 seconds on my machine with, around 5-7 of which is
downloading. Without the url truncation it takes 40 seconds including 
download.
I think thats a big improvement over the 3 minutes initially reported. Id like
to get further since 5 seconds of overhead is still too much.

Doing some back of the envelope math shows that url expanding is taking
.0075s/url, and url validation+bucketizing takes about .0675s/url. I get that
from 5=500X+20Y and 35=500X+500Y, where X is the time to expand and Y is time 
to
validate+bucketize. 500 is about the number of urls we expand the kernel url 
to.
In the common case we're spending 3.75 seconds expanding (to 500) urls and 
1.25
seconds processing the 20 that matter.

We have both ftp and http mirrors for practically every country or region. 
Many
of the http and ftp sites are the same machine. I dont see a whole lot of use 
in
keeping both in the list, if people really care, they have the Custom option.
Next theres probably some in that list that are not pingable or not up to 
date,
those should be removed. Im expecting to cull down to 200 mirrors from about
500. That would take the 3.75 expansion time to 1.5 seconds.

I think after that i'll dig into making all the hot api functions use return 
by
reference.

-- 
Configure bugmail: http://bugs.sourcemage.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.