Phillip Pearson - web + electronics notes

tech notes and web hackery from a new zealander who was vaguely useful on the web back in 2002 (see: python community server, the blogging ecosystem, the new zealand coffee review, the internet topic exchange).

Search progress

(topic: search engine)

Checkpoint: The server just indexed 319 items (the 319 posts from this weblog) in 1 min 14 secs … so about 4 items per second. That’s using one XML-RPC call per item, and opening / closing the index each time.

I wonder which bit takes the most time. I bet if I packed them all up in one XML-RPC call and kept the index open the whole time, it would be heaps quicker. Realistically though, people only ever post one post at a time (this is for searching blog posts), so that particular optimization might not really make any sense.

← Previous - Next →