Phillip Pearson - web + electronics notes

tech notes and web hackery from a new zealander who was vaguely useful on the web back in 2002 (see: python community server, the blogging ecosystem, the new zealand coffee review, the internet topic exchange).


Search progress

(topic: search engine)

Checkpoint: The server just indexed 319 items (the 319 posts from this weblog) in 1 min 14 secs ... so about 4 items per second. That's using one XML-RPC call per item, and opening / closing the index each time.

I wonder which bit takes the most time. I bet if I packed them all up in one XML-RPC call and kept the index open the whole time, it would be heaps quicker. Realistically though, people only ever post one post at a time (this is for searching blog posts), so that particular optimization might not really make any sense.
... more like this: []