Interesting to see that the new MSN Search can generate results in RSS format which is essentially XML and easy enough to crunch in python. You just submit a query and add '&format=rss' to the end, e.g.:
http://search.msn.com/results.aspx?q=peter's+blog&format=rss
gives this. What's useful about this?
- can interrogate a search engine without screen scraping (hastle, hoping web page format does not change) or using the google api (limited to 1000 searches/day). There may well be terms and conditions that will stop bots doing 10,000,000 searches a day.
- could set up aggregator to repeat search terms.
- could be a use for firefox's live bookmarks.
Searching MSN for 'peter's blog' puts this site first
Google reserves this for Tom Peter's Blog.


Testing captcha mod