Wikipedia entry on web crawling / spidering is here.
Not sure if Nick has just downloaded it locally, or what - I considered seeing if there was some way that I could import the thread into a MySQL database on my laptop so that I could do some analysis / geek work with it.
But I never got round to it.
Not sure if Nick has just downloaded it locally, or what - I considered seeing if there was some way that I could import the thread into a MySQL database on my laptop so that I could do some analysis / geek work with it.
But I never got round to it.
Comment