|
The human eye just sees things that bots never notice...
Running a bot regularly will makes it much easier to review sites by hand afterwards. if the bot is your own, you might want to have it extract information and store it on each listing, and if those parameters change, you can be flagged and look at the site again. Things like page size, last updated date, number of images, number of links off, etc are all good "tips" that something is going on.
In the end, the bot can only get rid of the VERY obvious, and it can help you guide your eyes for the best use of your time possible.
Alex
|