Slurpconfirm404
Slurpconfirm404Seeker that looks for non-existent pages
Look at, this did not know it to me. Today I have received petitions of Yahoo’s robot requesting non-existent pages Why? After navigating a little and checking than although some have asked the same thing themselves, they are not too many and they are something paranoid
In short, yahoo’s answer, you put me on the alert about a possible problem ( I right now have verified that I do not suffer it )
When requests him a non-existent page, some servants Web they return a page to sail across the place along with the code HTTP 200 OK instead of HTTP 404 Not Found.
What happens in these cases? When you erase a page, the seekers do not learn about it and keep on maintaining it in your index and making out of petitions in each cycle your index’s refreshment to see if it has been modified.
In this way Yahoo tries to find out if your servant manages of the standard form the petitions of non-existent pages
Slurpconfirm404