|
We Block IPs of Web Crawling Agents
One thing that slows down our servers are web crawling search agents, like AltaVista and other services that crawl around the web cataloging links. They find one of our calendars (each page of which usually has about 40
different links) and start following all of the links. If the calendar is large (lots of events), this takes up
server resources.
So, when we see that a single IP is bombarding our servers with an inhuman sequence of requests, we block it.
Here is our current List of Blocked IPs. If you think your computer is on this list,
and you are not a web-crawling agent, please let us know by email to that Calendars
Net: Web Crawling Agents.
|
 |
|
