Questions tagged [web-crawler]

For questions about how to use or defend against web-crawlers or web-spiders.

Filter by
Sorted by
Tagged with
84
votes
10answers
16k views

How and why is my site being abused?

I own a popular website that allows people to enter a phone number and get information back about that phone number, such as the name of the phone carrier. It's a free service, but it costs us money ...