Ask HN: Adaptive Spider Technologies?

1 pointsby throwavay45215 yıl önce2 comments

Today a bot from 174.127.132.210 tried to copy information from my stealth-mode site (not linked to any domain name). This site was not supposed to be searchable and is known to a very limited number of people.

Any experience with such bots?

1 comments

tshtf15 yıl önce

I've been blocking 174.127.132.0/22 for a while now.

It's generally not worth getting into an arms race against misbehaved bots, unless you're prepared to setup a honeypot or seriously analyze your access logs.

throwavay45215 yıl önce

Thanks! Good to know it's common