abaker87·vor 12 Jahren·discussAgree. Scrapy is great for this sort of thing. Takes care of little details you don't want to be worrying about.I coupled scrapy with Stem to control Tor on the odd chance your IP gets blocked. Works great.