I'm a PHP developer, but the scraping tools I'll need probably call for Python. Basically, what I'm looking to do is scrape a couple search engine APIs (Google, Bing, DDG) to grab 10 to 20 results. I'll then crawl the results pulling page title, meta description, and snap a screenshot of a couple pages (home page for sure).
I'd like to use MySQL as a backend since that's what I'm familiar with (PHP and Perl days). With this data I'd then want to output text files to be processed via PHP to be imported into a PHP based website/app.
Basically, I'm thinking I should build this thing off of some framework and from what I've read Flask is a more lightweight framework than Django.
Basically, I want to jump in, but I want to know if one would be a better choice then the other, if they're both comparable for this type of job, or if I'm even on the right track.
I'd like to use MySQL as a backend since that's what I'm familiar with (PHP and Perl days). With this data I'd then want to output text files to be processed via PHP to be imported into a PHP based website/app.
Basically, I'm thinking I should build this thing off of some framework and from what I've read Flask is a more lightweight framework than Django.
Basically, I want to jump in, but I want to know if one would be a better choice then the other, if they're both comparable for this type of job, or if I'm even on the right track.