Hi Thomas, really sorry you had a bad experience with ScrapingBee.
Would you mind sending me the account you used as I wasn't able to find anything under Thomas Isaac or Tillypa and couldn't see what was going wrong then.
I'm sure your comment has nothing to do with the fact that you share the same investor as ScraperAPI but I just wanted be sure.
We've decided to go this route because based on billions of web-scraped page, Headless-based scraping is still a minority. And, it's way harder and more expensive to do at scale.
PS: we spend tens of hours writing those piece of content and even pay a technical editor to spot the typo and make it more readable since we're not native English. You might not like this post, but I can assure that genuine care was put into writing this!
"We do not encroach on others, but we will not give up our own. We have a wonderful army. Our guys have a unique combat experience and modern weapons.
This is an army many times stronger than eight years ago. We are told that February 16 will be the day of the attack.
We will make it the Day of Unity. The relevant decree has already been signed. On this day, we will hoist national flags, put on blue and yellow ribbons and show the world our unity.
We all want to live happily, and happiness loves the strong. We have never been able to give up and we are not going to learn that, ”
Revenue would be near impossible to do, however we could have analyzed traffic using SimilarWeb or Ahrefs API.
We could also have analyzed the sitemap to check the last update date.
Those articles are really fun to write (I haven't written this one, I'm just the editor), but at some point you have to stop otherwise you end with a 20k words essay.
I find your warning a bit unfair as there are literally no CTA inside the blog content promoting our product and only 2 internal links toward other educational posts.
But anyway,
I thought about taking a random sample of pages who returns a "200". Let's say 150, and manually tagging them to find if they're "dead" or not.
And then reuse the "dead or alive but a 200" ratio for all the pages but I was afraid that I'd need to tag much more than 150 pages to have a significant statistical result.
Would you mind sending me the account you used as I wasn't able to find anything under Thomas Isaac or Tillypa and couldn't see what was going wrong then.
I'm sure your comment has nothing to do with the fact that you share the same investor as ScraperAPI but I just wanted be sure.