We can't comment on why, but there's no rational way to watch his behavior and assume he isn't obsessed with being liked. He constantly tweets about his own tweets performance, makes humiliating appearances on stages, and pretty much terrified that someone might do something 1/100000th as awful to him as he and his family have done to others.
This is true of any webscraper though, you need to santitize any content you collect from the web. If a person wanted a scraper to get something different from the browser, they could easily use UA sniffing to do so. (I've seen it this done a few times.)
Asking GPT to create JSON and then validating the JSON is one piece of that process, but before someone deserialized that JSON and executed INSERT statements w/ it, they should do whatever they usually would do to sanitize that input.
He's looking for a few case studies to work on pro bono, if you know someone that needs some data that meets certain criteria they should get in touch.
FWIW, That's been my use case, when I saw the author post his initial examples pulling data from Wikipedia pages I dropped my cobbled together scripts and started using the tool via CLI & jq.
These kind of one-shot examples are exactly where this hit for me. I was in the middle of some research when I saw him post this and it completely changed my approach to gathering the ad-hoc data I needed.
I was most worried about #2 but surprised how much temperature seems to have gotten that under control in my cases. The author added a HallucinationChecker for this but said on Mastodon he hasn't found many real-world cases to test it with yet.
Regarding 3 & 4:
Definitely take a look at the existing examples in the docs, I was particularly surprised at how well it handled nested dicts/etc. (not to say that there aren't tons of cases it won't handle, GPT-4 is just astonishingly good at this task)
Your project looks very cool too btw! I'll have to give it a shot.
It requires API access, temperature=0 means completely deterministic results but possibly worse performance. Higher temperature increases "creativity" for lack of a better word, but with it, hallucination & gibberish.
Not the author, but it seems like the separation of system & user messages actually prevents page content from being used as an instruction. This was one of the first things I tried and IME, couldn't actually get it to work. I'm sure (like all webscraping) it'll be an arms race though.