LLMs struggle to explain themselves
jonathanychan.com50 pointsby jonathanyc80 comments
There has been much scrutiny over how much the ArriveCAN app cost to develop and who was subcontracted for its development. Contracts show that the federal government will spend close to $54 million with 23 separate subcontractors. A Parliamentary committee ordered federal departments to submit contracting documents related to the app but have been told that the names of subcontractors cannot be released citing issues of confidentiality. In October 2022, two developers at two separate IT companies took part in a hackathon where they both developed duplicates of the ArriveCAN app in under two days, for an estimated cost of $250,000.
Surely the actual app was more complicated than the hackathon duplicates. But where in between $250k and $54m should the cost have been? To be fair, I read estimates saying Healthcare.gov cost around $500m, and a friend who I know is a great engineer worked on that (albeit in a rescue capacity). And a single F-35 costs $80m, so maybe we need to triage things. In 2019 they were the #2 committers to both the WebKit and Chromium codebases and in the top 10 contributors to Gecko/Servo. Igalia has helped the interoperability of some features across web engines; they implemented CSS Grid Layout in WebKit and Blink.