Visual Feedback for Copying with Keyboard Shortcuts
prabros.com1 ポイント投稿者 fwlr0 コメント
An AI agent, 600k tokens into a feature that it just authored, understands the feature as well or better than I do.
On this, we are in complete agreement. If enough capital has been installed before learning removes the wedge, the economy lands in the high-capital state,
I’m gonna need an honest caveat on the load-bearing assumption here. This could be due to ADD, I am still getting tested. Granted, that's a diagnosis, not a root cause.
No, it’s a diagnosis of the root cause - in fact, it is plausibly the root cause of everything else described in the post. Inability to complete work, procrastination/distraction by focusing on nearby tasks, the pervasive sense that you struggle with things that other people do not, even the depression (untreated ADD causing repeated failures, repeated failures causing depression). To understand why it really could be the root cause, you can read up on “executive dysfunction”, which is what ADD really is. For each likely AI-generated target, we search human controls from the same repository and same programming language, controlling for project-level practices … We also apply size matching: a control must be within 20% lines of code of the AI target
And then from the start of their results and analysis: Comparing the lines of code (LOC) between AI-generated and human-written files, we observed no statistically significant differences
Here I would expect some sort of caveat that this result is a verification that their size-matching was effective in removing differences in lines of code between the target and control. However, there is no such thing, indicating to me that the authors are unaware that what they are detecting are the effects of their own methods. This leads me to strongly discount their stated insight regarding structural differences, and frankly the rest of their paper too. For mechanical work–things like bumping versions, fixing failing tests, checking documentation for inconsistencies–the clankers have proven their worth (even before LLMs, anybody remember dependabot?)!
The way to fix that, of course, is automated processes and mechanical guardrails. Automatic enforcement of style, automatic testing and linting and formatting–same as ever.
We can use the whale fall tokens to build that machinery.
This seems to be the main contention of the post, however it leaves me confused as to what the author specifically thinks should happen. “We should have the AIs generate more dependabots”?