recitedropper · HackerTrans

recitedropper

151 karmajoined 3년 전

comments

5일 전discuss

Vibe code giveth, vibe code taketh.

5일 전discuss

I can't agree with this more. May cooler, more compassionate minds prevail.

10일 전discuss

As your writing seems to allude to, life is an impossibly complicated series of trade-offs made with imperfect information, so I definitely wouldn't consider joining an AI frontier lab to be a priori bad. Even if I have some qualms with how the models are built.

If anything I was just trying to point out that, even with people we might disagree with, we deserve to show them recognition and respect when they make moves we do agree with.

But I doubt we disagree on much. Your writing is great, and it makes me sad to see this thread somehow disappear from the HN front page so fast. Either it triggered some internal flamewar detector--but without a flamewar--or someone didn't find it convenient.

I wish you the best of luck with your next endeavors, and look forward to seeing the value you add to this world.

10일 전discuss

No worries! Thanks for engaging. Fun to have the rare kindly-resolved internet discussion.

10일 전discuss

Hmm, links for what? My student project? The decisions that face humanity that are pretty clearly modellable as prisoner's dilemmas?

Otherwise not sure what I could cite--I would assume most all on this forum know that AI is trained on the works of other people, without their permission to do so. I guess you could disagree with my framing, but I wouldn't think this requires a citation.

I think maybe my writing wasn't clear, and it sounded like I was referrencing some well known thing that happened at UC Berkeley. I have edited it to read more cleanly!

10일 전discuss

Nothing but respect to TurnTrout for taking an action like this. The world needs more smart people who are willing to stand for what they feel is right, despite the pressures otherwise. Without that occurring more, our species is going to lose many impactful prisoner's dilemmas coming these next two decades.

This raises my respect for AI researchers a little bit too. I have often felt that the entire industry is pretty tainted to the core, and for better or worse that colors my opinion of the researchers.

Maybe I'm in the minority, but I thought it was gross to download pirated art for a student project when I was at Berkeley years ago. So it has been really sad to witness many of the most brilliant minds of this generation answering the siren song of disrespecting the collective effort of others to extract and resell residual value.

I'd guess TurnTrout doesn't agree on that framing, otherwise he probably would not have been at Deep Mind. But clearly he and I agree on other ethical positions; I am nothing but glad to see him stick to his principles here.

10일 전discuss

There is a very real contingent of people driving AI who genuinely believe this. And it is this belief that allows them to avoid their cognitive dissonance around the negative externalities of their work. For the environment, and really for the future of humanity too.

The /s tag weakens the post. Glad to see I got downvotes--hopefully a few of these incredibly wealthy people in positions of power had to, for even a brief moment, consider their beliefs.

12일 전discuss

Don't worry, just a few more months until we get AGI and all of our problems magically disappear as the singularity changes everything forever.

Why care for current iterations of nature, when we will all get to experience infinite varities of it as immortal digital consciousnesses?

16일 전discuss

I agree with you--but just fyi I think "antifragile" is generally used in the opposite to what you mean. If I'm remember correctly Taleb has tried to coin it as a precise word to describe the inverse of your phenomena: Systems that prioritize robustness over optimizations, and therefore can handle stress effectively.

19일 전discuss

Tell me you don't understand Taleb without telling me you don't understand Taleb.

2개월 전discuss

The cult in this case is TESCREAL, not everyone working on AI. Last I checked not all the "several thousand skilled workers" in AI subscribe to TESCREAL ideology, although it has been a while since I've been to the Bay. Maybe things have changed since my time at Berkeley, and Dario's belief that he will eventually be made immortal by mind uploading is more widespread.

Otherwise we agree that benchmarking is hard, the benchmarks contain hard problems, and that there are many hard working people trying to accurately gauge what is going on. It is getting harder to watch though as all that is on the line taints the overall endeavor.

2개월 전discuss

Do you see the pattern as new accounts tending to boost or criticis $LLM_PROVIDER? I think I see both...

Either way, I agree that HN is quickly becoming more manipulated and low SNR, like the rest of the entire internet.

2개월 전discuss

"Carefully and thoughtfully" is antithetical to the approach to benchmarks these days.

Maybe back when this was a scientific endeavor; not now when enormous, enormous amounts of capital are on the line. Along with an entire cult's chosen eschatology.

2개월 전discuss

I am having a similar sentiment change about our industry as well. The more AI's marketing plays purely on fear and shame, the more I want to see it fail. If Anthropic, OpenAI, and the other power players continue in this direction, I hope the graduation speech boos are just the start.

2개월 전discuss

Interesting: New account, made approximately 20 minutes after this was posted, to solely call this out as slop. Someone either hates Anthropic, or something fishy is going on here.

Honestly I'm pretty tired of Anthropic's press releases too, but this one is pretty benign. If I was a hater, I'd save up my new-account-energy for their next "paper" that insinuates Claude might be actively introspecting.

2개월 전discuss

Completely agreed. It looks like there is a concerted effort to "massage" opinion away from any substantial questioning of the ethics, companies, and people behind the AI push. Some of this inevitabilism is organic of course, but there is too much for it all to be so.

HN is way too central for shared sentiment in the tech world for these companies not to do some amount of astroturfing. AI companies have shown at every single turn that they act out of self-interest and greed, not of moral principles. So it isn't surprising, even if it is still sad, to see those who are commanding the most capital in human history act with such callousness.

I think the appropriate course of response is to stop adding to public spaces on the internet. No doubt painful for those of us who have so benefitted from the freely shared thoughts of others. But if well-funded bullies are going come in, steal everything, ruin the commons, and then say "this is the new normal, deal with it", there isn't much the rest of us can do other than stop feeding them.

2개월 전discuss

The opening line of my parent comment is: "This is impressive, no question." I am impressed, and the chain you are replying to is questioning how much that impression should be tempered.

They pay people for expert training data they do not share because it gives them an edge over other AI companies. And, as always, deep learning is enormously data-hungry, and we've gotten to the point where publicly available data has been exhausted.

AI companies absolutely retrain models regularly to keep up with the cutting edge. There is a reason why this announcement references an internal, unreleased model, rather than "we just put a lot of new math papers within the GPT5.5 context window and found this."

2개월 전discuss

  - https://www.theverge.com/cs/features/831818/ai-mercor-handshake-scale-surge-staffing-companies
  - https://outlier.ai/math/en-us
  - https://www.opentrain.ai/
  - https://www.pin.com/blog/ai-labs-hiring-train-models/

Much of this is data annotation, reasoning trace evaluation, and problem set curation. But there is no way they haven't atleast paid some mathematicians to work on research grade problems in tandem with their models, and then used that for training data.

Does this expert data likely contain this proof within it? No. Would it temper the impressiveness to know they have a large amount of novel mathematical training data, an internal Lean harness for evaluation of open conjectures, and spent hundreds of millions in compute to calculate this? Yes.

2개월 전discuss

It is interesting to me how controversial this post is. It has the highest upvotes, and most disagreeing comments, of anything I've typed up on HN.

I'll gladly admit I think what these companies are doing is unethical, and I'm sure that biases my thinking toward skepticism.

That said, there remains way too much that is hidden to be able to effectively evaluate what is going on. You have the perfect storm:

  - AI companies do not share their custom internal harnesses.
  - AI companies do not share their custom internal training data. 
  - AI companies do not share how much compute they allocate to trying to solve problems of this nature. 
  - AI companies are primarily marketing their models to investors as human-replacing rather than human-augmenting. 
  - AI companies are under enormous financial pressure to make their business work.

The last two points incentivize them to find these types of "first proof" successes as aggressively as they can, and I'm sure they've thrown the whole book at it.

Is it likely that they literally had a mathematician discover this, put it into the training data, and then prompted it out? Of course not.

But it would make a world of difference--in evaluating the impressiveness of this discovery and LLM capabilities in general--if we were to know the extent to which the training data crosses over this problem, the harness with which this was ran, and how much compute was spent.

Until they bring more transparency to the whole process--something which some of the mathematicians commenting on this even asked for--I will personally take discoveries of this nature with a good dose of salt.

2개월 전discuss

Thank you for engaging with my comment in a kind and authentic way.