dacox · HackerTrans

16 giorni fadiscuss

the 1.5 and 2.0 flash models were absolute beasts. They were very cheap, and _very_ fast. We contemplated moving some of our fine tuned workloads to them because we would have gotten very substantial total latency reductions for our workloads.

However, they are aggressively deprecating them (OpenAI is as well), and replacing with newer models. These newer models are all reasoning models, and importantly, only bear the flash name. They are not fast. And they are very expensive!

dacox

mese scorsodiscuss

very cool! not sure if something is broken, but there seems to be no data past 2019 on any of the queries that i can see

dacox

3 mesi fadiscuss

As a Canadian I see little reason for optimism

dacox

3 mesi fadiscuss

Yeah, I have been seeing lots of comments, tweets, etc, but given everything I have learned about these models - i do not think the change to 1M was innocuous. I'm not sure what they've claimed publicly, but I'm fairly certain they must be doing additional quantization, or at minimum additional quantization of the KV cache. Plus, sequence length can change things even when not fully utilized. I had to manually re-enable the "clear context and continue" feature as well.

dacox

5 mesi fadiscuss

i feel like i misunderstand the UI - it seems to show coalition strikes mostly being intercepted? or does the bottom row refer to strikes against coalition forces?

dacox

6 mesi fadiscuss

The reflexive and moralistic anti-AI takes are starting to get more annoying than the actual AI slop

dacox

7 mesi fadiscuss

the stacked changes support, for me, was an absolute game changer. the auto rebasing, etc, is -really- nice. i found it especially useful for Gitops type stuff where you have to make lots of little PRs

dacox

8 mesi fadiscuss

The iPhones autocorrect is one of my biggest frustrations coming from Android a few years ago. The biggest frustration for me is the tendency to correct the _second to last word_. I have never gotten used to this. I know i can stop it by "clicking" on the word instead of hitting space - but that feels slow and bad.

dacox

8 mesi fadiscuss

awesome! i was just looking at a bucket full of parquet files from last year trying to recall some things about them.

i tried to install with brew, but it told me my cli tools were "too out of date". Never seen that before! and also just upgraded.

Will try again tomorrow

dacox

9 mesi fadiscuss

thanks! glad to know its getting fixed. if i have any notes ill send them your way!

dacox

9 mesi fadiscuss

Cool app!

I think I found a broken problem (or it’s worded strangely?) and I’m unable to progress beyond it

“Pick 2 that beat villain on board”

“QQ552”

In submitting Queen and 2 to make a full house but it just says

“Incorrect. Two pair on board. Win with a full house or ace kicker”

dacox

9 mesi fadiscuss

There is a podcast, Memory Hole, about the recovered memory movement. There is a lengthy section about this book and the people behind it (not positive)

dacox

anno scorsodiscuss

Plugging ourselves, Lumen5 based out of Vancouver. I was one of the first hires found trough the HN hiring thread many moons ago. https://lumen5.com/

dacox

anno scorsodiscuss

This is happening everywhere where I live (Vancouver)

dacox

anno scorsodiscuss

I think it should fairly clear why I'm curious, as the article mentions

> Although it’s typically not viewed as a partisan board, the Biden administration had installed the entire committee.

After some degree of googling the history of ACIP I had not found any explanation and thought maybe someone here(who is actually American and maybe follows this kind of thing more closely?) would just know

Looks like there are actually some comments now that are more clarifying.

> Are you just asking questions to smokescreen for this executive power grab?

I’m just trying to understand the background. I get that this is a sensitive topic, but I’d ask that we keep things civil and give people the benefit of the doubt when they’re asking honest questions.

dacox

anno scorsodiscuss

yeah, I see that.

Apparently ACIP is very much not new. I am curious to the specifics of the prevous mass appointment, however.

dacox

anno scorsodiscuss

Was this a new committee? there is a quote about this being a coup, but it is also noted that the previous administration selected the entire existing committee

dacox

2 anni fadiscuss

It's an open secret that most nutrition research is of extremely low quality - almost all relying on decades old self reported nutritional questionnaires.

Sometimes dozens of these studies get wrapped up and analyzed together, and we headlines that THING IS BAD with a hazard ratio of like 1.05 (we figured out smoking was bad with a hazard ratio that was like 3! - you need a really good signal when you are analyzing such low quality data)

dacox

2 anni fadiscuss

...k

dacox

2 anni fadiscuss

They definitely have to be trained to reinforce longer outputs, but I do not believe this adequately explains the low-ish generation limits.

We are starting to see models with longer and longer generation limits (gpt-4o-mini having 16k, the o1 models going up to 64k), as well as longer and longer context limits (often 128k, google offering a million).

I find it very unlikely they are actually training with inputs or outputs near these maximums.

If you want to convince yourself, do the attention calculation math for these sequence lengths.

You can also see how openai restricts the sequence length for fine tuning to 64k - almost certainly bound by available GPU sizes

I suspect the 4096 limits have been set as a "reasonable" limit for a myriad of reasons.