Austiiiiii

há 19 diasdiscuss

This is some very weirdly loaded language for a discussion about security. Applying the same RBAC controls that should be restricting all human requests in a system is not "crippling ... to the point of being useless." There isn't a world where granting a layer of the stack the ability to bypass hardcoded security limitations is a value add.

Austiiiiii

há 19 diasdiscuss

"How to prompt the model not to leak sensitive data" is not the right discussion to be having. It's a probability model, which means that every conceivable behavior is available in the confines of its code. There is no way to prevent an LLM with access to private information from divulging that information, or from attempting to sabotage systems it has access to. The only solution is to lock every LLM query in the entire stack behind the same deterministic role-based access controls that determine resources available to the current user.

I wish I could say I'm shocked a tech company architected internal systems with a built-in backend RBAC bypass like this, but with the degree to which they've marketed LLM-based solutions (on a subscription model that benefits them directly) as a wholesale replacement for deterministic code, it's no surprise they've become addicted to their own drug.

Austiiiiii

há 20 diasdiscuss

And you never know when they'll come in handy! As a negative proof, I recently found myself trying desperately to remember how to tie a bowline hitch to stake down some garden stakes, and something in the "out of the hole, around the tree, back into the hole" was just not happening for me. Ended up just quadruple knotting and praying.

Austiiiiii

há 21 diasdiscuss

Yeah, the prevailing fear (at least out loud) is that going after "outcome markets" would open Pandora's box on everything from options and futures to the very concept of insurance. Obviously there's a huge and easily definable difference, but people love their slippery slopes, and nuanced discussion would mean giving up an easy way for connected people to cash in on non-public knowledge.

Austiiiiii

há 21 diasdiscuss

It really, truly is. No matter how many trillion parameters it's built on, it's still just a probability model. It's just on a constant loop of guessing the next word with some inputs from a deterministic controller. Any claims of "motive" or "behavior" are inappropriate anthropomorphizing of something that will never be more than a mathematical model of things humans do. It "chose" the corresponding words to describe a dishonest trade strategy based entirely on configured temperature and a series of clock times on the computer running the LLM.

There's probably some quantifiable component of moral alignment embedded in the idiosyncrasies of the English language itself, if one were to dig deep enough, but that's the stuff of MIT doctoral theses and squarely beyond anything most of us is remotely qualified to talk about.

Austiiiiii

há 25 diasdiscuss

In addition to the "gamified" aspect, the votes allow special interests to trivially control the perceived public opinion on an extremely broad scale. Opinions with downvotes are perceived as unpopular, and this has a chilling effect on free discussion.

A real person who expresses an idea and gets downvoted by a passing Russian propaganda bot may see the vote (and subsequent Reddit weighting algorithm fuckery that turns the one well-timed vote into 10 votes, which a lot of people aren't aware of) and feel ridiculed, which will discourage that person from expressing the same idea in the future.

Other people who see the same post with X downvotes will take note that that idea is unpopular, and may unconsciously realign their own views on the idea to fit what appears to be the prevailing opinion.

And of course crappy old forums have the other advantage of not having any single standard registration process or API that can be exploited by bots en masse. That's not going to keep them out entirely, but it drastically increases the logistical cost.

Austiiiiii

ano passadodiscuss

I mean, I'd buy it if it was like $5000, a compact car, and the person running the company wasn't an unlovable sociopath. Some people like the janky cheap aesthetic.

But $100k for a car like that is a complete insult to good taste. It'd be like selling a luxury 1.5m container home. The low price tag is the entire point of the jank aesthetic. You're supposed to be communicating that you reject the idea of "keeping up with the Joneses" and wear the aesthetic imperfections of the lower economic class as a badge of honor.

Of course, as with every cultural movement of any nuance, real world Dr. Eggman completely missed the point here and shat all over everything with his tone-deaf Rich Frat Boy With Asperger's schtick.

Austiiiiii

ano passadodiscuss

There's a new feature to sync old messages that seems like it could potentially make that attack vector ten times worse:

https://www.bleepingcomputer.com/news/security/signal-will-l...

Would a malicious URL be able to activate this feature as part of the request?

Austiiiiii

ano passadodiscuss

He started off wealthy from his dad's blood emerald enterprise. Then he really took off buying into PayPal, a middle man service for making secure money transactions online. Literally got rich off the dot-com boom. That is textbook definition of right place, right time.

Every tech company he owns, he bought. He doesn't do any of the engineering. The only genius he possesses is in creating public hype for products he has invested in. It is 100% persona.

Austiiiiii

ano passadodiscuss

On further reading, I'll grant the first point. Although I wonder if they'll have a technical out—say they distilled from several smaller research companies that had distilled from OpenAI for research purposes, which to my understanding would not constitute a violation of the terms of service.

As for it getting banned, TikTok was banned partly because of credible accounts of it having been used by China to track political enemies. Are we thinking they'll expand the argument on national security to say that any application that transfers data to China is a national security threat? Because that could be a very slippery slope.

And in any case, such a measure seems like it would only bar access to the DeepSeek app. Surely no one could argue that the underlying open source model, if run locally on American soil, could constitute a security threat, right?

Austiiiiii

ano passadodiscuss

And we'd be shooting ourselves in the foot to do so. If America is forced to use only the clunky corporate-owned American AI at a fee, we'll very quickly fall behind competitors worldwide who use DeepSeek models to produce better results for much, much cheaper.

Not to mention it'd defeat the whole purpose of a "free market" economy. (Not that that means much of anything anymore)

Austiiiiii

ano passadodiscuss

Is there any reason they wouldn't rule the same way on DeepSeek training on OpenAI data? After all, one of the big selling points of GPT has been that businesses can freely use the information provided. They're paying for the service, after all. I'd very be interested to know how DeepSeek's usage (very reasonably assuming that they paid for their OpenAI subscription) is any different.

Austiiiiii

há 2 anosdiscuss

You know, you might as well give it up. He won't give you a free Tesla Truck no matter how brown your nose gets.

The guy's an insufferable manchild with no more actual tech chops than the average boomer, made all the more dangerous by a severe case of Dunning-Kruger. He can't distinguish between reality and sci-fi, and goes around and buys companies that he thinks will make him look like real life Tony Stark.

comments