meatmanek · HackerTrans

meatmanek

1,152 karmajoined 16 jaar geleden

[ my public key: https://keybase.io/evankrall; my proof: https://keybase.io/evankrall/sigs/dZbfLc0PpPkWQrWVgPvqbe1P_y2BH4gxAW3jzxYis24 ]

Submissions

Preventing Kubernetes from pulling the pause image from the internet

kyle.cascade.family

97 pointsby meatmanek9 maanden geleden52 comments

Introducing venv-update

engineeringblog.yelp.com

3 pointsby meatmanek10 jaar geleden0 comments

True Zero-Downtime HAProxy Reloads

engineeringblog.yelp.com

128 pointsby meatmanek11 jaar geleden49 comments

Yelp moves to Spain

techcrunch.com

3 pointsby meatmanek15 jaar geleden0 comments

Everything's Amazing and Nobody's Happy

youtube.com

1 pointsby meatmanek16 jaar geleden1 comments

comments

3 dagen geledendiscuss

There are 1-bit* LLMs (+1/-1, usually), though they often come with an additional scaling parameter:

https://huggingface.co/prism-ml/Bonsai-27B-gguf#weight-repre...

> Weight Representation: Q1_0_g128 Each weight is a single sign bit: 0 maps to −scale, 1 maps to +scale. Every group of 128 weights shares one FP16 scale factor. > Effective bits per weight: 1.125 (1 sign bit + 16-bit scale amortized over 128 weights)

The Bonsai ternary model also uses this group-wise scaling, so the theoretical bits per parameter is 1.71 instead of ~1.58; additionally, they actually store trits as 2 bits; with the group scaling factor it becomes 2.125 bits/weight: https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf#memo...

8 dagen geledendiscuss

> Scan the backs

I guess this is assuming some scanning rig (camera scanning?) where it only takes a few seconds per photo. With a flatbed scanner, scanning the backs is almost certainly going to take longer than just typing dates in manually.

10 dagen geledendiscuss

My (probably mis-)understanding of StubHub/Ticketmaster is that they're serving as sin eaters / reputation shields for the artists:

Phase 1:

   - Artist lists tickets as "$20"
   - SH/TM charges $20 + $15 convenience fee
   - SH/TM pays the artist $30 and keeps $5
   - Artist gets to look like they're kind/generous for pricing so affordably while making some of SH/TM's cut

Phase 2:

   - SH/TM hold back some percentage of tickets (possibly most or all of them) to sell on the "resale" market
   - Those "resale" tickets sell near the market-clearing price, either earning higher margins than if they had sold at list price, or ensuring that most of the seats in the venue are filled.
   - SH/TM kick back some percentage of revenue from resale tickets to the artist.

11 dagen geledendiscuss

It's also super fast on CPU.

18 dagen geledendiscuss

Direction dependence also means your output drops even more on cloudy/overcast days.

18 dagen geledendiscuss

It would be really cool if they could expose this information to customers somehow. Imagine:

   - having a log of the most prominent J-space tokens during your customer support chatbot's interactions with a user, so you can have more introspection into why a particular outcome happened
   - being able to detect certain thoughts associated with undesirable behavior (hallucinations, overstepping authority, lying, etc.) and trigger some sort of remediation (e.g. upgrading to a better model, redirecting to a human, forcing tool calls)

28 dagen geledendiscuss

All you're saying is that the government under Biden talked to Meta.

29 dagen geledendiscuss

https://youtu.be/zdA__2tKoIU?t=149

29 dagen geledendiscuss

> You are missing the context of the ecosystem

That's one of several reasons why a citation is warranted.

vorige maanddiscuss

This is super cool. Do you know if any of the inference backends (llama.cpp, vllm, etc) support this technique?

vorige maanddiscuss

> speed dial options. That doesn’t happen if you don’t click on them directly.

It also seems to happen if you type the domain name in the address bar but hit enter when the suggested URL autofills. For me, typing out aliexpress.com fully will send me directly to AE, but typing aliexpress.c and hitting enter (with the autofill completing "om") redirects through vivaldi.com/bk/aliexpresscom-us

vorige maanddiscuss

Frankly, it's not really more insecure than any other installation method. Apt packages and the like generally have the ability to specify pre/post-install scripts, so `sudo dpkg -i ./random.deb` is equivalent to `sudo bash ./random.sh`. Even if they didn't have pre/post-install scripts, they're still writing arbitrary files to arbitrary locations on your disk, so they can trigger execution the next time you boot or log in or whatever.

And at the end of the day, no matter the installation method (even just unpacking a tarball and executing the program directly from that directory), you're going to run their program on your computer, and then the program can do whatever it wants. Maybe you don't run it with sudo, but https://xkcd.com/1200/ seems relevant.

vorige maanddiscuss

Freemium is a potentially interesting model for app developers. If you're small enough to be in the free tier, you can avoid the risk of someone turning your app into the next backend for Chipotlai Max and running up your AI bill.

Once you get enough downloads to where Apple starts wanting to charge you money, you can consider switching to OpenAI or Anthropic or Google or Deepseek or whatever. Sounds like they've even made that relatively easy to do in the Foundation Models framework -- just implement the LanguageModel protocol. I expect open-source or provider-written adapters to pop up that would let you use your vendor of choice.

2 maanden geledendiscuss

I'm guessing they'll integrate with the double-tap-the-bottom-of-the-screen feature that pulls up siri in front of a screenshot. Currently it doesn't seem to hook into "visual intelligence", and needs to call out to ChatGPT to do anything with the screen contents.

2 maanden geledendiscuss

"shape"

2 maanden geledendiscuss

At least that somewhat aligns incentives between players and the game studio. If an old game has a long-lasting player base, then a modest subscription makes it more likely that the studio would keep the servers up and running, if not actively patching the game. With a game that you pay for up-front, a long-lived player base can be a liability for the company (ongoing costs without many new purchases.)

2 maanden geledendiscuss

it's a joke: the author of the post is literally the guy who wrote PuTTY

2 maanden geledendiscuss

I still use google as a verb even though I use Kagi.

2 maanden geledendiscuss

Presumably asymmetric splits meaning A and B can talk, B and C can talk, but A and C can't talk.

2 maanden geledendiscuss

> AI works great on it.

Define AI, and define "great"