adrianco · HackerTrans

Local models need to be tuned to work well so this looks useful. Seems to be for general purpose model serving. I’ve been using https://github.com/adrianco/retort to run experiments for coding models across 13 different programming languages to see which frontier and local models work.

adrianco

há 16 diasdiscuss

I pointed my Claude/Retort evaluator at this blog post and it ran an experiment to test what it found. We got better cache hit refill but it didn’t improve the overall coding results on my M5Pro/64GB system. Results in experiment-24 at GitHub.com/adrianco/retort

adrianco

há 7 mesesdiscuss

I’ve talked to the authors of this, it’s a very interesting project. GPU memory space used to be the limitation but the latest generations of GPUs have enormous shared memory capacity and need something like SiriusDB to manipulate and prepare data in-place before the AI algorithms get to work.

adrianco

há 7 mesesdiscuss

I distilled these ideas over subsequent years into several talks on “Failing Over without Falling Over”. Investing anything in resilience without testing that it actually works is a waste of resources. Thats the underlying lesson. https://github.com/adrianco/slides/blob/master/FailingWithou...

adrianco

há 8 mesesdiscuss

All sounds like a good plan, but there’s no easy way to enforce the lack of cycles. I’ve seen helper functions that call a service to look something up, called from a library that is running on the service itself. So a service calls itself. There was probably four or five different developers code abstractions stacked in that loop.

adrianco

há 8 mesesdiscuss

It’s a bubble. Buy low and sell high. Right now, holding cash is the safe option. You can predict that the bubble will burst, but not when. However with the US being run by someone who is poking everything with sharp implements I think it bursts sooner.

adrianco

ano passadodiscuss

Its hard to understand why so many California houses are built of wood. After a fire all that’s left is a few chimneys. However I happen to live in California in a house made of concrete bricks and we don’t get a higher valuation per square foot or a discount for our fire insurance. There should be more incentives to build fireproof houses.

adrianco

há 2 anosdiscuss

I think there are two things that change. One is that Amazon would be controlling output scheduling of part of the the power station rather than the grid operator. The other is that this would be behind the meter for Amazon like rooftop solar, so would be accounted for differently in the annual report.

adrianco

há 2 anosdiscuss

This is super interesting and useful. I tried reading the code to understand how GPU workloads worked last year and it was easy to get lost in all the options and pluggable layers.

adrianco

há 2 anosdiscuss

Someone came up with the name for this: “Disagree and commute”.

adrianco

há 2 anosdiscuss

I wonder if the other Boars Head plants also have issues. Avoid the entire brand? What brands have better hygiene?

adrianco

há 2 anosdiscuss

AWS tends to optimize for whatever its customers want, rather than what its partner ecosystem wants. However we did spend some time trying to help open source partners figure out how best to work with AWS and to leverage the marketplace etc. to be successful by leveraging the platform rather than fighting with it. Mongo is a good example of how that can work.

adrianco

há 2 anosdiscuss

There were several proposals made to Elastic at the time, but their attitude was that they controlled the project and didn’t want AWS to make big contributions to the open source distribution that would reduce their differentiation. They were also mixing licenses in the code base and deliberately making it hard for AWS to use.

I was also assisting in the deal with Grafana, which I thought was a good deal on both sides, setting up a framework for AWS and Grafana to work together over a longer timeframe. Ash Manzani who negotiated the deal for AWS later joined Grafana to run Corp Dev for them.

adrianco

há 2 anosdiscuss

AWS at the time had AGPL on its list of licenses that couldn’t be used. There were other clouds in China especially ignoring the AGPL provisions and I think SSPL was used to try and be more explicit.

adrianco

há 2 anosdiscuss

Here’s the initial AWS response to the license change that they made in 2018, which I helped write. At the time we didn’t think a new license made sense, as AGPL is sufficient to block AWS from using the code, but the core of the issue was that AWS wanted to contribute security features to the open source project and Elastic wanted to keep security as an enterprise feature, so rejected all the approaches AWS made at the time. https://aws.amazon.com/blogs/opensource/keeping-open-source-...

adrianco

há 2 anosdiscuss

I tried to do this a few months ago (for videos not shorts) and found that YouTube will only let you download transcripts for your own uploads. You have to authenticate to the API. Also the transcripts aren’t that great. I ended up downloading the video and running whisper on it.

adrianco

há 2 anosdiscuss

I was a fly on the wall as this work was being done and it was super interesting to see the discussions. I was also surprised that Jepsen didn’t find critical bugs. Clarifying the docs and unusual (intentional) behaviors was a very useful outcome. It was a very worthwhile confidence building exercise given that we’re running a bank on Datomic…

adrianco

há 2 anosdiscuss

Not a big surprise. Garman has been working up to this for a while. It will be interesting to see how the VPs reshuffle and whether anyone else who thought they might get the CEO job leaves in a huff…

adrianco

há 2 anosdiscuss

When we migrated Netflix to AWS in 2009-2011 we setup a separate archive account on AWS for backups and also made an extra copy on GCP as our “off prem” equivalent. We also did a weekly restore from archive to refresh the test account data and make sure backups were working. I’ve documented that pattern many times, some people have even implemented it…

adrianco

há 2 anosdiscuss

This is a water-cooled system, so AWS is going to have to figure out a new datacenter architecture to install and run it. It’s a big investment and commitment from AWS and I expect that part of the deal was that NVIDIA would be a guaranteed customer at scale for the system, in return for things like AWS getting preferential early access to the technology.

comments