I love bringing up Pokemon as a humbling example of how AI progress is counterintuitive. Naively we might see games like Go, Chess, StarCraft, and Dota as more "complex," yet current approaches still tend to fail here, a game we would expect an early-grade school child to have no problem completing because of how incredibly sparse the reward function is. I hope that one day we'll get a satisfying tabula rasa solution to narrative-based/world model games like Pokemon rather than something like "well it turns out a GPT ingested a gameplay walkthrough during training and can regurgitate that as gameplay inputs womp womp."
Was it a salvage title car? A year ago a clean title FRS with 100k miles would still easily pull $10k at auction, so you got a heck of a deal if it didn't come with major defects.
I'm not sure how to reconcile the purported gains with the fact that matrix multiplies are empirically the most heavily accelerated primitive [1] on current-gen hardware and that the "digital ops" shown here aren't even a blip on the "fractional of total compute" Figure 6. Sure, they're very small in terms of FLOPs, but they take up a disproportionate amount of time being bandwidth-bound. Intuitively, adding another hop off-chip and A/D or D/A conversion doesn't sound great, and I wonder if that's why this work sticks to efficiency over end-to-end throughput. Given that GPUs today mostly trade efficiency for clock rate and speed (think about how a single GPU can be at > 300W TDP), how much efficiency could we gain by simply inverting that tradeoff?
What is a bit concerning is the speculation that the flight continued to the intended destination in an effort to avoid having the incident captured by cockpit voice recorder (which apparently only have a recording window of 2 hours???!?).
It gets exhausting seeing the same NIMBY talking points trotted around every once in a while. I guess the "new developments are just luxury housing" talking points have started to smell so we're back to the good old "character of the neighborhood."
Taking a look at the "character of the neighborhood" in South Bay and I couldn't be more thrilled that developers are putting up inoffensive boxes rather than some rehash of "Spanish/Mediterranean revival" that seemed to dominate circa 2000-2015. I have a little more hope that these "bland boxes" won't look garishly outdated in a generation. And that's neglecting the irony entirely of "European" styling applied to single family sprawl.
EDIT: Spoke too soon, "For many people, 5-over-1s have come to symbolize the most painful aspects of today’s housing crisis — stand-ins for gentrification, corporate landlords and excessively high rents." Do better, NYT.
My particular deal seems to be gone now, but they come and go periodically. I also didn't bother with the (bait?) models at the top of the page that never seem to be in stock.
I was recently in a similar boat, as the combination of discord + twitch was really making my 11 year old i5-2520M-based T420 really show its age (WHY IS A DESKTOP CHAT CLIENT AN ELECTRON APP??!??!) even with 16 GiB RAM in Arch Linux. I settled on a 16GB X13 Gen 2 from the outlet store (which seemed like a deal at ~520 USD). Coincidentally that's where I bought the T420 in 2011. The outlet store seems like a good way to snag a bargain for Linux users if you have a bit of patience as I would be looking at a last-gen model anyway (which seems to be primarily what the store stocks) for better compatibility.
A truly invaluable resource. Many years ago I was searching for the music used in this ancient Tom's Hardware video: https://www.youtube.com/watch?v=N1hg1zf7rrY after finding out that many previous Tom's Hardware video soundtracks were featured modules from the archive. However, this one remained elusive until I realized that the entire archive to ~2007 was available as a torrent and that even a single laptop could run the "shazaam" algorithm fast enough to search it given a few days of time ;) https://github.com/eqy/molasses
I'm genuinely curious of the details of how the 1.5v vCore measurement was obtained. CPU-Z and software measurements in general don't have the greatest reputation of being accurate, especially with just-released generations of CPUs. Conventional wisdom has been with newer manufacturing processes, less voltage is required (and tolerated), and 1.5v vCore sounds truly insane in 2022 for a "4nm" chip. For reference, I haven't heard of 1.5v being a safe "24/7" voltage since the days of 90nm-130nm+ CPUs circa 2005-2006. IIRC casual overclockers in the forums weren't really comfortable with 1.5v even with 65nm Core 2, and this was back when it was common to e.g., safely overclock your 2.4 GHz Core 2 Quad to 3.4 GHz.
If you can turn whitepaper diagrams and throughput claims into accurate performance estimates in your head, I suggest you embark on a lucrative career path as a world-leading computer architect immediately if you haven't already done so
The most striking thing about the architecture is that it appears so heterogeneous and complex. Considering the vast amount of software/machine learning engineering behind model/data/pipeline parallelism schemes like Megatron-LM and ZeRO (which target hardware topologies that seem almost simple by comparison) I'm curious what abstractions are in place to make this beast of an architecture friendly to programmers. Can you program a small tile in the same way you would a large tile and like you would in CUDA for a large/small GPU? Are there dedicated kernel teams that implement common blocks like multiheaded attention with the topology in mind so researchers/engineers doing modeling don't have to worry about scaling the model architecture in a hardware-friendly way? Do they have a monstrous fork of PyTorch with "Dojo" supported natively?
Wow, every time I am even remotely tempted to upgrade from my T420 (from 2011!) Lenovo manages to completely fumble something. ARM Thinkpad X13s? Crickets on Linux support front, not holding my breath on getting something usable anytime soon.
No physical trackpoint buttons hadn't even occurred to me until I saw the photos...
Pointless until you veer even the slightest bit from what Spotify is able (cares?) to license.
City pop listeners in the states will back me up on this one (it's not even an esoteric genre!) but where's Yamashita, Kadomatsu, or Sato? The Spotify US catalog is black hole here. Ironically the best legal way for listeners to buy this music is to fly to Japan to buy vinyl.
Ugh, every time I see a device like this (and even the larger Reform) I'm so tempted. But I learned my lesson form-factor wise with the GPD Win Max: even as a travel laptop it's painfully small after about a day or two of use. And the sad reality is that the performance-freedom tradeoff is still immense. If we assume the best system module is faster than say a Raspberry Pi 4 (which seems optimistic), it'd still get absolutely walked by an 11-year old i5 (e.g., Tx20 generation Thinkpad which are coreboot-able these days).
Any kind of performance-critical stuff is clearly not the point, but it's hard to not think that smartphones have killed off this form-factor/performance tier for good reason. Makes a lot of sense as a Raspberry Pi with a screen and keyboard, but not really as a "laptop."
As someone with a rapidly (exponentially?) decaying background in engineering, all the article did was create an insufferable itch of mathematical fuzziness about why these were called zeros until I got to the footnote and the actual article began.
Way out of my wheelhouse here but maybe something like emitter-coupled logic that was used in the Cray-1 of similar vintage? Power hungry but allowed the Cray-1 to hit 80 MHz in 1975.