groq did an ASIC for llama and now for nvidia. Their cloud service is fast.
> NVIDIA Groq 3 LPU Inference Accelerator
> The NVIDIA Groq 3 LPU is the next generation of Groq’s innovative language processing unit. Each LPX rack features 256 interconnected LPU accelerators that, together with the NVIDIA Vera Rubin platform, supercharge inference. Each LPU accelerator delivers 500 megabytes (MB) of SRAM, 150 terabytes per second (TB/s) of SRAM bandwidth, and 2.5 TB/s scale-up bandwidth.
“Mac-only” was disappointing to read, but OBS’ render performance has been fine on macos and linux even with older hardware. James Webb calls anything heavier than helium “metal.”
> The technical term is enteral ventilation via anus (EVA).
Anecdatally, I have encountered multiple people with congenital capabilities re enteral locution via anus.
Wishfully, training astronauts for enteral ventilation via anus during extravehicular activities that involve writing an ongoing Prince song would be called “EVA EVA 4EVA.”
Beyond solid benchmarks, Alibaba's power move was dropping a bunch of models available to use and run locally today. That's disruptive already and the slew of fine tunes to come will be good for all users and builders.
> The DESI collaboration is honored to be permitted to conduct scientific research on I’oligam Du’ag (Kitt Peak), a mountain with particular significance to the Tohono O’odham Nation.
Anyone here know how a request like this was made or the permission given?
I haven’t seen this previously.
A recent financial report on the media industry noted The Onion is on the verge of collapse due to, quote, “not being able to able to make sh*t up that is more idiotic than current reality.”
darktable does all of this. It’s a complex application like Aperture or Light Table. You run it on your own macos, Windows or Linux computer. You can write your own software to extend or change it. Photos.app does most of this sans the Windows, Linux or “write your own” parts.
“Your Honor, why should I bother obeying a law my elected representatives could not be bothered to write?” seems like it should be a reasonable defense, but you’re right that the onus is on us as The Governed to know and understand every bit of slop and hallucination on the books.
OpenAI and Anthropic are definitely among the leaders. Playing catch-up to these leaders' mind-share and technology is some of the motivation for others. Calling the progress being made in the space by Google (Gemini), MSFT (Phi), Meta (llama), Alibaba (Qwen) "nice and all" is a position you might be pleasantly surprised to reconsider if this technology interests you. And don't sleep on Apple and AMZ -
In the space covered by Tabby, Copilot, aider, Continue and others, capabilities continue to improve considerably month-over-month.
In the segments of the industry I care most about, I agree 100% with what the commenter said w/r/t expecting major improvements every few months. Pay even passing attention to huggingface and github and see work being done by indies as well as corporate behemoths happening at breakneck pace. Some work is pushing the SOTA. Some is making the SOTA more widely available. Lots of it is different approaches to solving similar challenges. Most of it benefits consumers and creators looking use and learn from all of this.
A compiler in the mix is very helpful. That and other sanity checks wielded by a skilled engineer doing code reviews can provide valuable feedback to other developers and to LLMs. The knowledgeable human in the loop makes the coding process and final products so much better. Two LLMs with tool usage capabilities reviewing the code isn't as good today but is available today.
The LLMs overconfidence is based on it spitting out the most-probable tokens based on its training data and your prompt. When LLMs learn real hubris from actual anonymous internet jackholes, we will have made significant progress toward AGI.