I know this is a common trope here, and yeah, plenty of MBA-type CEOs are trash. But speaking as a founder/CEO of a small company, the quality gap between an average hire and top talent at the director level is night and day.
Proven talent comes with a massive price tag, but it's almost always worth it. The times I regretted going with the 2nd or 3rd place candidate because they were cheaper ended up setting us back by months.
The same logic applies to CEOs. Moving the needle for a massive company by even a few percent is worth billions. Just look at Lisa Su or Steve Jobs.
This could be controversial, but when hiring and I see anyone that has multiple parallel jobs, it is an instant reject. Maybe this could be it? This sentiment is shared by many other persons I talked, and come from bad experience in the past.
I´m super curious about those "Two Weird Tricks". I would like that you would release more. It remember me the MiniMax Sparse Attention https://arxiv.org/html/2606.13392v1
One interesting point of GitLab for me is the self-hosted version, including the AI features (Duo) that can also be self-hosted and you can bring your own OpenAI/Anthropic key.
From my experience MariaDB is not necessarily better than MySQL. The 8.x line brought many interesting features. I dream on switch to Postgres, and try every year but for my use case MySQL is still superior (100Bi+ rows for large texts, and heavy modified - I´m also space constrained - So I need data compression and the VACUUM are not good.)
One thing I don't understand about Nvidia’s valuation is that right now a small number of algorithms have 'won,' such as Transformers. The data is very important. Compared to the past where customized code was much more common, such as modeling code and HPC, the ecosystem was very important and it was almost impossible to implement all CUDA and related code.
Competitors now only need to optimize for a narrow set of algorithms. If a vendor can run vLLM and Transformers efficiently, a massive market becomes available. Consequently, companies like AMD or Huawei should be able to catch up easily. What, then, is Nvidia’s moat? Is InfiniBand enough?"
I use Rancher for a hosted Kubernetes cluster on top of dozens of dedicated servers, and so far, it has been super nice. What are the alternatives for CI/CD for a small team (30)?
I'm really curious about the history of spaCy. From my PoV: it grew a lot during the pandemic era, hiring a lot of employees. I remember something about raising money for the first time. It was very competitive in NLP tasks. Now it seems that it has scaled back considerably, with a dramatic reduction in employees and a total slowdown of the project. The v4 version looks postponed. It isn't competitive in many tasks anymore (for tasks such as NER, I get better results by fine-tuning a BERT model), and the transformer integration is confusing.
I feel sad and disappointed in Microsoft for letting the entire Faster CPython team go. I was a big supporter, always leaving positive comments and sharing news about their work. I'd figure the team paid for itself in goodwill alone. What a letdown, Microsoft. You ought to do better.
This is a common mistake and very badly communicated. The GIL do not make the Python code thread-safe. It only protect the internal CPython state. Multi-threaded Python code is not thread-safe today.
Love NLP, ML and infra
github.com/bratao
bruno at escavador dot com