(March 2024) Antropic claimed Claude 3 Opus had "graduate-level expert reasoning" with GPQA results of around 60% showing a roughly phd level performance.
(Sept 2024) OpenAI claimed o1 was phd-level in their launch post.
Yes and no. It would make the test fair but it would also mean losing any optimizations the vendors have made specifically for their model. They're all trained differently so they should be used differently to get maximum benefit. It makes sense to use each vendor's harness to get the most of their models, and compare the results that way. Additionally, it's not easy to use all the models in all the harnesses. Anthropic's subscription only covers claude code for example.
If it was just one test, sure. But if they're spinning these up continuously with new models on tens of thousands of GPUs, air gapping becomes impractical. I would mostly fault them on having no guardrails at all. They should have a monitor/external harness that looks for successful access to external networks then stop it there. They may as well let the models test their own networks for vulnerabilities. That's going to be really important to have going forward.
Has to be mixed. The model accomplished something truly impressive. We'll see how impressive when the zero-days are available look at. But OpenAI as an engineering company screwed up. The impressive part is mostly locked away from public access so I don't see a huge PR upside. The ugly part could bite them and the entire AI industry hard in terms of regulations. People will be citing this for years.
Even programming questions. If it's something considered popular, you get awful results. Take javascript, I always append "mdn" when I'm trying to look up a language/api detail. Otherwise I'd be sifting through the top ten garbage Q&A or tutorial sites. In the glory days, Page Rank would return reference material first since it was so heavily referenced. But clearly that no longer works in the real world of SEO optimization.
It's more about long-term strategy. China wants full control over their OS. They want features Microsoft would never add. They want support for their own hardware, etc.
Correct. The US only had net neutrality on the books for traditional ISPs. However, they were playing relatively nicely to avoid such regulation happening. The mobile arena was fought over data caps and exemptions rather than throttling.
Data exemptions are absolutely an example of a net neutrality violation. Similar things, like exempting partnered streaming music services from mobile data plans, have been shot down in Canada.
The fix was to block the botnets that were scanning millions of numbers and ban the associated accounts. Likely that includes some ongoing threat detection as well. That'll at least prevent scammers from collecting one more account name/number to attempt exploiting.
It doesn't do anything against a targeted attack against someone who has chosen to be discoverable. That's just how search/discovery is intended to work.
No, it wouldn't work. It only works if people can discover you with the "find people you know from your address book" feature. A deleted number won't match. Or you can just turn it off in your discoverability settings.
Exactly. Using Mars as a second example is basically just doubling down on the "Elon isn't trustworthy" argument. That should be a giant red flag to readers.
Have you considered just creating multiple windows/mac accounts? Since you can switch without having to log off, it's really convenient. I understand partners sharing accounts and such but it's really just a better workflow/experience IMHO.
I use Temporary Containers (https://addons.mozilla.org/en-US/firefox/addon/temporary-con...) to do this. You can customize how you want links handled when they target different domains. It takes some getting used to as there are a handful of options to understand/customize. Plus you can have customizations where you're replacing the current container with a new one which kills off your back button history. Just need to be aware of the quirks. It's definitely still in the realm of power-user UX.