No, that’s not my argument. Rather it is that a counterexample to a mathematical proof whether produced by human or AI may be a scientific discovery but it is not inherently new and brilliant by definition.
The case for AI is also weakened when the model is steered by an expert.
The comment more likely means the harness source was read, not memory from a previous run and the first few turns of bp35 appear to be a cold start.
Sure none of this is certain without the source.
I do believe the authors that this schema significantly improves over the base, particularly given that it took 22x simulated turns over 14 hours, which is moving the trial and error to context rather than to game. I also don’t doubt there is some contamination.
Regardless, the approach is sound and I do believe it would significantly improve scores, even if that was +20-30 over baseline (49% in this case) it does imply the benchmark is measuring the harness more than the model.
If you are referring to the Jacobian conjecture Claude only provided a counterexample, not a disproof, neither of which is necessarily a “new brilliant scientific idea”.
> Say, Claude 7 creates a new, brilliant scientific idea every 1 out of 1000 times.
I would not hand wave that away - but Claude 5 feels closer to Claude 1 than the hypothetical Claude 7 you propose. I do not believe one can extrapolate LLMs that far ahead despite the very substantial progress so far.
Radiologist who does read shoulder MRI would like to add that over half the annotations are wrong, glaring mistakes in anatomy and cardinal direction which begs the question of how is it making these findings without knowing what it’s looking at (here’s a hint, it’s hallucinated based on reports it sees).
Ultrasound is very operator dependent. Shoulder ultrasound is very hard. Visualizing the labrum let alone detecting pathology is very very hard and you will miss huge chunks of it due to limited windows.
Ignoring all of this, there are few sub specialist radiologists in the world who could theoretically do this and if you were to pay for their time it would cost more than a highly reproducible and easy to get MRI.
Half baked images? No one said that is impossible.
I am skeptical of any brain ultrasound claim that doesn’t use skull correction which requires a CT scan.
Very large chunks of vasculature and major arteries are missing in the images they provided. Just because it’s pretty and colorful it doesn’t mean it’s useful.
Perhaps it will one day, but this doesn’t prove much so far. There are several physical challenges to using ultrasound.
Depends for what reason. I trained in Canada. Studies are triaged priority 1 through 4 in most provinces. Nowhere in Canada is a high priority MRI waiting 2 months.
They are mistaken. I am a practicing radiologist in the US. We regularly work-up findings from private pay whole body screening MRIs and the workups are covered by insurance.
It’s called evidence based medicine for a reason. Medicine has long since moved away from making decisions based on whether a person thinks it will be better.
> Ultimately, it should be about personal freedom. This is not a contagious disease we're dealing with here.
The state regulates health and medical devices for a reason. Look at what’s happening with all of these prescription mill apps these days which are still theoretically overseen by a licensed healthcare professional - plenty of medical errors and harm in the name of increasing access (a good thing, when done well). We’ll see criminal investigations within a year.
1. Having concerns over unvetted AI is not the same thing as running an exclusive protectionist racket.
2. Doctors who depend on revenue from forced visits to renew prescriptions are grifters and not close to a majority. The profession obviously isn’t perfect but the vast majority of physicians I know would be happy to lighten their rosters.
With that said it can’t be a system that creates problems and dumps them back on physicians to fix, hence #1
That’s the goal for doctors too. It would be great to get simple things off the system.
But I think the more realistic intermediate step is a trained person cheaper than a doctor - nurse, PA, etc - aided by AI. The current generation of agentic AI doesn’t seem to be there yet and is too agreeable from RL.
“you’re probably fine sleep it off combined with: drink more water, eat healthier, exercise more, sleep better, consume less alcohol and quit smoking/vaping” +/- “we’ll check some labs to make sure” is the correct answer for probably 95%+ of encounters so it’s not hard for an automated system to handle most simple things, even without AI.
My gut as a physician says AI will revolutionize primary care the most and the premise of AI having more specialized knowledge than a PCP holds water - I think the future of primary care is AI equipped midlevel providers - so I was very excited by the intro only to be let down. A lot of buzz about nothing sadly.
The only takeaway here is logging helps detect patterns, we already knew that.
> The brain is encased in bone, so you might get some penetration but it will be very limited.
Radiologist as well. Remember this is full wave inversion not pulsed wave B mode. You can get much more useful information from both high low frequency and capture transmitted waves.
There is promise with this and we use it for example with MRgFUS. With advanced computational models or patient specific CT/ZTE MR aberration correction it is theoretically very feasible to image the brain with ultrasound, whether that’s more useful than say portable low field strength MR is a different question altogether.
> This is cool, but ultrasound is not CT.
Not to be pedantic but since this is a tech forum I would clarify that FWI US is computed tomography by definition (at least in this and many applications). Gas degrades conventional CT too, it’s just worse with US as you have little to no forward propagation and of course innumerable interfaces in the lungs to reflect and scatter.
This is ridiculously optimistic. The technology, USCT with full waveform inversion, is not new.
It’s already used in breast imaging (SoftVue) and hasn’t replace mammography. A body part ideally suited for ultrasound.
More compute many minimize some of the fundamental limits of sound waves (bone and gas) but I would be shocked if they have useful images of 90% of the body parts we image with CT or MRI and even beyond that I question how much it’s more useful than B-mode anyway.
Quite slow which means most things abdomen and chest will be motion degraded.
This may be useful in superficial areas but then why do whole body anyway. Might be some new niches and interesting research but hardly revolutionary in my opinion.