Context: I finished a PhD in pure math in 2025 and have transitioned to being a data scientist and I do ML/stats research on the side now.
For me, deep research tools have been essential for getting caught up with a quick lit review about research ideas I have now that I'm transitioning fields. They have also been quite helpful with some routine math that I'm not as familiar with but is relatively established (like standard random matrix theory results from ~5 years ago).
It does feel like the spectrum of utility is pretty aligned with what you might expect: routine programming > applied ML research > stats/applied math research > pure math research.
I will say ~1 year ago they were still useless for my math research area, but things have been changing quickly.
Exactly! It's n+1 points in n dimensions (when finite). Another way to think about it (the way that I know because it extends into general Banach spaces and not just n dimensional spaces) is that each point inside is the unique weighted average of the extreme points (corners). So in 2d, if you have a square you can get that middle point by averaging all the corners, or averaging two opposing corners, so it's not a simplex.
On the topic of simplices! I did my PhD in dynamical systems and the space of invariant measures [0] is (in the compact setting) always a simplex and the extreme points are the ergodic measures. It's because of this that you can kind of assume your system is ergodic do work there and frequently be able to generalize to the non-ergodic case (through ergodic decomposition).
But the real thing I wanted to mention here was the Poulsen Simplex [1]. This is the unique Choquet simplex [2] for which the extreme points are dense. This means that it's like an uncountably infinite dimensional triangle where no matter where you are inside the triangle, you're arbitrarily close to a corner. It's my favorite shape and absolutely wild and impossible to conceptualize (even though I worked with it daily for years!)
This paper is a theoretical analysis showing that the ridge regularization that optimizes the source task almost never optimizes transfer performance. Interestingly, in high SNR regimes (low noise) the optimal regularization for pre-training is higher than the task specific optimal regularization, and in low SNR regimes (high noise) it’s better to regularize less than you would if you were just optimizing for that task.
Although the proofs are in the world of (L2-SP) ridge regression, experiments were run using an MLP on MNIST and CNN on CIFAR-10 and suggest the SNR-regularization relationship persists in non-linear networks.
I think my main point is just because an LLM can lie, doesn’t necessarily mean an LLM generated slide is fraud. It could very easily be correct and verified/certified by the accountant and not fraud. Just cuz the text was generated first by an LLM doesn’t mean fraud.
That being said, oh for sure this will lead to more incidental fraud (and deliberate fraud) and I’m sure it already has. Would be curious to see the prevalence of em-dash’s in 10k’s over the years.
Establishes that accountants who certify financials are liable if they are incorrect. In particular, if they have a reason to believe they might not be accurate and they certify anyway they are liable. And at this stage of development it’s pretty clear that you need to double check LLM generated numbers.
Obviously no clue if this would hold up with today’s court, but I also wasn’t making a legal statement before. I’m not a lawyer and I’m not trying to pretend to be one.
Presenting false data to investors is fraud, doesn't matter how it was generated. In fact, humans are quite good at "generating plausible looking data", doesn't mean human generated spreadsheets are fraud.
On the other hand, presenting truthful data to investors is distinctly not fraud, and this again does not depend on the generation method.
Even one of these topics I would say it would take most PhDs at least 2-3 years to “master”. I feel like at the end of my math PhD (5 years, 3 focused solely on my research area) I had just scratched the surface of mastery in my sub field, and that’s with 3 published papers.
I guess you’re right though, defining “mastery” is the key missing point here.
Right but for self improving AI, training new models does have a real world bottleneck: energy and hardware. (Even if the data bottleneck is solved too)
ClearStride AI | Founding Software Engineer - Full Stack | Remote (US), Bay Area Preferred | Part Time | Equity Comp | clearstride.ai
ClearStride AI is building a comprehensive AI/ML powered platform for diagnostic radiology. Our initial focus is on equine radiographs, specifically targeting the unique needs of sports horse practitioners.
We are using deep learning to build a comprehensive diagnostic assistance platform that will enhance veterinary workflows and improve diagnostic accuracy. Our mission is to revolutionize the field of veterinary diagnostics, starting with automated annotations of radiographs and report generation.
We are looking for a founding SWE to help us finalize and deploy our MVP. The team is remote and based between CO and NY.
If you are interested please reach out to us through founders at clearstride dot ai.
I'm not sure if this really says the truth is more complex? It is still doing next-token prediction, but it's prediction method is sufficiently complicated in terms of conditional probabilities that it recognizes that if you need to rhyme, you need to get to some future state, which then impacts the probabilities of the intermediate states.
At least in my view it's still inherently a next-token predictor, just with really good conditional probability understandings.
To add some extra numbers here just to showcase how little energy usage this is.
This means it's adding about 0.012% additional energy consumption to those users energy consumption.
From another angle: Average US house energy consumption is around 30kWh per day. 0.012% of that is 3.75 watt hours of energy per day. This is the equivalent amount of energy as streaming HD video to your iPhone on a 4G network for 1.5 seconds. [0]
So in other words, a 15s youtube ad you are forced to watch on your phone before watching the video you were going to watch anyway takes an order of magnitude more energy than the average AI user according to this article.
We don't need first principals thinking every time, but having an understanding of why you can't just test 100 variations of your hypothesis and accept p=0.05 as "statistically significant" is important.
Additionally it's quite useful to have the background to understand the differences between Pearson correlation and Spearman rank, or why you might want to use Welch's t-test vs students, etc.
Not that you should know all of these things off the top of your head necessarily, but you should have the foundation to be able to quickly learn them, and you should know what assumptions the tests you're using actually make.
Important correction, it’s not DD/MM/YYYY, but DD Month YYYY. (At least what I saw in the article)
This format is common in heavily regulated industries and frequently a regulatory requirement since it’s fully unambiguous. I (American) worked in clinical research/pharma for a bit and still write my dates like 23Jan2024.
As someone that’s in the later stages of a PhD in math, given the title starts with “Mathematical Introduction…”, the notation feels pretty reasonable for someone with a background in math.
Sure I might want some slight changes to the notation I found skimming through on my phone, but everything they define and the notation they choose feels pretty familiar and I understand why they did what they did.
Mirroring what someone else said, this is exactly the kind of intro I’ve been looking for for deep learning.
In my experience it's at least marginally better, but one of the really nice features that Kagi has (and probably the main reason I subscribe) is you can extremely easily block domains. So whenever I hit a SEO garbage site, I just go back, block it, and I never worry about it again. In the areas you regularly search, this quickly gets you to a result page that is substantially higher quality than google.
> They were caught not too long ago actually spreading environmental causes in Texas against rare earth mining. They were trying to leverage our political process to make us dependent on them.
Do you have a source for this? I did some quick searching but couldn't find anything concrete. Super curious to learn more about this case if it's true.
It's the first symbol referenced for symbols used in proof by contradiction to show contradiction [0]. I know that's not exactly "not" or "disproof" but I think that might be what the poster was getting at.