I did use default settings on those tools. I'd agree it wasn't the best benchmark and certainly wouldn't hold up if the goal here was to break any records in compression. The tools and settings chosen were mostly to validate 'this ended up roughly in the same ballpark as other tools' over 'Claude burned a lot of tokens and still made a terrible compression tool'.
A very exciting release and I hope it stacks up in the field. I ran into their team a few times in a previous role and they were always extremely robust in their clinical validation which is often lacking in the space.
I still see somewhat of a product gap in this whole area when selling into clinics but that can likely be solved with time.
I'd recommend giving Raylib a look if you haven't. I've been working on a couple small ideas using it lately and it feels very aligned to being a game 'engine' for people who come from a more classic software engineering background.
There was a time where I felt like this. Especially early as a founder as we began to bring on staff for the first time. I started to feel that if I wasn't building the things then someone would call me out for not being deserving of the founder title any more.
It took a long time to grow out of this feeling. These days I get a lot of joy from management. I try to look at myself like a coach on a sports team. I may not be on the field but I feel good when we win knowing the work I have done to help my team succeed.
I would agree with the author that the feedback loop is different. It is also often slower and more subtle. That doesn't however mean that it's not there. Perhaps the author is new to management, perhaps the author just really likes being an IC. Their journey is their own but I would certainly say there are many paths to endorphins as a manager, even as a manager of managers.
This looks good as an overarching framework but will likely fall into the same bucket as a lot of regulation in cutting edge fields (if this ever becomes mandatory). These are only as good as the quality of the people doing the assessment.
I've worked with a lot of people in the medical world while developing SaMD (software as a medical device) in the past that had little to no idea about software. They can apply the principles in the abstract but will likely not dig deep enough to catch some very major issues.
In the medical world, things like post market surveillance and notification of adverse events help to at least create a public feedback loop here. I think we will need something similar in this space if we really want to see more than a surface level, checklist ticking exercise.
A (mostly) weekly podcast we've been doing for almost a year now. Trying to cover a mix of next, papers and releases through the lens of two previous founders of an AI company.
During my PhD this issue came up amongst those in the group looking into compressed sensing in MRI. Many reconstruction methods (AI being a modern variant) work well because a best guess is visually plausible. These kinds of methods fall apart when visually plausible and "true" are different in a meaningful way. The simplest examples here being the numbers in scanned documents, or in the MRI case, areas of the brain where "normal brain tissue" was on average more plausible than "tumor".
To Cal's credit, he has somewhat done this. He has a playlist on YouTube [1] which covers 90% of the lessons and it's pretty short. There is a lot more material sure but it's mainly focused on smoothing out that last 10% and can easily be skipped.
Something I will add which relates to the examples in the post (gym, business, relationships) is that big things happen with lots of small steps over time. You can't do a years worth of workouts on Jan 1 and be fit for the year. These things take daily effort and cycles of work and recovery to happen.
That desire for perfection can also be a desire to be done. To have it finished and get closure. It's hard to accept that some things are going to take a long time or a lifetime.
A model I've uses is one of risk. Whatever your idea is there are going to be a number of potential reasons it might not work out.
For some ideas the biggest risk is the market, does anyone want this? For others it might be the technology, is this even possible?
In a lot of cases you can do things to reduce those risks and give yourself more confidence to jump ship and go all in. That might be talking to people, it might be reading academic papers. In some cases, but honestly pretty rarely, it will be building something. Most of the time that can come later.
Not dismissing any of the great advice in here already around non-compete, company IP etc. most of this kind of work (research, conversations etc) isn't something your employer can "lock down" as concretely as an MVP. Plus if it is tangential to your current job and your idea doesn't work it, you may still end up better off from having learned something new.
The wiki is fantastic, I think I landed on the gitbook version somehow earlier this year. Love seeing long term projects like this full of interesting content. Well done.
The content and the design of your site look excellent, well done. I think the lab notes format for longer term projects works well to group ideas.
Is there any way to preview what is in the member magazine? It looks compelling but hard to tell if it crosses into purchase territory from the outside.
Writing mainly about AI and healthcare these days. Using ghost (hosted) after many years of picking a new platform every time I felt compelled to write more.
Yeah, very reasonable question. I suppose a somewhat simple version could be to add exercises to a 'cart' and then change the colour muscle groups on the home page based on cart contents. Would then be pretty easy to click back and forth and colour in the desired groups. If I could then look at my cart when I'm happy I have good coverage that would probably be enough for my needs of 'does my workout plan have any blind spots'.
Great website and kudos for making it. Noting you have limited spare time feel free to ignore but: I would love to be able to select a collection of exercises and see a visual of which muscle groups I do and don't have covered in the chosen exercises. Perhaps with some suggestions on exercises to cover those that are missing.