from the article "A pattern we see in some interpretability and interpretability-adjacent ML papers is defining some metric which is claimed to correspond to some property of interest, and then very rigorously measuring this metric. We see this as a kind of Cargo-Cult Science."
In Escape from Model Land: How Mathematical Models Can Lead Us Astray and What We Can Do about It, Erica Thompson explores how mathematical models are used in contexts that affect our everyday lives – from finance to climate change to health policy – and what can happen when they are malformed or misinterpreted. Rather than abandoning these models, Thompson presents a compelling case for why we should revise how we understand and work with them, writes Connor Chung.
I'm interested in whether this has potential trickle effect in other startups where the staff threaten to mutiny if they don't like the change in leadership. Flipping crazy and precedent setting for corporate governance.