Today seems to be one for making guesses about the future of the impact of AI please allow me to add one more.
AI Impact has been very uneven and I've tried making sense of the magnitude and locations of the impact. Here's one breakdown by code base maturity, that pulls together how early stage products are moving soo quickly, while large tech companies are still struggling to get past 2x productivity, and what were leading edge Search and Home Feed products have noticeably decayed.
I'm the author and would be happy to answer any follow up questions. Also, I encourage replication of these results with additional data science classes and workshops. The generating notebook is included and a sample data set. If you are interested in running this exercise please stay in touch – as I would love to hear about your variations and results!
Ah! In some situations it is possible at the cost of a degraded user experience.
Let's say we have an experiment that encourages sending likes. There are two users here, the user sending the like and the user receiving the like. A traditional a/b test flips a coin. If the coin turns up heads, then the user receives the treatment. To control viral spread we want to flip a coin on the interaction of the like. To implement with a traditional experiment framework flip two coins, one for the user who could send the like and one for the user who could receive the like. If both coins turn up heads, then the interaction of the like receives the treatment.
A benefit is it allows us to test 2 hypothesis:
* Sending more likes is good for users
* Receiving more likes is good for users
However, the cost is an inconsistent user experience. If each coin is a 50-50 coin, then for a user sending the likes a random half of their network will be featured. Similarly for the user receiving likes, they may not understand why the sudden upturn in likes from some people when they may feel closer to others in their network.
Good Morning! I'm the author of the post and tried to highlight the salient points. Please feel free to ask questions for a more indepth explanation of application, derivation, etc!
I will be actively checking and answering questions today.
AI Impact has been very uneven and I've tried making sense of the magnitude and locations of the impact. Here's one breakdown by code base maturity, that pulls together how early stage products are moving soo quickly, while large tech companies are still struggling to get past 2x productivity, and what were leading edge Search and Home Feed products have noticeably decayed.