I'm not sure that LLVM is the correct way to go about this. Don't get wrong, it can be used, but most of the work of the frameworks work on very large tensors/multi-arrays. As such optimization of the computation graph for such arrays, although very similar to standard optimization, has also and some significant differences. I do believe, however, that all frameworks should start using the same graph IR representation and optimize procedure, with potentially having different back ends based on hardware and different front ends based on language. I in fact tried to achieve this some time ago, and is still in progress, but lately have no time to work on it. Still the post is really great.