What this boils down to, is that we live in the civilisation of the image, where image is the most important thing. So now, for authenticity, you constantly have to look past and ignore the bs.
I remember 2 years ago someone proposed adding stream processing in datafusion and PRs followed. But IMO stream processing is an entirely different beast, some people could use the sql engine of df for it though. There are rust projects like Arroyo