Data-Parallel Actors: A Programming Model for Scalable Query Serving Systems(micahlerner.com)
micahlerner.com
Data-Parallel Actors: A Programming Model for Scalable Query Serving Systems
https://www.micahlerner.com/2022/06/04/data-parallel-actors-a-programming-model-for-scalable-query-serving-systems.html
2 comments
Serialization vs. what... Throwing away data?
I mean yes, saving more to disk is slower than not saving it, computing more is slower than not computing anything... Or are you making a more subtle point?
I mean yes, saving more to disk is slower than not saving it, computing more is slower than not computing anything... Or are you making a more subtle point?
You’re saying serialization for immutable objects?
Anyone interested in data meshes should give the paper itself a read.
The primitives developed for the system are incredibly flexible and potentially worth knowing about.
The primitives developed for the system are incredibly flexible and potentially worth knowing about.
It’s easy to code, naturally, but if you’re saving large objects your performance will tail off over time as the volume of data increases.
Wins I’ve seen and coded myself have been in reducing the iops.