Another important point about sending the requests to different servers is that it reduces the tailing latency (higher percentile latencies) and the variance in latency
While some data is cached at an instance level by rocksDB, it wouldn't be cached across instances. So, there is a need for coordination/communication among the servers for every request.