I actually recently asked a German police person the exact same question if I have to have my ID/passport with me at all times.
The answer was “no, you just need to own one or the other”.
I always thought as well that there is “Ausweispflicht” (ID carrying obligatory) in Germany.