We do this for most of our docker image builds in CI. Definitely worth it if your CI builds take significantly longer than it takes to pull down the image layers from previous builds (sometimes network speeds can end up slowing it down with a method like this)