This mostly avoids the issue of getting negative sizes. It's still possible to get a negative size after refresh or deletion, I'll get to that in a bit.
