Both parties have struggled to stay popular this century. But the opposition tends to benefit from time out of power.