We have to 'pay', or, in other words, we have to reap what we have sown or have thrown into the Universe, through our actions, attitudes & intentions. This is called paying off karma. That is, we have to settle the accounts in order to clean the soul of the marks left on it by its negative actions or intentions. We also reap the fruits of the good seeds that we have planted.
