Paying down a debt as quickly as possible can help interest owed.