Why should banks that received TARP money not be asked to pay a fee so program does not add to the deficit?

It will hurt businesses because banks won't lend as much money, it will make interest rates and fees go up and that will hurt the consumer.