If I don't use my credit card, will I still have to pay an interest fee?

You only get charged interest if you buy something and don't pay it off completely every month. As long as your card has no annual fee which most don't, then you won't owe anything.