Do I risk ruining my credit if I refuse to pay the bogus charge?

The smarter play is to pay what you actually spent and withhold the disputed amount. That preserves your credit for legitimate balances while keeping the fraudulent slice alive for us to zero out in court.