Do I need to pay late fees when original charge itselfis reversed

Hi,
I am not sure, if it is a correct platform to raise

the question .But anyway ...,

In Nov 2007, I bought an item from a company which

sells the product online.They offered a credit card

alongwith the item and asked me to pay through the

credit card.
In the following days, I neither received the item

nor the credit card. I did not follow it up myself

and almost forgotten it.
Now, two weeks back , I got a phone call from the

credit card company that I had to pay certain amount

( cost of the item + fees for non payment).
I contacted the company help desk.They confirmed that

the item returned to their warehouse ,

undelivered.So, they are going to request the credit

card company to reverse the charge.

The credit card company reversed the original charge

but they are still insisting that I should pay the

late fees charges.My point is - I do not enjoy any

benefit from the deal, as I never received

it.Moreover, the original charge itself has been

nullified.
Do I need to pay the late fees and other charges of

non payment even if the original charge itself is

revoked ? If no, then what are the options available

to me ?
I really appreciate your advice in this matter.
Thanks,
Vijay