Go to the Site Map button. There you will find "contact us". The 800 # there is for the site, not the CRA. Tell them you want to cancel. They can tell you how.