I had this exact same problem, here's what you do:
Open iCal
To to File > Export > Export...
Save the calendar (and any others you have) on the desktop or somewhere handy
Go to settings and disable iCloud calendars
iCal should now be empty
Double click your exported calendars, and choose to add them to iCal as a new calendar.
Boom done.