I cannot remove a device using that link. However I already logged into iCloud and removed the device, this did not make a difference though :-(
However it seems the issue is a self healing one "Removing Tabs from the Tab list
To remove a tab from the list of iCloud Tabs, you must close that tab in Safari on the supported device that you used to browse that website. Quitting Safari, putting your Mac to sleep, or shutting it down will not remove the tab from the list. If you no longer have access to the device that that you used to browse that tab, the tab will automatically be cleared from the list after 7 days, if not updated."