In the US, patents and trademarks are handled by one office, PTO. The notion of defending patents and trademarks is the same. If left undefended, they can be contested.
Trademarks? Yes. Patents? No. Your patents are yours for 30+ years, whether you protect them or not. The only way to lose a patent is to have it contested in court.