I think your opinion relies on a fallacy.I live in Japan and hate My Number system. Big brother is here to stay in Japan.
Big brother can also track you through multiple pieces of ID and just aggregating into a file with a master number.
Such would be no different from My Number except the individual would still be fumbling with multiple numbers and cards while the government had a virtual one.
Consolidating it on the user side doesn’t really change tracking on the government side much but possibly does reduce duplication and mistakes.