My 10+ year old 46 inch Sony Bravia TV died last month, got a good deal on an open box Samsung 58 inch 4k TV to replace it. Was concerned that my Apple TV HD would look terrible on the big 4k screen but was quite surprised when I hooked it up. Everthing looks noticeably better. I think the upscaling algorithms on current 4k TV's are really quite good and since the screens are also better (brighter, better contrast, blacker blacks) it makes quite a difference.
I don't have any 4k content, don't watch sports and am just not very interested in 4k programming. Had been planning to upgrade to a new 4k Apple TV but decided not to. Eventually I will, but mainly for the faster processor and gigabit ethernet. For now, I just don't want to spend the money however.