Oh, I remember them very well. I actually had a portable MP3-player and a couple of years later a cell phone with MP3 player built in (the excellent - for its time - Siemens SL45) before the iPod was even available.Remember before the iPod how there was the Creative Nomad, and the Archos Jukebox and so on? No, nobody does.
I have no issue with Apple copying and refining earlier ideas. What really grinds my gears though is that they always present it in a way that implies that they have actually invented the idea/function - and that it is something brand new that no-one has done before.
And most of the press plays along every single time - it is not unusual to see the same reviewer trash something one year and then praise something that is 99% similar from Apple the next year.