Yes that's the method I used when I switched from a galaxy S5 to the iPhone 6 plus. However I already had an iTunes library on my computer with all my music in it. So it was just a case of syncing.
Since that time I got a MacBook and had to set up my iTunes library on the Mac. I had been storing all my music on an SD card when I used android phones so I just put the SD card into the Mac and transferred all my music across to iTunes.
To add to msp3 and Gav2k: Just stream using the Google Play Music App and either download your music through there or turn on music caching. That will pretty much just download the music for you on your device, and the app has a toggle to only list music stored on your device (including cached music) for ease of playback.