I really don't think it is. I went back to Mountain Lion (the OS that came with my Mac) and it still did it on a completely clean install.
I ran AHT and it found problems with the SSD. I rang AppleCare who asked me to take it into the Apple Store. They couldn't get it to boot to their internal network when booting using a Thunderbolt ethernet adaptor, so they diagnosed a logic board fault. Subsequent tests using ASD over an external HD, confirmed the logic board was at fault, specifically the GPU.
2 weeks later and despite replacing almost every part they could, it still wasn't fixed and they gave up trying to repair it and replaced the machine for me.
A lot of other people are having this problem, not just on Yosemite, but on Mavericks too.