Nah, you just have to pick the right parts. I built my sister a desktop PC recently for under $600 that is dead silent. The only thing not "stock" is the Coolermaster 212 Evo CPU heatsink/fan, but that was only $25.
Does it have a gpu used for gaming?