Png files save transparency, so if you do not want your exported image to be transparent, choose the jpg format.
If you prefer having a better quality png export, then what you can do is create a new layer beneath your existing layer(s), drag out a rectangle which extends past the image borders and fill it with white. This way you can also toggle it to be not visible or delete it in future without messing up your earlier work.