Ah this "beachball"

it spins around 3sec. If I then click open image in PS there is a spinning thing until it asked me which color spectrum I want to use. Don't know if it is already rendering to sRGB at this time. The time until the Window with the color spectrum shows up is about 3sec also.
@Jeff Flowerday: There is a noticeable lag in library mode and switching between library and develop mode. In develop mode everything is smooth. With lag I mean the first time opening the RAW file it shows up immediately but there is a spinning thing saying loading data for about 6sec at pictures with high detail (night shot). It is just there the first time opening it. First time zooming into the picture there is a lag of 0.5-1sec the first time.