Which 3 finger swipe are you talking about and you are talking about finger gestures on Mac laptops? I don't know if the Magic Mouse uses 3 finger gestures which is why I asked the latter question.
I didn't try Chrome from the beginning but 3 finger swipes from left to right has always worked for me. Three finger swipes up and down doesn't worked in both Chrome or Safari. In Firefox the 3 finger swipes up and down go to the top and bottom of the page which I really like. I'm talking about the MBP unibody trackpad by the way. I don't own the Magic Mouse.