That'll work, but it would be a better match to have the smaller original 1980s SE keyboard and square-type mouse.
The similar Apple IIgs keyboard is also of the same era and matches the SE's design (it's what I use on my SE/30).
I believe you can still buy the mice brand new still in the plastic (from old warehouse stock) on ebay. The SE keyboards are available too, but much harder to find in very good condition though. I bought a couple that looked good in the ebay photos but were heavily discoloured or stained or damaged in reality.