There's no way to downgrade within iOS 5. You can downgrade to pre-iOS 5 firmware but for anything iOS 5 or above, it's impossible right now.
Apple changed the way they sign their firmware starting with iOS 5. The devs haven't found a way to circumvent this yet.
Ahh! That makes sense now thanks!