If the other computers are running iTunes sure. All you have to do is point it to the library that you want to share. On a Mac hold Option when starting iTunes. Then a dialog will pop up asking to locate the library. In Windows I think you hold Shift.
When you want the original library back just quit and reopen doing the same (holding option [Mac] or shift [Win]).
Note: Only one computer can be running from a single library at a time or you will experience issues.