Really two different things the OP needs. One he knows about, and one he doesn't.
First, a request for some clarification. You have a DSL modem that has a single Ethernet port on the back, right? You stated "no wireless". I'm assuming that that's due to some kind of restriction - i.e. workplace or parents or whoever said "no wireless". Is this correct? Or do you simply mean that your DSL modem doesn't have WiFi?
Anyway, if there is some "no wireless" restriction, then the wireless router one person suggested is out.
Does the DSL modem have NAT built in? Do you know what NAT is? (Do a little Wikipedia research...) NAT allows several computers to share a single Internet connection. It changes the packets going out to the Internet so that they all come from the same address. It also provides *some* firewall protection, in that incoming packets are only accepted if they match-up with an outgoing packet. By default, a NAT router won't accept any incoming connections. You can set it up to accept incoming connections, in that case you need to designate which computer to send them to for a given port.
This is of no concern to you unless you are running a server, etc.
If your DSL modem does not have NAT, and also doesn't have some kind of firewall, then you are currently *very* vulnerable to attack.
It would be useful to post your DSL modem model.
If it does have NAT, then I'm a bit surprised that they didn't build in a small Ethernet switch and give you multiple Ethernet ports. If it does have NAT, then you should only need to add an Ethernet switch. Get a gigabit switch, which will make then connection BETWEEN your Macs very fast. (For copying files back and forth, etc.) For the Internet connection, gigabit is a non-issue, since Internet speeds are (typically) way below that of even a 100M switch.
If it doesn't have NAT, then you need a router or firewall. Think "wifi router without the wifi". It's a bit of a specialty product, because they are usually built into a WiFi device, cable modem, or DSL modem.
You can also look for a compatible DSL modem that has a built-in router and switch.
You will have to check your provider's terms of service to see if it's OK to connect more than one computer. Generally, though, the provider won't be able to detect that you are using NAT, so won't know in any case.