Since this is all new to you, and there is nothing stupid about that, .dmg is a Disk Image file. When you click on it, as you've found, you get a virtual drive mounted on your computer. As has been explained, drag the application to your applications folder and trash (unmount) the .dmg file. This is how most applications are installed on a Mac. Drag the application to the trash to uninstall it.