If you must mount the DMG to use the application, then yes deleting the DMG file will delete the app.
Usually when installing apps, you mount the DMG, then drag the app to your Applications folder. If the app is in the Applications folder, and you don't need to mount the DMG to use the application, then you can delete the DMG file.