OK yeah, for some reason I had am Audio folder in my /Library/ folder with the duplicate loops in there. Deleted that and all was peachy (If I deleted the loops from /Library/Application Support/GarageBand/ I'd get an error saying no loops were installed).