AHT is OS independent. If you are really worried, take it to the Apple store and have a Genius run a hardware test. When I had an issue with my machine, I took it there after I was pretty sure it was the RAM. Even after running AHT and doing boatloads of research, I was still super paranoid.
They gave the Logic board the all-clear, and even told me which stick was bad. Have Apple check your machine out if you are really paranoid about its condition. Believe me, I've been through this-- it's really really scary, especially when you rely on your computer, and don't have the money to repair it-- let alone replace it.
Let us know what happens. By the sound of it-- I'd put my money on a bad RAM stick, based on the fact that you passed the basic test-- and hung out on the last one. Download this program, and run it. If you Kernel Panic while it is running, you have bad RAM.
http://www.kelleycomputing.net/Rember/
Again, if you upgraded your memory, it is likely that it has a warranty. If that's the case, you can fix your machine for free!