Speed won't be an issue either way. Things to be on the watch for are any changes to the partition or boot loader that would conflict with the new OS installation. Also, I'm recommending a disk repair, just to be safe. Finally, make sure your backups are up to date. Lion has been a great upgrade from everything I've seen (which isn't much) but there's always a risk with a system upgrade. Better safe than sorry, I always say!