Clean kernel files? Where did you read this specifically? Cause I've never heard of this.
A kernel panic doesn't mean anything is particularly broken or corrupt, its when it happens constantly that you should worry. I doubt there is much to be concerned about on this matter.
Why not upgrade to 10.4.10 as well, that might help things.