I'm kinda torn on this one...
It could be a feature, because then if the file structure of your project changes on disk, then you'll be able to refer back to project explorer to see what you had before the change, before you refresh.
On the other hand it's a little annoying, but not too bad when you get used to it...
So which is it? A bug or a feature?