FF keeping Win 7 C: Drive Users folder stashes

Like the title says, and when I restore Win 7 from an image, FF won't start the first time. I think it balks at there being old stuff in its C: drive stashes.
FF is on my computer's E: drive.
I'm afraid to use it on somebody's computer, especially if they have FF too.