CCleaner
CCleaner is already pretty simple (im my opinion), so I don't think that making it portable would cause some major problems. Browsing on a USB stick with Firefox is already pretty portable, but any leftover temp file/registry entries won't get deleted, so porting CCleaner could help clear those out.