I'm running 64-bit Windows 7, and for whatever reason, the main PortableApps window will not leave my taskbar. The window itself goes away, but the taskbar button remains. The only way I can get this button off is to close out of the Platform app entirely.
I'm also noticing this problem with Skype, so I'm guessing it's Windows-related. Is there any way to fix it?