https://www.facebook.com/photo.php?pid=7654074&l=46e09d3ed5&id=615205698
Image pretty much speaks for itself. Both sets of window buttons (e.g. minimize, close) work. Only the top one can be double-clicked on for maximize/restore, though.
Right-clicking and adding, then removing the menu bar removed one, but the tabs are now below the address bar, not up on the title bar, and I have a second taskbar entry for "Mozilla Firefox" (where the first one is the title of the page).
//edit: Issue between Firefox and XP, not something PA can fix with the portable launcher. Restarting it can fix it. Getting a newer OS works, too, if that's an option. I recommend Windows 7 Home Premium or some flavor of Linux.