Portable FF on PC

Situation:
I installed Portable Firefox 11 on my computer (Win 7) at work. I used the portable version because I don't have admin rights to install the regular version. The installation location is in a folder on my desktop. An industrial supply site that I visit quite often now won't display their catalog pages due to a Java update requirement. I attempted to update Java, but it is saying that my FF 11 is no longer supported.

Question:
Being that the portable FF that I'm using isn't on a flash drive, what is the best way to update to a later version while retaining my plug-ins, bookmarks, passwords etc.?