I've had a problem - when i upgraded ff portable it crashed without launching. I found out that the problem was caused by the language pack, installed by me in previous version of ff, it is in language section of about:addons.
So the suggestion is - add to your portable unpacker/installer automatic turning off language pack(s), if there're any installed by user.