Firefox Portable and Windows 10

I upgraded to Windows 10 over the weekend. First Firefox Portable won't start saying that my profile is missing. I managed to fix that by move the profile to another directory, then started Firefox Portable, then copied the profile I moved into the new profile. I currently have Firexfox Portable 45.0.1, but I could not upgrade Firefox Portable to 46.0.1. I tried to upgrade it inside Firefox Portable (About Firefox), but it said I can't upgrade. I downloaded Firefox Portable 46.0.1 and trying to install it over, but it keeps saying that FirefoxPortable.exe cannot be opened or accessed. I tried to rename Firefox Portable folder, but it won't let me, even though the folder is not read only. I tried to delete the whole folder so I can reinstall it, but Windows 10 won't let me delete it either and I already lowered the permission to the bottom. Any help would be greatly appreciate it.