I'm using VeraCrypt and think that it would make a great portable app.
Here is a web page that discusses using it without installing, but
it does leave tracks in the registry.
https://veracrypt.codeplex.com/wikipage?title=Portable%20Mode
regards,
Jeff Franks