After toying with it for quite some time, I've finally come up with a version of Portable Notepad2 I consider worthy of public release -- PortableNotepad2 0.4.
Portable Notepad2 lets you use the Notepad2 text editor on the go, without leaving mess behind on the current computer. Get it at the Notepad2 project page.
UPDATE: Now comes in two flavors: EXE and ZIP downloads. Waiting on SF.net hosting...
Enjoy!