How to drop out installation proccess?

Is it possible to build portable .exe version that doesn't require actual installation proccess and does not require admin privileges? Like Putty portable version or so.
The point is to avoid admin privileges to make work an app instantly (not bad case scenario supposed). Please, correct me if I wrong.
Any advice will be appreciated, thanks!