If the download is cancelled while the installer is still displaying "Connecting...", the folder "$PLUGINSDIR/Downloaded" isn't removed. I can only reproduce this with FTP, HTTP cleans up fine. And so does FTP but *only* if it's cancelled once the download has started.
Is that a bug?
I tested with PicPickPortable (HTTP) & GZDoomPortable (FTP).