save all past "saved in folders" emails and their attachments & put future impt emails into folders while on thumb drive,

I am trying to save all my "saved" past emails, which are in folders, and all my future important emails, which I would place into folders. I want to save them on a portable device such as a thumb drive (30GB) or my Seagate brick. Is this possible? If so how can I do this? Please tell me the best way. I am no techie, so I need something simple and transparent.I have Windows 7. Thanks Joa