Google Chrome not closing all the way, makes ejecting USB drive a pain

I am running Chrome 23.0.1271.95, when I click the red X button to close Chrome, the window closes, then I go to eject the USB via the Portable Apps launcher, but it says the drive is currently in use, and to try again later. I wait, try again, same message, repeat, repeat, etc. Unless I go to process manager and end the Chrome process (of which there are several, I am figuring out this is due to the plugins I have in Chrome) then I can eject my drive.
Does anyone know what is going on or how I can fix this?