I keep it all. I also went through the pain in the ass of consolidating/importing all of my .psd Outlook email files, Thunderbird mail, and mail from email server I used to run. It's all in one fancypants Gmail account. Tagged emails keep the relevant mail on top.
I've had to reference so much old crap that going through that pain in the ass was worth it in the end.