Script for Searching for Duplicate Emails?

I am curious to see if anyone has written a script to deal with duplicate emails that have resulted from combining several old archives. I have one archive now with 40k+ emails. I am guessing that approx. 15% are duplicates.

Any suggestions?

Thanks in advance.