Maybe he wants to keep the emails for reference purposes, cuz he feels the need to have the instructions and advice you gave in them, rather than as some kind of proof of your sins.