Dear Contradiction

We’ve heard them both:

“Forgive and forget” and, “Forgive but don’t forget”.

Which do we live by? Do both exist for the purpose of choosing whichever is most convenient?