Learn En Passant rule to avoid arguments

I'm sure we've all been there:

Your playing against a less expericenced player, you play the En passant move, your opponent exclaims "You can't do that!!", because En Passant is such an unusual move an argument soon erupts.

Quite a rare move, beginners should at least be aware that it exists, but perhaps leave this move till last in their learning curve.

What does everyone else think?

Yes it's an odd move. You capture a pawn without actually landing on it. Bound to lead to a dispute.