His Mistress(1984)

This is how it usually happens. Some older man is unhappy in his marriage and meets a jolly young sweetheart in which he rediscovers his own youth. He dumps his old family and starts living with his new girlfriend. At that point problems araise.