I understand your love for him but you should not forget that life runs on realities and not on blind emotions. And the realities of your life are: he is married, he is happy with his own family; you are an outsider and will always remain so (you may not like this word but its bitter truth). You have to prepare your mind to accept that this relation does not have any future and for your better future you have to put an end to it.