Is it worth it? should i fight for him?

Better you quit from him. He makes you go crazy. And he will. Always there is one more wave and bus to ride on. Nothing is going to change in your life once you forget rather dump him. Best wishes.