What's your end?

He said it himself "during the war I'd go away and try to forget you, but I couldn't and I always had to come back".
He leave because his heart is broken and he can't give her another chance at the moment.
But time will pass and his pain will slowly become more bearable. And his need for Scarlett will be back.

Back to TARA to break more hearts of men. She probably would always be in love with another man. Knowing Scarlett.