Of course you want to be careful. You're that kind of person.

But if you re-entered each other's lives, then that seems evidence enough to me that your differences are not irreconcilable. And if you're lucky, you'll have plenty of time here to work through them.

Just don't hide from him.