Now it's not to say that Takeo did not trust Xyxer to be left on his own. But Takeo did not trust Xyxer to be left on his own. When it came down to the decision on whether he would rather leave Pig or Xyxer on their own for extended periods of time, he decided that Pig was far more trustworthy.
His short stay in Hoshigakure had been pleasant, he had managed to broker a deal with the owner of 'The Turning Point' to let Pig and himself stay in the stables for some time. Of course since Takeo wasn't interested in paying rent or anything like that he had agreed to help out with whatever the guy needed. He could have just threatened the person, but he did make a vague promise that he wouldn't do that.
So with Pig having a safe residence he decided to go back and check on his troublemaker of a sibling. Which was why Takeo now found himself stood at the gates of the village, though walking in the opposite direction than a few days ago. "One day I'll actually stick around somewhere for more than a week." He mumbled to himself, walking out of the place unless stopped, which was unlikely.