I would be inclined to accept it in the case of Samurai Jack, but in general I'd prefer the dimension-traveler backstory to be limited to cases where it's not feasible to integrate them into the setting more thoroughly.