No dont take the cat out of his home when you both go away together. Its MUCH less tramatic to have him stay at your home, where he is comfortable and have someone come at least once a day to put food out/change the waterdish/and clean the litterbox. I mean, it only takes a few minutes to do this.
It is much less tramatic for a cat to be alone in his own familiar surroundings, than to be around people and other cats that he doesnt know.
