Is my cat anxious?

Just wondering if you could help.
I have noticed that when we go out my cat does doesn't use the litter box , but within half hour he goes to the toilet when we come back.
Is that anxiety ? We don't go out for long periods of time maybe the longest is 5 hours but most is two. I don't go out a lot besides on weekend really. It's just something I noticed. My husband started a new job as before he was out of work and studying. It's week three with the new job. But the not using the litter box has been just the last week. I don't know if it's just that's when he needs to go, but it's just something I don't remember him doing. In regards to me going out anymore that hasn't really changed. He is using the litter box, we did have a Tom cat few weeks back that stressed him out but haven't seen the cat around for awhile so I don't think it's that. Should I play and cuddle him more before we go out to help? Any suggestions would be great.

For how long are you gone?  Most kitties nap while their humans are gone to work or running errands.  If you're only gone for a couple of hours, then there's nothing to worry about.  If you're gone 8-10 hours, then that's a different story.

We never go for long, am home most of the time. Am hoping it's nothing to worry about.

This behavior sounds normal to me.  My kitties don't use the box but maybe 4 times a day, if that.

I wouldn't worry unless kitty has gone a day or more without any litterbox activity. Many times I've come home from a 12hr day, and my cat hasn't used it since the night before. It depends on how much is in their system. If it is a bit of separation anxiety, he might fall in to the new routine in time, and not rely on you to be there.