Recently adopted stray keeps forgetting me

I am hoping someone has experienced this before.  I just adopted my 5th stray.  Started coming to my door, eventually got him inside.  Took him to the vet.  He is now vaccinated and neutered.  I kept him in the bathroom for a week, then my bedroom for a 2 weeks.  He was properly introduced to my other 4 cats and now roams the house.  The other cats ignore him and he is staying downstairs (his choice) in our finished basement.  He sometimes comes upstairs for short periods of time when its quiet.  He was allowing me close and I was able to pet him, he even rolls over and allows me to rub his belly.  The weird thing is that every time I approach him he hisses a little and lets out a cry...it almost sounds threatening but not quite.  I speak to him and tell him its okay and then i begin to pet him and he relaxes and begins to purr.  He is still very skittish and wont play or come when I show him food but he is eating.  The weird thing is he hisses and acts scared every single time.  We are going on week 4 of this.  I go downstairs, talk to him, get closer and closer and begin to pet him.  He enjoys it, purrs and rolls around.  I go upstairs and come back 10 minutes later and we start all over again, he hisses, sometimes runs away.  I talk to him and move slowly and hes okay again.  It may be that this is just going to take longer then usual but is anyone familar with this behavior?  I do this with him every day at least 4 times a day and its always the same.  I don't know anything about his history but it is possible he was abused at some point as he is always wary of where my hands are.  Any thoughts?

My thoughts are that you are right and he was hurt by a human. 4 weeks is not very long in cat time, my cats didn't stop hissing at each other for almost two years. Now they clean each other's face! You are doing everything right, I think it's just going to take time, and a lot of it. Try to have him associate you with good things like yummy treats, offer him some chicken or turkey Gerber baby food, he'll warm up fast! Good luck!

Thank you!! Im glad Im on the right track.  My other guys were strays for very short periods of time so I wasn't sure how long it should take.  I'll try the Gerber food, thats a great idea!!  

My now nine week old kitten does this also, but we have only been socializing her for a week and a half. Once she comes to me she could spend hours cuddling, but getting her to come is a pain. I swear it is actually getting worse at times. Good luck. I don't think a month is very long for the cat. He also needs to let you know he is in charge.

That said, letting him be in charge probably isn't the answer. I have found that when I am most scared of my cat is when I need to show authority. It is hard, but we are still making progress.

sounds like you're doing everything right... just love him.

My Rascal probably was abused by humans before he showed up in my yard... when I used  throw a stone-sized avocado pit, everyone else would chase it, Rascal used to think it's a stone thrown to hurt him and hide. It got better with time (he still doesn't chase toys, but he'll watch others do it).

He's not above scratching and biting me when he feels threatened, or disrespected (I do have to put ointment into his eyes these days). I ignore his tendency to draw my blood and love him. He'll purr for me.

"Thank you! Im glad this isn't unusal. We're making very slow progress but progress none the less"

Hi Rissy

Yes hang in there and be patient.  It's taken 4+ months to get our latest (clearly abuse) rescue Little Ginger (renamed Ellie) to the point that she will come to me for pets and she still hisses at any sudden move.   I don't think the problem is "forgetting" you, it's remembering past abuse. A sudden noise, a hand moving in peripheral vision, an unfamiliar smell - all are perceived as threats.  Sounds like you are on a good track though.

Thank you for the reassurance.  That is exactly whats happening.  Pet, pet, hiss, run away, come back etc.  I try to move very slowly and quietly.  I'll keep at it! Thank you again

Yep, that's Ellie all over, although now she doesn't run away,  just retreats and sometimes gives me a little slap to show she's had enough pets for now thank you, please leave me be! 

I forgot to mention the power of singing - any silly little ditty will do, it quickly becomes familiar and seems to soothe.  Try out a few.  Ellie's is "the tattooed lady" (with new words --- "she's just a little girl, my little Ellie girl, but such a pretty girl, my little Ellie girl".).  In past posts others have mentioned similar success with"my cat's song". 

Keep us posted on progress and those memorable milestones.  I had one the other day - I was doing laundry and Ellie came up to me and rolled over and showed me her belly!  Ok, she didn't let me rub said belly, but almost! 

I have to second @lrosewiles on the singing. My daughter is a theatre kid, so she sings a lot. The kitten had her first visit to the vet Saturday and was frightened. My daughter sang Somewhere over the Rainbow and she calmed down. It also calmed down every animal in the place.