I'm sorry for your loss, but you did the right thing. The decision to put a pet down is so hard, but you knew it was time.
I had to put my little buddy Bandit down about 3 weeks ago, so I know what you're going through. Rest assured that he's at the Rainbow Bridge, and all his new friends...