Uh Oh, no one replied since yesterday? Now that's a very bad sign!
Yeah, lint rollers are pretty worthless on fleece. I've got one of those spongelike kitty hair lifters that is worthless on fleece also. The only thing that works for me is just washing it in the washer, period.
The color of the fleece matters greatly also, I find. I just put a brand new burgundy fleece couch cover on the sofa on Saturday. Four cats were sleeping on it Saturday night and the cover was loaded with hair by Sunday morning [sigh]. Before that I had a seafoam green couch cover of the same material and I swear I could go weeks without any noticeable cat hair on it [to the naked eye, anyway].