I think they do it on purpose

Our couch had a light green slipcover on it. Puppy was never to into the couch. He'd stay on it for a little while if we put him on it next to us and pet him, but he'd jump off when the petting stopped. There's nothing wrong with the couch, no previous animals, no spills on it. We assumed he just didn't like the feel or placement of the couch.

Fast forward to today. I brought home a DARK BLUE slipcover. I put it on the couch. Now our WHITE and ORANGE cat decided this is his new favorite sleeping spot. Comes right after the DARK BLUE bedpread and my BLACK office chair. (He ignores the LIGHT ORANGE office chair though)

I think if I covered all the objects in the apartment with white fabric, he'd go crazy because there's be no place to sleep.

I have observed this phenomenon among our cats as well. Sadly, I cannot even use the "all white" idea to escape, because out of white, gray, black, orange, and tan, there's always a clashing color.