Took him to the vet. It was feline acne. They gave me medicated wipes for him. Started using them on his chin. Will have to try and limit his exposure to plastic. He loves it and tries to eat it every chance he gets. Thanks for the responses.
He started with some small scabs in January. It progressed to get worse. It seems to be getting better as of late though. Seeing as I'm a truck driver I only get home every few months so I couldn't get him looked at. I'm going to be home for a few days and wonder if people think I should take...