I'm not really bothered by cheese much, but I don't eat a lot at once either. Aged cheeses tend to settle on my stomach better too.
Ice cream, normal milk, foods that have a lot of milk added, and now frozen yogurt are the foods that tend to cause problems.
For about four months I was taking Naproxen daily, one side effect from that and the other meds I take let me eat dairy for a while.
I also have a gallbladder that causes the same problem with non dairy foods but not as often, so it kind of doesn't matter what I eat some days. The results are the same.
(and no, getting the gallbladder out wouldn't fix that - if anything it's a problem some people have after their's is out)