A tiny piece won't hurt but keep in mind that cats don't have the digestive enzyme to break down the milk proteins in cheese. Maybe a cheese flavored cat treat would be better. My previous cat loved these before he became diabetic:
If you Google for cat cheese treats you'll find other brands.
Other healthy homemade treats you can give to your kitten are plain cooked chicken (poached in plain water is great), canned fish in water, raw meats and organs (understandable if you don't want t feed any raw). I found this TCS article on homemade treats: http://www.thecatsite.com/a/which-foods-are-safe-cat-treats