Bobby had a thing for pet food when he was a toddler. I remember catching him eating cat food and asked to see the bag. I needed to make sure it didn't have beef in it because he was moderately to severely allergic to beef, or any form of dairy because he was severely- very severely to all dairy(carrying an EpiPen Jr with you everywhere is no fun, having to try and explain that your diaper bag can't be within any small person's reach and why but even without the EpiPen I carried Benedryl so either way it had to be out of reach, thankfully never had to use one and hope I never do but he doesn't need an EpiPen now and he outgrew beef but dairy, although his allergy is not as severe as it was, still hangs on), other than that I tried to keep him away from the food but since I knew it didn't have beef or dairy in it I wasn't too worried about him eating it if he got a few pieces before I could get him away from the food. He never got sick from it.
It's mainly for human protection when it comes to e-coli or salmonella, Abby

, my Old English Sheepdog, got a pig's ear every night and all over the packaging it had warning to wash your hands well after handling them or you might get salmonella and that isn't good. Abby was old, blind, and had severe arthritis and was on heavy meds for said arthritis(no other choice, her arthritis was bad, not yet PTS bad but heavily medicated bad) and she never got sick from them, but a human could. Abby died(at 11 1/2 so she was OLD by sheepdog standards) from a burst liver or spleen which could have been caused by the arthritis meds(she had checked out fine at her senior appointment less than 6 months prior and they had taken her off Rimadyl to something less hepatoxic for her liver's sake even though it was perfectly fine.) It also simply could have been she was old. Anyways my old decrepit dog ate stuff that could have been(and prolly was) infected with salmonella and she was fine. Animals don't get sick from this stuff like we do.
However there are exceptions, mine can never be fed raw due to feline leukemia(even raw advocates agree that FeLV+ or FIV+ never be fed raw) due to their compromised immune systems, so they could pick up something that could kill them. I will say my outside ones that also have FeLV do occasionally catch something and eat it and they've never been sick, but they are outside and it's impossible to keep them from occasionally catching something and eating it.
If your cat(s) are healthy then feed them raw if you want to, I'm assuming you know how to do it right to make sure they are getting all the necessary nutrients. Just go to a high quality butcher to get meat from and obviously wash your hands after preparing it and keep your kids out of the cats bowls(which I'm assuming isn't an issue.) In other words, just follow general food safety guidelines for humans and you'll be fine.
Find a new vet, one that has no issues with raw feeding.
BTW- no vet sells high quality kibble out of their office, they sell Science Diet which I wouldn't feed to any cats, it's too expensive for all the crap it contains, it's like Iams. I'm talking about regular Science Diet not Hill's prescription, those are medicine and are made the way they are for a reason. Mine knows I am happy with what I feed and I'm not going to change but they don't really recommend food anyways unless it's prescription.
Taryn