I think it is likely that night time is much worse for a cat to be outside. There are predators that are also out at night like coyotes. There is the potential for encounters with raccoons or other cats and cars that can't see your cat. The daytime dangers are pretty bad too. It's a huge risk to let cats roam free and the opportunity for all sorts of trouble to occur regardless.