It should not be a problem at this stage. Mama will watch you closely though and some mothers are more protective than others but most mama cats are very choosy about just who they let near their babies. But she is your "baby" right? I am sure she won't mind.
I once read that some mother cats come to view their human as another feline in the colony - you know how some female cats in colonies help to care for each other's kittens - and I have observed this myself when I was younger and we took in a stray who was pregnant. As the kittens aged to about 8 weeks, she would happily even drop them in my lap - as if to say, "I need a kittensitter for awhile and you have been nominated", lol
These babies are still young but it is also good for them to become accustomed to human voices and touch and to becoming socialized. There is a lot of good info in www.kittenrescue.org
(Or is the other way around, lol?