Personally, I feel like everything is moderation is good. Too much soy will indeed raise Estrogen in both males and females so it's good to limit the intake. I DEFINITELY think dairy affects the skin (my dad is a dermatologist and believes in this whole heartedly). We cut dairy out of our diet long ago. We drink soy millk and my LO drinks soy formula. When it comes time, we will switch her to soy milk but again- in moderation.
HTH~!