People should not be influenced by the label "Rinpoche", "Lama", "high reincarnation" & etc. Regardless of religious beliefs, we must observe the person's actions according to dharma before deciding to follow and learn from him or her. We must not give in to peer pressure and follow what everyone does. Due to our ignorance and lack of knowledge of dharma, we would just follow what everyone does even if it doesn't look right, for e.g. keeping a harem of woman, intoxication, drugs etc. Perhaps a proper guideline would be to follow a teacher who keeps his or her vow purely and does not follow one who uses the samsaric desire including sex, drugs, alcohol, fame, power and etc. which is difficult for us to tell.