You are right DharmaDefender. Segyu is not very large at all, at least not the branch of Segyu that I visited in Nepal. The monastery is small, they have very little facilities, they have fewer sponsors than most of the monasteries there, they have very basic food, and they dont even have enough monks.
I had a chance to chat with their main administrator there, and he told me that they have very few new monks each year. The reason for this is because most of the non Shugden monasteries take the most new monks, and spread rumors against Segyu.
But regardless of the above, I felt authentic dharma practice when I was in Segyu. All the monks, young or old, had bright smiling faces and went about their daily duties and studies with great pleasure. Although they have very little (even the main prayer hall is small), they make the most of what they have and more than other places in Nepal, I felt I was among true practitioners.
Random fact BTW:
http://www.sed-gyued.org/ is not the same monastery, but from another lineage. Take a look at the top of the page, just below the monastery name. They had to make it very clear that they are supported by the Dalai Lama, just in case people mix them up!