Just to clarify:
The 'Yellow Book' was written in 1970 and published in a very limited way in 1976.
The Dalai Lama first started to speak out against Dorje Shugden in 1978. He did not mention the Yellow Book in any of his first talks against Dorje Shugden.
According to the text 'Selected Writings of Zemey Rinpoche:
In 1974 Zemey Rinpoche retired from public life and entered a period of semi-retreat in the Tibetan settlement of Bylakuppe, Mysore, South India. Four years later, in 1978, he re-entered public life and moved his permanent residence to Ganden monastery in Mundgod, Karnataka. From the late 70's onward, he taught extensively at Gaden Monastery and also wrote prolifically. Rinpoche also began to travel widely during this time, fulfilling requests for him to teach in the various Tibetan communities if India and Nepal. In 1984, while on tour in North India, Rinpoche suffered a stroke. Though no longer able to speak, Rinpoche supervised the compilation and editing of his entire six volumes of his collected works. Since his stroke until his death in 1996, Zemey Rinpoche led a retired life at his residence, Tashi Gephel House, at Gaden monastery, south India.