However, Hay's days as a bishop were not to last long. In the following year Bishop Hay, along with all other Scottish bishops, was deprived of his see. He refused to take an oath of fealty to King William and Queen Mary and was expelled from Spynie Palace, its last episcopal occupant. He died at his son-in-law's house: Castlehill House in Inverness, on 19 March 1707.
Family
He married Margaret Wemyss daughter of Robert Wemyss of Castlehill. They had two daughters: Sophia and Jean.