Gaston was born on August 20, 1881, in Halsey, Oregon. He was the son of Maria Glasgow (née Irvine) Gaston and William Hawks Gaston, a merchant and farmer.[1] His maternal grandfather was the Presbyterian minister, the Rev. Samuel Glasgow Irvine, D.D.[2]
Gaston began at working in newspapers in Tacoma, Seattle and Chicago as a reporter, printer and assistant city editor on the Tacoma Tribune. From 1898 to 1910, he worked for the West Coast Trade in Tacoma, the Seattle Times, the Tacoma Ledger and the Chicago Record-Herald. From 1910 to 1916, he was assistant editor of the Spokane Chronicle before becoming editor of the Nonpartisan Leader in Fargo, North Dakota. The next year he edited the Fargo Courier-News before resuming work with the Nonpartisan League from 1918 to 1920. In 1920, he helped establish the Minneapolis Star.[1] After a rift with the other members of the Minneapolis Star over Gaston's expose on gambling interests in the Twin Cities, he moved to New York City where he worked for the New York World, serving as night editor until the paper closed in 1931.[1]
After the closure of the New York World, Gaston went to work for Henry Morgenthau Jr. as secretary of the New York State Conservation Department, becoming a deputy commissioner within a year. After leaving the State government, Gaston became secretary of the Federal Farm Board and deputy governor of the Farm Credit before being appointed special assistant to Morgenthau in November 1933, handling public relations.[1]