O'Leary was born in New Brighton, Staten Island. He attended St. Peter's Academy, Augustinian Academy, and Westerleigh Collegiate Institute, and also studied law. He became active in the real estate and insurance businesses, and in 1917 he joined the North Shore Ice Company, of which he was general manager and vice president from 1920 to 1934.