Walker was a running back for the Browns for three years from 1982 to 1984. He was forced to retire due to injuries sustained in a car accident. His best season with the Browns was in 1983. In 1987, Walker resumed his career with the Saints and played wide receiver before retiring again following the season.