Jim Brown scored his most total touchdowns in a game against the Baltimore Colts on November 1, 1959, with 5 touchdowns.