Fritz Scheller was one of four German road cyclists participating in the first ever mass start of the Olympic road race at Berlin in 1936, and he was the highest-placed German rider in fourth place and just 2/10th secs off the bronze medal position. Scheller was German Road Champion in 1932, 1936 and 1937. He also won the bronze medal at the 1937 World Championships.
In 1938 Scheller turned pro and started his only Tour de France, but abandoned the race on stage nine. He won the Harz-Rundfahrt for the third time in 1939 after two previous wins as an amateur, in 1934 and 1936. He enjoyed many podium finishes in many different road races at that time and retired from racing at the beginning of the 1950s. He then opened a cycling shop in Nuremberg and supported, and organized, motor-paced and other cycling events.