He was offered the part of Doctor James Kildare in Dr. Kildare, but thanks to his (now prescient) request that the show not have cigarette ads, the part went to Richard Chamberlain at the end.
The film which made him a star, All Quiet on the Western Front, appears on the AFI's (American Film Institute) list of the 100 best American films of a time, ranked at #54.
Ayres was married three times. He was married to actress Lola Lane from 1931 until 1933 and to actress Ginger Rogers from 1934 until 1940. His third marriage, to Diana Hall, lasted from 1964 until his death.