Since the wager was who could get to Sleepy Eye the fastest, Charles would still win, since he arrived first. He may not have gotten there by noon, but he still beat Almanzo. Why Charles had to buy Almanzo supper, then, is a mystery.
Charles: (carrying Kavendish on his shoulders across the creek) You're heavier than you look, old man!
Kavendish: And you're dumber than you look!
Charles: You sound like my wife.
Kavendish: I didn't think a man like you would be married to someone with common sense.
Almanzo: You know, I thought you'd be more understanding. They were starving!
Charles: I was more understanding, until you ordered another steak, and then another slice of peach pie!
The old mill/house where Almanzo finds the poor family eating "his" goods is the same place where Charles and Jonathan were held hostage in Season 5's Mortal Mission.
Eddie Quillan has a recurring role in this episode, adding humor as the grumpy elderly man Kavendish. Previously he played Judge Parker, presiding over the Garveys' divorce proceedings in The High Cost of Being Right.