Big Brown became the first horse seeking the Triple Crown to finish last at Belmont.
"I feel like a loser right now and I don't know why," Dutrow told the Daily Racing Form on Monday. "Usually when I get beat I can handle it the right way, and I've handled this the right way, but I just feel like something's not right."
Dutrow said he's been unable to find anything physically wrong with Big Brown. He said the quarter crack on the colt's left front hoof was fine and that he showed no signs of being sore.
Jockey Kent Desormeaux eased up Big Brown with a quarter-mile remaining in the race, won by 38-1 long shot Da' Tara.
"I don't know why he had to do that," said Dutrow, who questioned Desormeaux's decisions.
Entering the first turn, Desormeaux took a hard hold of Big Brown and yanked him to the outside, bumping with Anak Nakal before finding running room outside of Tale of Ekati while Da' Tara opened up a three-length lead.
"I'm sure he didn't have any idea what the hell was going on going into the first turn the way (Desormeaux) was switching him all over the damn track," Dutrow said. "I don't know what he was doing."
Desormeaux said Monday that his plan was to go to the lead, but that Big Brown slipped coming out of the gate and that he was pinched back a length. He said that he pulled Big Brown up because he wasn't going to finish anywhere but last.
The loss was Big Brown's first in six career starts. He's expected to race in the Travers Stakes on Aug. 23 and the Breeders' Cup Classic in October.