Ilya Kovalchuk's second goal of the game with 3:20 left in the third period tied the game at 5-5. Garnet Exelby was then called for a holding penalty, allowing the Devils to play with a man-advantage.
Elias then scored the game-winner to help goalie Martin Brodeur earn his first victory of the season.
The Thrashers' five goals topped their total in being outscored 17-4 in their first four losses, but their reward was another loss. Atlanta is the only NHL team without a win.
SENATORS 3, RANGERS 1
In New York, Dany Heatley and the surging Ottawa Senators took care of the New York Rangers in record-setting time.
Heatley scored the first of Ottawa's three goals in a team-record 52 seconds of the middle period, and Martin Gerber made 36 saves.
SABRES 7, CAPITALS 3
In Buffalo, N.Y., Brian Campbell had a goal and three assists and Jaroslav Spacek scored two power-play goals to help Buffalo beat Washington.
Ryan Miller, coming off a 6-0 win over Atlanta, had 23 saves for Buffalo.
Maxim Afinogenov and Derek Roy each added a goal and an assist, and Jason Pominville and Adam Mair also scored for the Sabres, who have won two in a row after dropping their first two games of the season.
HURRICANES 3, CANADIENS 1
In Montreal, Cory Stillman and Matt Cullen scored power-play goals and Carolina spoiled the Canadiens' home opener.
Cam Ward made 23 saves for Carolina, which has won three consecutive road games in Canada since losing the opener of its current six-game trip.
PANTHERS 6, LIGHTNING 4
In Sunrise, Fla., Olli Jokinen had a goal and two assists to tie Scott Mellanby for Florida's career scoring lead in the Panthers' victory over Tampa Bay.
Jokinen, in his seventh season with the Panthers, has 156 goals and 198 assists for 354 points with the team.
FLYERS 3, ISLANDERS 1
In Philadelphia, Jeff Carter and Sami Kapanen each scored goals, and Martin Biron made 29 saves to lead Philadelphia over New York.
Jason Smith scored an empty-net goal for the Flyers with seconds left in the game.
PENGUINS 6, MAPLE LEAFS 4
In Toronto, Sidney Crosby scored his first two goals of the season, including the winner with 5:22 left in the third period, to lead Pittsburgh to a wild victory over Toronto.
FLAMES 7, PREDATORS 4
In Nashville, Tenn., Flames captain Jarome Iginla scored two goals and added an assist to lead Calgary to a victory over Nashville. Kristian Huselius also scored twice for Calgary.