Dylan Guenther gave Utah a 5-3 lead with a power-play goal at 13:59 of the second period. He has five goals in a season-opening three-game goal streak.
Braden Schneider cut it to 5-4 at 17:59, skating down the left wing and beating Ingram short side under his blocker.
Will Cuylle then tied it 5-5 at 12:56 of the third period with a deflection in front.
"There were mistakes there. They are a fast, skilled team and they capitalized on that," Fox said. "I thought especially that third period we played really well. Offensively we were creating a lot, but you give them a little bit of room and some chances and some breakdowns like with that first goal … they capitalize."
Hayton gave Utah a 1-0 lead at 3:43 of the first period, converting from in close near the left circle off a cross-ice pass from Nick Schmaltz. Hayton has three goals in three games this season after he scored three goals in 33 games last season.
"I think last year was tough for me, missing a lot of time," Hayton said. "At the same time, you're watching a lot of games and learning a lot of stuff, so you've just got a different perspective. So, I think I took some of that into the offseason and also to start this season, and some of it has paid off."
Panarin tied it 1-1 at 8:38 with a wrist shot in the slot off a drop pass from Alexis Lafreniere.
Jack McBain put Utah back in front 2-1 at 1:48 of the second period, stuffing in a rebound at the side of the net.
Panarin responded again to tie it 2-2 at 3:51. He scored a power-play goal on a wrist shot from the left circle.
The Rangers appeared to take a 3-2 lead at 4:54 when Victor Mancini scored on a shot through traffic. However, the call on the ice was no goal because of goalie interference on Rangers forward Matt Rempe, which was upheld after New York used a coach's challenge.
Keller did give Utah a 3-2 lead at 6:02 of the second. With the teams skating at 4-on-4, Rangers defenseman K'Andre Miller turned the puck over behind the net to Alex Kerfoot, who fed Keller in front.
"Sometimes when you put the puck on the net, good things happen," Keller said. "And we have a lot of skill, a lot of guys that can shoot it. And we're just going to keep doing what makes us successful."