Sidney Crosby scored, and Tristan Jarry made 23 saves for the Penguins (40-18-10), who have lost three of four (1-2-1), including 5-1 to the Rangers at Madison Square Garden on Friday.
"It was a way different game tonight than on Friday," Pittsburgh coach Mike Sullivan said. "It was a way different game. It was a low-event game. I don't think there were significant scoring chances on either side. I think that's a testament to both teams' commitment to defend hard.
"It just felt like you're fighting for every inch of ice out there in all three zones. We were trying to force them to do the same. They got a couple of looks. They finished."
Brian Boyle gave Pittsburgh a 1-0 lead at 14:24 of the first period, deflecting a shot from Brian Dumoulin. He has scored in consecutive games after getting one goal in his previous 16.
"I think when we executed, we had momentum," Boyle said. "When we didn't, they had momentum. They got chances. We're not thrilled with the whole of our game."
Vatrano tied it 1-1 at 13:32 of the second period on a wrist shot from the right hash marks off a backhand pass from Mika Zibanejad. He has scored four goals in his past three games and five in seven since being acquired in a trade with the Florida Panthers on March 16.
Braden Schneider gave the Rangers a 2-1 lead at 17:04, scoring on a one-timer from the high slot off a pass from Artemi Panarin.
"We have such a great group of guys," Schneider said. "To be able to be playing with everyone on our team and to be part of this is pretty special. I just hope we can keep rolling like we are. It's been a lot of fun."
Kreider pushed it to 3-1 with a power-play goal at 1:06 of the third period. After a shot from Adam Fox bounced off the end boards, Kreider got the rebound and chipped a shot past an outstretched Jarry.