Dougie Hamilton had a goal and an assist, and Nico Hischier scored short-handed for the Devils (23-11-2), who had lost two straight and eight of nine. Vitek Vanecek made 25 saves.
"Really gritty effort," New Jersey coach Lindy Ruff said. "It was a hard-fought game, really pretty even 5-on-5. … I think we didn't panic."
Evgeni Malkin and Jeff Carter scored, and Tristan Jarry made 24 saves for the Penguins (19-11-6), who are 0-2-2 during the skid and 1-3-2 in their past six games. It lost 5-1 at the New York Islanders on Tuesday before letting a four-goal lead slip in a 5-4 overtime loss to the Detroit Red Wings on Wednesday.
Pittsburgh, which was 0-for-9 on the power play, next plays the Boston Bruins in the 2023 Discover NHL Winter Classic at Fenway Park in Boston on Monday.
"I just think we weren't as sharp. We tried to work through it," Penguins coach Mike Sullivan said of the man-advantage. "There was no flow in the game. It was just all special teams, for the most part. That's where the game was won and lost."