Jeff Petry and Rickard Rakell each had a goal and an assist, Jason Zucker had three assists, and Jarry made 37 saves for Pittsburgh (6-6-3), which finished its road trip 2-0-1.
"Anytime you get five out of six points out of three games on the road, I think most coaches would probably take that," Penguins coach Mike Sullivan said. "But when it's there for you to get six, it's a little bit disappointing. We knew it was going to be a tough game for us coming into it. Just logistically, it's one of those games where you know it's going to be a tough one, and give Montreal credit, they played really well."
Cole Caufield scored 49 seconds into the third period to tie it 2-2 when his wrist shot from the left point went in off Penguins defenseman Marcus Pettersson's glove.
Evgeni Malkin put Pittsburgh ahead 3-2 at 3:19 before Suzuki tied it 3-3 at 4:09.
Brock McGinn scored at 3-on-3 to give the Penguins a 4-3 lead at 14:02, but Sean Monahan again tied it 4-4 with a power-play goal at 14:42.
"No one got down on themselves, it was just to stick with the plan and keep fighting," Hoffman said. "And you know, we bounced back a few times tonight and that just shows the character that this group is starting to have, and it's a good thing to be a part of."