Foligno, who was playing his 800th NHL game, scored on a rebound at the top of the crease off Seth Jones' initial shot from the right point.
"I had a way better chance earlier in the shift," Foligno said. "[Subban] made a heck of a save. I was really happy to get a second opportunity. [Jones] made a heck of a play to put it on net and I was able to bang it home."
Vegas outshot Columbus 14-7 the remainder of the third period.
"We didn't play well the first two periods, but we started to play well when we got behind 1-0," Gallant said. "We had some good chances and Bobrovsky made some big saves late."
Bobrovsky preserved the lead with a save on a deflected shot by Golden Knights defenseman Colin Miller with 47 seconds left.
"It got a little scary there the second half of the third period," Tortorella said. "That's where I thought [Bobrovsky] was outstanding. He made some big saves where the first two period he barely had to work."
Blue Jackets forward Artemi Panarin (lower body) participated in the morning skate but missed the game and is day to day. He was replaced by Anthony Duclair.
"Just getting that opportunity at the last minute, you never know what's going to happen. You never take anything for granted," Duclair said.
Subban stopped Duclair on a partial breakaway with a skate save at the right post at 9:19 of the first period.
"You want to make a big save early if you get the chance to," Subban said. "It sets the tone for the game. It gives you a bit of confidence. You aren't sure. You haven't played in a long time."