Oliver Bjorkstrand tied it 1-1 on a power-play goal off a quick shot from the high slot at 11:55 of the first.
Laine gave the Blue Jackets a 2-1 lead on a one-timer from the left circle at 14:54 of the first period.
Mercer tied it 2-2 on a wraparound at the left post at 8:37 of the second, and Hamilton gave the Devils a 3-2 lead at 9:54 with a slap shot from the right circle.
"You want to be a top team in this league, you have to find ways to win back-to-back when you're up 3-2 in the third," Subban said. "We're still learning those things."
New Jersey, which won 4-2 at the Pittsburgh Penguins on Saturday, outshot Columbus 14-3 in the third period but did not score.
"The guys should feel good," Larsen said. "They found a way to get through this, get a win, and 'Korpi' had a big effort for us tonight."
NOTES: Hamilton led all skaters in shots on goal (10) and ice time (26:35). He blocked four shots and was plus-2. … Bjorkstrand has scored 14 points (nine goals, five assists) in 16 games against the Devils. He has scored 10 points (four goals, six assists) in seven games this season; Rick Nash is the only player in Blue Jackets history who scored 10 points in fewer games to start a season (six games in 2009-10). ... The Devils played their 3,000th regular-season game since relocating from Colorado for the start of the 1982-83 season (1,398-1,213-170 with 219 ties).