It was former Shayman Jordan Burrow who put Gateshead ahead after 37 minutes.
Scott Barrow sent in a free-kick picking out Jamal Fyfield at the far post and his header back across goal was bundled home by Burrow.
But Mike Fondop-Talom’s third goal in three games, rising highest in the box to knock in Michael Collins' cross, brought the home side level 3 minutes after half-time.
The game looked as though it was going to drift towards a 1-1 draw until Gateshead struck seconds into stoppage time when a free-kick saw Kieran Green pull the ball back for Burrow to net after another goalmouth scramble.
Home fans started drifting towards the exits but 8 minutes into time added on, the Shaymen grabbed an equaliser with a stunning free-kick from Matty Kosylo which gave James Montgomery in the Gateshead goal no chance.
It would take a miraculous sequence of results to see either of these teams get sucked into the drop zone, but both will be happier when they have another couple of points in the bag.