The Lions became only the second team to win at The Laithwaite Community Stadium in a thriller.
Declan Appau put the hosts ahead with a stunner but two goals either side of half-time by Rowan Liburd gave Guiseley a shock lead.
Regan Charles-Cook equalised before Mike Fondop struck the winner, that moved Cox's side out of the relegation zone.
“That’s why you want to be involved in football. It was proper football, end-to-end, it was like a cup game," he said.
“I’ve enjoyed it because we got the result and the tenacity we showed, the desire to go and try win a game at a club that’s had a really good start to the season.
“We were brave but once again there’s a million and one things we can get better at. The build-up to the first goal was sloppy, the second goal was really sloppy.
"We’ve now got goals in the side. We've just got to cut out the minor mistakes but I can't fault their energy and desire. I’m over the moon for the boys.”
For more coverage, reaction and some of the best moments from games going throughout the season, head to our social media channels on Twitter, Facebook and now Instagram.