That is the view of Lee Bradbury, who admitted he was 'gutted' in the manner of the Hawks' late loss at York Road on Saturday.
But Bradbury is sad that his side aren't in the hat for Monday's draw but knows how much his players can take away from being so close to dragging Alan Devonshire's team back to Hampshire for a repay.
Now the manager wants his squad refocused and ready to go in the Vanarama National League South.
"It was hard to take for everyone," the Havant manager said. "We managed to get ourselves level and as soon as we did we took control of things. I really thought we were the better side and it was a killer moment.
"But it wasn't to be, we have let in a lot of goals late on in games and it's come back to bite us. We switched off and it doesn't matter who you play in the FA Cup - if you do that at an important time, you're getting knocked out.
"But only a few months ago we were a Ryman Premier team and we've pushed a club doing well in the National League until the closing stages. We have to take encouragement from that at least."
But he added: "At the same time we know there are parts of our game we've got to do better in. I can't fault their effort but we really should have at least got a replay.
"The FA Cup is important to us and we're out so it doesn't matter how well we played."