The Vanarama National League club have invested on the pitch this summer but have won only one of their first four matches.
But speaking to the National League following the dramatic draw at Chesterfield, the former Everton defender says everyone needs to stay patient.
The Latics face a trip to Boreham Wood on Saturday before a Bank Holiday home game with in-form Solihull Moors.
The manager says it is going to take time to get things as they want it but knows supporters crave good results after a demanding couple of years.
“We’re at the start of our journey,” he said. “I understand the fans’ frustration, I do get it.
“But there has also got to be a bit of realism of where we are at. We are at the start. Chesterfield are probably a year, maybe 18 months ahead of us.
“I think we’ve shown that we can compete with the best side in this division, so that’s a big positive.
“We had to steady the ship last year and we’ve bought a level of players into the club this year where we think we can improve.
“We’ve got two or three of those missing at the moment. When we get our best team out on the pitch then we’ll do OK.”
He says his side are big title outsides but knows they can challenge for promotion.
“It’s still so early on in the season,” he added.
“I still think Chesterfield are the team to beat, but they were just as good last year - there were two really great sides better than them.
“They’ve been a really good team for a number of years now and we’re a work in progress. I felt we deserve our point at the weekend, we had the better chances.
“Now we want to see what we can do in these two games over the Bank Holiday.”