The league leaders let a lead slip and missed the chance to fire themselves four points clear after their 2-1 defeat.
Orient lost Marvin Ekpiteta to a red card early in the second half and couldn’t recover from the blow of being a man short and conceding a penalty.
But boss Edinburgh wants his side and the supporters to stay measured.
“I’ve told the players that we have to now remain calm. Everything is in our hands,” he said.
“Just a lack on concentration has put us in this position. We can’t afford that. The situation is intensifying and the occasions are becoming greater.
“We just need to remember to stay in the moment.
“I don’t think there was anything particularly wrong with the performance.
“I can’t stand here and criticise the players,” the manager said on the club’s YouTube channel.
“Josh Coulson popped up with another goal right before the break and in the first half we were really comfortable.
“But four minutes into the second half, to concede a penalty and lose a man, you’re then going to be up against it.
“We’ve run hard and given everything. We worked the opposition with ten men right until the very end.”