The Gulls gave their survival hopes a big shot in the arm with the 1-0 victory at Brisbane Road.
Elliott Romain’s first-half goal was enough to give them the three points and extend Orient’s winless run to five games in all competitions.
“It’s not acceptable,” Edinburgh told the club’s website. “It’s disappointing, frustrating and I totally understand the crowd’s reaction at the end of the game.
“It was a game we expected and the fans expected us to win. We’ve got no-one to blame but ourselves.
“It’s becoming a recurring theme now that in games that there isn’t much in, we tend to lose 1-0. There are questions being asked of us and we’re not giving the answers.
“I don’t think for one minute we deserved to win the match. We certainly should be doing better than what we are. We’ve got to start delivering.”
For more news, reaction and action from across the National League, like us on Facebook and follow us on Twitter and Instagram.