Moors beat Dover Athletic 3-2 on Saturday before a goalless draw with Wrexham on Tuesday - a game Yates felt his side could have won.
Solihull are still two points adrift of safety but a run of five wins in eight National League games has given them a real chance of survival.
“We’ve played two teams who are fighting to get out of the division and we’ve beaten Dover and so nearly beaten Wrexham,” Yates said.
“It was a tight game and one goal would have been enough. We had a few chances but it just didn’t quite go our way.
“The lads have got to keep believing. If we keep playing the way we are, particularly at home, we’ll be fine."
Asked about whether getting out of the bottom four would be a big psychological boost, Yates added: “That’ll take care of itself when we get the results and performances.
“The lads have been superb since we came in three months ago. We’ve improved enormously and we’ve taken big steps forward.
“The board have been fantastic and allowed us to bring in seven or eight new players into the group. We’ve found a system that works for us and we’ve been getting some good results.
“The message now is to keep that going and make sure the belief we have in the group transmits to the fans.”
For more news, reaction and action from across the National League, like us on Facebook and follow us on Twitter and Instagram.