Kevin Blackwell was disappointed his first game in charge as Bury could only leave Stevenage with a draw.
Tom Hopper opened the scoring for The Shakers midway through the first half with a powerful header, but two goals in as many minutes for Stevenage saw the hosts take the lead after the break.
Substitute Mark Cullen secured the point for Bury five minutes from the end, tapping in a pass from Hopper.
“If I am being honest, I am slightly disappointed after that,” Blackwell said afterwards.
“I thought we had good control of the game but we had a ten minute spell where we handed the initiative back to Stevenage – they gladly took it and got their two goals – but I think that’s the first time we have seen the lads show a really god bit of character.
“I’ve only had two training sessions with them and I know a lot more about them now after the game than I did before. I’ve learnt a lot about them and from what I have seen, when we got the ball down and moved it quickly and sharply, we looked a good side.”
Blackwell was under no illusions about the magnitude of the task ahead though, with Bury currently bottom of the table having gained only four points from nine games.
“There’s plenty to build on – we have to start from somewhere and Saturday was a good start.”
The ex-Sheffield United manager, who was only unveiled as Bury boss five days ago must now look ahead to tomorrow’s game, when the Shakers will face Carlisle at home.