Gray selected an unchanged team following the convincing weekend win against Aberdeen at Pittodrie, and the momentum from that performance was apparent in the early stages in Gorgie.
They could have had a penalty when Rowles appeared to inadvertently handle in his own box, but from the corner that followed, they hit the front.
Josh Campbell – who was an effective aerial presence throughout – met Cadden’s inswinging delivery, and the ball deflected off Rowles’ head and past Gordon in the Hearts goal.
Having originally disallowed the goal for Bushiri blocking Gordon’s line of sight, referee Nick Walsh was advised by VAR John Beaton to review the incident, after which the goal was given.
Cadden’s left foot provided a constant threat, while his twin brother Chris bombed up and down from right-back.
There were chances for Martin Boyle and Elie Youan to add a second before a lapse in concentration from Bushiri undid the preceding good work.
Lawrence Shankland’s header was going harmlessly wide, but the centre-back swung a leg at it and wildly sliced his clearance into the back of his own goal.
However, Gayle delivered the decisive moment of quality on 78 minutes, and Hibs then showed real character to see the game through.
So often they have thrown away leads with late concessions, but they seem to have turned a corner in recent weeks and their fans showed appreciation by roaring them through the final 10 minutes.
It’s now four wins from five, and Hibs are closing in on the league’s top six before they welcome Kilmarnock to Easter Road on Sunday.
