West Indies appeared to be cruising towards their first win of the series after Gayle's devastating knock and a patient 63 from Ramnaresh Sarwan.
But Brett Lee and Nathan Bracken claimed a combined two for five in the 48th and 49th overs to halt the hosts.
Michael Hussey's sublime diving catch to remove debutant Shawn Findlay off Lee's bowling in the 48th over wrested much of the momentum back Australia's way.
And when Shivnarine Chanderpaul (53) fell to Bracken with the last ball of the 48th over, a target that had appeared attainable suddenly appeared distant.
Earlier, man of the match Symonds shared a 127-run fifth-wicket partnership with David Hussey - standing in for injured skipper Ponting - to rescue the tourists from a tricky position at 129 for four.
Even a brief rain delay could not disrupt the rhythm of Symonds, who struck 10 fours and two sixes before becoming Fidel Edwards' first victim.
They then quickly dismissed James Hopes for a duck with the following ball, while David Hussey fell to Gayle as Australia lost three wickets for 10 runs.
The tourists will complete a 5-0 series victory if they win the final match in St Kitts on Sunday.