The only change before kick off saw Gifford come back from injury to replace Jasper Mather who is due to return next week.Alfie Bridgman did well to dig out a low cross but it was swiftly hacked clear in the early stages.
Then a Calvin Davies freekick was swung in dangerously but it was headed up and then Shaun Rowley gathered it.
Ibitayo Oyebola had a freekick he hit directly at goal on 9 minutes. Thankfully for Bognor, Hall was there to punch it away.
Then Davies had a shot from outside the box which swung wide after a corner kick was awarded to the Rocks.
Harvey Whyte teed up Pattenden again on the right. He dragged the ball back to Dan Smith who won a corner after trying to turn and shoot on 14 minutes.
Frankie Raymond got a cross in from another freekick and it was George Porter who scooped a header in at goal but Hall did superbly to tip that over the bar on 17 minutes.
However, Cray took the lead on minutes and it was another dangerous cross by the visitors that Bognor failed to deal with and Gary Lockyer beat Joe Rabbetts to the ball before unleashing an unstoppable strike beyond Hall to take the lead.
Cameron Black tripped up Gifford on the turn on 23 minutes. Davies hit his freekick directly high and out of play for a goal kick though in response.
On 24 minutes it was Pattenden who crossed it into Gifford who placed it on a plate for Smith but he belted his shot wide of the left post as early as he could when he had perhaps more time to compose himself and get it on target.
Pattenden did well again to cross it to Gifford but he fell to ground and was not able to backheel the ball in with Rowley gathering the loose ball low to his right.
Then Pattenden had to receive treatment for a knock on the run but did return to play on 33 minutes.
Soon after, Hall managed to divert it wide from his own hip after Rabbetts was bamboozled as Oyebola had a strike. The ball bounced only just wide of the goal, and the Rocks were able to clear the danger.
Smith smacked another chance wide of the goal as another square ball by Pattenden picked him out on 42 minutes.
To end the half, Ben Anderson did well to cross for Smith with his right sided corner and his header was good but straight at Rowley.
Davies bundled down Raymond in a clumsy challenge on 50 minutes as Bognor started just as well as they had played in the first half.
Raymond played a low ball in from the freekick of which Hall gathered on 52 minutes.
Porter and Spencer Spurway both went into the book on 53 minutes after a freekick was awarded to the visitors in their own half.
A ball came in from the left hand side and it was Whyte who swung his boot at it and he forced Rowley into a parried save on 60 minutes.
Then a powerful cross by Pattenden picked out Isasc Olaniyan on the back post but he diverted his header over the bar.
Smith had another chance from another cross but stubbed his effort wide.
Bognor won a penalty on 67 minutes as Pattenden was deemed to have been tripped on the run into the area. Many thought that the defender had got the ball in the challenge. But up stepped Gifford but hitting it with power his attempt flew high over the goal.
Then Yahya Bamba committed Hall into an unusual back-bending, headed save from just outside his box steering the ball wide on 77 minutes.
Olaniyan was set through on goal again on 80 minutes but he somehow smashed his chance over the bar after hard work from Higgs and Smith in the build up.
Goalkeeper Rowley got caught time wasting on 85 minutes and aas rightfully shown a yellow card.
But Bognor kept battling and Gifford made up for his earlier missed penalty by swerving a boot at it on the turn. He found the net after Smith put Rowley under pressure forcing him to push the ball in the air where Gifford was waiting to put in on 87 minutes.
Cray were on the backfoot and Rocks capitalised after great work by Pattenden and Whyte on the right saw a swift cross dispatched by Gifford 3 minutes into stoppage time, sending the Rocks fans into wild celebrations.
But it wasn’t quite over as when he was called into action, Bognor’s golden glove winner for December, Hall, was there to acrobatically push away a sure fire headed chance from a swift left-sided cross to secure the win and three points for Bognor. A true game-winning save.
Rocks are playing well at home but will hope to continue in this fine form away from home next as they travel to Hashtag United on Saturday 13 January with kick off at 3pm.
Rocks: Hall, Whyte, Rabbetts, Davies (c) (Higgs 72), Spurway, Robson, Pattenden, Anderson, Smith, Gifford, Bridgman (Olaniyan 56). Subs not used: Burgess, Briffa, Douglas.