Neil Jenkins scored 23 points as Pontypridd ground out another win to stay on course for a place in the Celtic League quarter-finals.
The Borders outscored their hosts by three tries to one and proved they are getting better with every game, despite the fact they remain winnless in the Celtic League.
"It was a hard earned victory and we didn't really perform. It was disappointing, but at least it was a win," said acting skipper Jon Bryant.
The robust Borders pack drove New Zealand flanker Campbell Feather over the home line for the game's first try in the opening half. That broke the deadlock after Kevin Utterson and Jenkins had swapped early kicks.
In the second half, Scotland and Lions outside half Gregor Townsend ghosted over for a try at the posts, but the ever reliable boot of Jenkins kept his side in contention.
Then some quick thinking from Wales back row man Michael Owen from a five metre penalty earned Ponty a try.Owen caught the Borders defenders napping as he ignored a penalty opportunity for Jenkins and drove over the line.
Jenkins added the wide angled conversion to leave the Scots chasing two scores to win.
In the end, they managed to send international wing Craig Moir racing 30 metres fro a try which Utterson converted with the last kick of the game to ensure a bonus point for the visitors.
Pontypridd lost their international flanker Richard Parks with a facial injury in the second half when he got a finger in his eye.
Scorers: Pontypridd: Try: M Owen; Con: N Jenkins: Pens: N Jenkins 6; DG: N Jenkins. Scottish Borders: Tries: C Feather, G Townsend, C Moir; Cons: K Utterson 3; Pens: K Utterson 2.
Roger Lewis talks to WRU TV at the announcement of a new £60 million Rugby Services Agreement (RSA) which provides a new and positive contractual relationship between the WRU and its four Regions for the next six years has been agreed.
The Welsh Rugby Union has announced a major new sponsorship deal with Gullivers Sports Travel which will make the UK's leading, and longest established, multi-sport tour operator, an Official Supplier for the rest of the decade.
Having taken part in seven World Cups as a player and coach, Liza Burgess hopes to go out in style this afternoon when Wales take on Australia in the Play-off for seventh and eighth place in the Women's Rugby World Cup in Paris.
WRU Head of Rugby Josh Lewsey met with volunteers across the game earlier this week, championing their role in the sport. He was joined by Wales captain Sam Warburton for part of the day as volunteers took part in a 'Try Out' event for the 2015 Rugby World Cup
Wales Women may not have got the results they wanted recently on the field, but off it they have made massive strides in strength and conditioning - and that is in no small part due to S&C coach Sam Dodge.
Two weeks into the new pitch project at Millennium Stadium, Groundman Craig Campbell takes staff on a unique behind-the-scene tour of the works so far and National Squad Assistant Strength and Conditioning Coach John Ashby and Tour Guide Peter Owen describe what the revamp means for them.
Try-scorer Jenny Davies and fellow prop Megan York reveal to WRU TV's Graeme Gillespie their thoughts after Wales broke their drought in the Women's Rugby World Cup with a 35-3 win over South Africa in Paris.