Neil Jenkins scored 23 points as Pontypridd ground out another win to stay on course for a place in the Celtic League quarter-finals.
The Borders outscored their hosts by three tries to one and proved they are getting better with every game, despite the fact they remain winnless in the Celtic League.
"It was a hard earned victory and we didn't really perform. It was disappointing, but at least it was a win," said acting skipper Jon Bryant.
The robust Borders pack drove New Zealand flanker Campbell Feather over the home line for the game's first try in the opening half. That broke the deadlock after Kevin Utterson and Jenkins had swapped early kicks.
In the second half, Scotland and Lions outside half Gregor Townsend ghosted over for a try at the posts, but the ever reliable boot of Jenkins kept his side in contention.
Then some quick thinking from Wales back row man Michael Owen from a five metre penalty earned Ponty a try.Owen caught the Borders defenders napping as he ignored a penalty opportunity for Jenkins and drove over the line.
Jenkins added the wide angled conversion to leave the Scots chasing two scores to win.
In the end, they managed to send international wing Craig Moir racing 30 metres fro a try which Utterson converted with the last kick of the game to ensure a bonus point for the visitors.
Pontypridd lost their international flanker Richard Parks with a facial injury in the second half when he got a finger in his eye.
Scorers: Pontypridd: Try: M Owen; Con: N Jenkins: Pens: N Jenkins 6; DG: N Jenkins. Scottish Borders: Tries: C Feather, G Townsend, C Moir; Cons: K Utterson 3; Pens: K Utterson 2.
The WRU has launched a campaign to create a long term legacy for Welsh club rugby by highlighting the advantages of volunteering. Rhian Edwards, a volunteer at Seven Sisters, has enjoyed many benefits of her volunteering at a grassroots rugby club including being part of the Rugby World Cup volunteer workforce after being nominated by the WRU - and the WRU is asking for more people to develop their 'Welsh rugby roots'.
Wales head coach Warren Gatland and captain Sam Warburton say their first prioirty on Sunday in the opening game of the World Cup is to win against Uruguay and not get overly concerned with points difference.
With only days to go until the biggest rugby competition in the world begins, rugby fans visiting Cardiff this autumn will be able to enjoy a special display at National Museum Cardiff as part of the celebrations surrounding the Rugby World Cup.
Geraint John has taken up the new role of WRU elite coach development manager having arrived in Wales last week. WRU TV caught up with him at the WRU rugby department's strategy day at the Millennium Stadium.
The entire Welsh Rugby Union Rugby Department gathered at the Millennium Stadium earlier this week where WRU Head of Rugby Josh Lewsey looked back on a year where structural and strategic changes have seen significant progress made
The Welsh Rugby Union has released a specially produced video to spearhead a new campaign to help promote the values of rugby union. The video, entitled Let us Play underpins the WRU rugby department's philosophy - to engage, transfer and retain players, coaches and referees.