Neil Jenkins scored 23 points as Pontypridd ground out another win to stay on course for a place in the Celtic League quarter-finals.
The Borders outscored their hosts by three tries to one and proved they are getting better with every game, despite the fact they remain winnless in the Celtic League.
"It was a hard earned victory and we didn't really perform. It was disappointing, but at least it was a win," said acting skipper Jon Bryant.
The robust Borders pack drove New Zealand flanker Campbell Feather over the home line for the game's first try in the opening half. That broke the deadlock after Kevin Utterson and Jenkins had swapped early kicks.
In the second half, Scotland and Lions outside half Gregor Townsend ghosted over for a try at the posts, but the ever reliable boot of Jenkins kept his side in contention.
Then some quick thinking from Wales back row man Michael Owen from a five metre penalty earned Ponty a try.Owen caught the Borders defenders napping as he ignored a penalty opportunity for Jenkins and drove over the line.
Jenkins added the wide angled conversion to leave the Scots chasing two scores to win.
In the end, they managed to send international wing Craig Moir racing 30 metres fro a try which Utterson converted with the last kick of the game to ensure a bonus point for the visitors.
Pontypridd lost their international flanker Richard Parks with a facial injury in the second half when he got a finger in his eye.
Scorers: Pontypridd: Try: M Owen; Con: N Jenkins: Pens: N Jenkins 6; DG: N Jenkins. Scottish Borders: Tries: C Feather, G Townsend, C Moir; Cons: K Utterson 3; Pens: K Utterson 2.
As the countdown continues for RWC2015, Tournament Chief Executive Debbie Jevans visited the Millennium Stadium to discuss preparations for the eight matches and reveal the positive news that 100,000 tickets for games at the home of Welsh rugby have sold in the last seven days.
Jason Harries is targeting a first win on the World Series circuit this season with Wales. The series returns to action this weekend in Dubai where Harries is part of a team hoping to build from its efforts in round one in October.
Wales skipper Jevon Groves says his side have addressed a few points from Gold Coast and aim to 'hit the ground running' in the next two rounds of the World Series, kicking off with this weekend in Dubai before heading off to South Africa next week.
Wales Sevens manager Steff Thomas is hopeful his side can build from a quarter-final spot in the opening round of the World Series in Australia when his side take part in the forthcoming double header in Dubai and South Africa.