"The boys played really well on Saturday," he said.
"It was an important win as it keeps our season going. As I said before, we need a good run in the Cup this year as we've not done so well in the League.
"Pontypridd are the strongest side but there's no-one I really want to avoid at this stage of the draw.
"Let's just hope we're at home in the next round and we can continue to build on that win."
Horgan's side turned the table on Keys after they were on the end of a 35-7 defeat at The Gnoll in the league the week before.
And Horgan believes Neath can only improve from here on in.
"The week before we just weren't clinical enough," he said.
"We gave the ball away and knocked on too much. This week we tightened everything up and focussed on being more clinical.
"The win could have been bigger as we missed two golden opportunities in the first half which would have taken us 20 points in front.
"But in the end I couldn't have asked for more and their endeavour was excellent.
"We've a few more coming back from injury too who may play at Bridgend next Saturday so it will give the opportunity for people to start fighting for places."