Horgan knows his side are in for a tough test against a team who are, in reality, only five places behind them albeit across two divisions.
"It's the most important game of the season for us so far and the boys are looking forward to it," he said.
"We desperately want to get through to the semi-finals,"
With home advantage and in a division above their opposition, you'd think Neath would be confident of going through.
But Bargoed's shock defeat of Premiership side Bridgend in the last round will serve as a reminder to the threat they can pose.
"We won't be taking them lightly," Horgan added.
"There's only about five or six places between us and them in reality and I'm sure that's what they will be telling their players.
"They're doing well in the Championship standings and they beat Bridgend in the last round. Last season they went to Aberavon and had a good win so they're a good side. They're a physical bunch and we will need to be at the top of our game."
Neath were edged out at Rodney Parade in their last fixture - Newport the winners by a single point in their Premiership clash. Horgan though, is confident of a positive result on Saturday.
"It was good to not have a game last weekend, it means that some of the boys have recovered from their bumps and bruises from the last couple of games and we had a good session on Tuesday," he said.
"We've had good numbers in training and Euros Evans is just one who should be back from injury. We're trying to explore a brand of rugby where we keep the ball in hand and go through lots of phases.
"Our ball in play time is pretty high as those who were at our recent wins over Bedwas and Cross Keys will tell you.
"We're all really looking forward to Saturday and hopefully we should have a good crowd at The Gnoll to cheer us on."
Championship side Bargoed have had a tremendous season of their own so far and sit in second place behind Ebbw Vale. They also boast a giant-killing cup pedigree having knocked out Aberavon last year despite being down to 14 men.
And their coach Steve Barber says a repeat performance is not unlikely.
"We played Neath in the cup about three years and lost narrowly but we're happy with our game at the moment," he said.
"We'll try and run the ball as usual and we're looking forward to what should be a great occasion.
"There will be a couple of changes from the Bridgend game but we definitely have a chance."
Neath from: Aaron Bramwell, Gareth King, Kevin James, Elliot Jones, Bowdy Davies, Lloyd Phillips, John Leyshon, Chris Morgans, David Langdon, Luc Jones, Ben Jones; Roy Jones, Rowan Davies, Alun Wyn Davies, Aled Williams, Rhodri Clancy, Stuart Vokes, Greg Cunniffe, Ceri Jones, Mark Davies, Rhys Jones, Euros Evans, Jonny Griffiths, Lee Evans, Gareth Gravell (C), Steffan Jones, Matthew Rees, Leon Ward.
Bargoed: 15 Andrew Mclaughlin 14 Gareth Dare 13 Darren Humphries 12 Simon Parry 11 Lee Pearson 10 Josh Prosser 9 James Pizey, 1 James Howe 2 Leigh Meades (C) 3 Craig Nutt 4 Darren Lynch 5 Marc Gwilt 6 Gareth Davies 7 Alex Herbert 8 Lewis Weyman.
Replacements: Rhys Morgan, James Blake, Aaron Elliott, Lee Williams, Grant Rogers, Mikey Roberts
Daffyd Carter, Matthew Hutcheon.