Wales have enjoyed some success over the Wallabies in recent years with two triumphs in the last seven clashes between the sides.
And Elsom has recalled on those memories and insisted Wales still pose a major threat to the Australian team that conquered New Zealand on the weekend.
"We have had some trouble here in the past," said Elsom ahead of the mouth-watering Cardiff encounter.
"There was the draw in 2006 and a couple of losses either side. They're an attacking team who've had some pretty good successes against us in the past.
"Obviously that is something we will look at and we know how strong they are going to be.
"We've developed as a team and have made progress. It is a smaller task that we have to get on top of now.
"But consistency is something that has eluded us and that is something we're working on. We play well one week but need to do it over two, three, four weeks. We need to play well throughout the tour."